no there is no switch between the filer and Sun box, using crossover fiber jumper scenario.
yes, both machines are set to FULL flow control. Here's a sysstat 1 before, during & after
I create a 100MB file, using mkfile:
CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache
in out read write read write age
3% 52 0 0 19 43 0 0 0 0 38
3% 65 2 0 11 10 0 0 0 0 38
4% 35 2 0 51 13 0 0 0 0 38
3% 6 23 0 167 10 0 0 0 0 38
4% 36 23 0 14 5 0 0 0 0 38
4% 29 79 0 72 28 52 0 0 0 38
38% 10 260 0 22 57 4412 10316 0 0 38
6% 20 2 0 36 136 3 0 0 0 38
59% 601 1 0 13398 374 0 0 0 0 38
82% 398 16 0 9009 291 4684 14874 0 0 38
73% 572 23 0 12229 363 2972 7208 0 0 38
87% 457 2 0 10112 326 3688 16404 0 0 38
80% 327 0 0 9509 284 5980 14176 0 0 38
73% 520 15 0 14158 405 1093 5053 0 0 38
93% 342 0 0 8070 269 7148 18589 0 0 38
68% 356 2 0 9640 283 5428 11073 0 0 38
82% 591 0 0 11667 346 4112 9208 0 0 38
88% 562 3 0 8520 506 6740 15836 0 0 38
32% 135 1 0 4585 271 1077 4032 0 0 38
3% 19 0 0 4 4 0 0 0 0 38
CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache
in out read write read write age
3% 64 0 0 3 2 0 0 0 0 38
3% 48 0 0 14 12 0 0 0 0 38
3% 17 2 0 13 10 0 0 0 0 38
3% 4 12 0 30 5 0 0 0 0 38
3% 4 12 0 4 2 0 0 0 0 38
On Wed, 06 Sep 2000, Paul Albers wrote:
! Marcus,
!
! Do you have flow control enabled on both Rx and Tx on the
! port the filer is connected to on the switch? If not, try enabling
! it and retest. How does the filer look during writes and
! reads ( sysstat 1 )? Also, what is the configuration of the
! filer ( cards in what slots? ).
!
! Regards,
!
! -paul
!
! Marcus Smiley wrote:
!
! > slot 8
! >
! > On Wed, 06 Sep 2000, Larry Armstrong wrote:
! >
! > ! Howdy!
! > !
! > ! Out of curiousity, what slot do you have your GbE card in?
! > !
! > ! ---larry >:)
! > ! _
! > ! * Marcus Smiley (marcus.smiley(a)ericsson.com) done spit this rhetoric:
! > ! > Does anyone have any benchmarks/suggestions for poor performace with
! > ! > gigabit ethernet between Sun enterprise 220R and NetApp 740 with Intel
! > ! > GBII card? I have an open ticket w/Netapp and it's been open
! > ! > forever. These machines are directly attached (private network), and
! > ! > I've tried a mkfile and copying that file back during the day and at
! > ! > night (no load) and it makes no difference.
! > ! >
! > ! > The performance is ~ 10 MB/s, no matter what.
! > ! >
! > ! > The Sun is running Solaris 8, with latest GB Ethernet 3.0 drivers
! > ! > and patches. Also, the Sun box's only function is Legato server,
! > ! > so I've even stopped all nsr daemons while the test copy/mkfile
! > ! > is in progress, & it makes no difference.
! > ! >
! > ! > I've tried NFSv2 vs. NFSv3, with 32k size packets and 8k size packets.
! > ! > I've tried tcp and udp, with the same results.
! > ! >
! > ! > The /etc/system file on the E220R looks like this, for the ge adapter:
! > ! >
! > ! > * Increase size of STREAMS syncronized queues to increase network
! > ! > * performance. Release notes for qfe card recommends setting this
! > ! > * to 25 per 64Mbytes of RAM in the system. It also prevents
! > ! > * receive overrun on the GbE interface. msmiley 7/20/00
! > ! >
! > ! > set sq_max_size=775
! > ! > set ge:ge_adv_1000autoneg_cap=0
! > ! > set ge:ge_adv_1000fdx_cap=1
! > ! > set ge:ge_adv_pauseTX=1
! > ! >
! > ! > Also, I've set tcp/udp specific stuff per the Netapp tech suppt. folks:
! > ! >
! > ! > ndd -set /dev/udp udp_recv_hiwat 65535
! > ! > ndd -set /dev/udp udp_xmit_hiwat 65535
! > ! > ndd -set /dev/tcp tcp_recv_hiwat 65535
! > ! > ndd -set /dev/tcp tcp_xmit_hiwat 65535
! > ! >
! > ! > The netapp is a 740 (5.3.6R1P1) with over 100GB of free space available on the
! > ! > volume I'm copying to/from.
! > ! >
! > ! > Interestingly enough, I have done a packet trace (pktt) on the GBII
! > ! > card and it looks OK. Also, the throughput from my 100BaseT card to
! > ! > the netapp (thru a catalyst 5500) does ~ 7.5 MB/s.
! > ! >
! > ! > *Any* input here would be much appreciated.
! > ! >
! > ! > -Marc
! > ! >
! > ! >
! > ! >
! > ! > Marcus Smiley | Ericsson Wireless Communications, Inc.
! > ! > Unix Sys Admin | 6210 Spine Rd. Boulder, CO 80301 | Ph (303) 473-6903
! > ! >
! > !
! > ! --
! > ! Larry Armstrong
! > ! <surfer(a)netapp.com>
! > !
! > ! bovarism n. - A magnified opinion of one's own abilities.
! >
! > Marcus Smiley | Ericsson Wireless Communications, Inc.
! > Unix Sys Admin | 6210 Spine Rd. Boulder, CO 80301 | Ph (303) 473-6903
!
! --
! "Nothing will benefit human health and increase the chances of survival
! of life on earth as much as the evolution to a vegetarian diet."
!
! -Albert Einstein
!