no there is no switch between the filer and Sun box, using crossover fiber jumper scenario. yes, both machines are set to FULL flow control. Here's a sysstat 1 before, during & after I create a 100MB file, using mkfile:
CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 3% 52 0 0 19 43 0 0 0 0 38 3% 65 2 0 11 10 0 0 0 0 38 4% 35 2 0 51 13 0 0 0 0 38 3% 6 23 0 167 10 0 0 0 0 38 4% 36 23 0 14 5 0 0 0 0 38 4% 29 79 0 72 28 52 0 0 0 38 38% 10 260 0 22 57 4412 10316 0 0 38 6% 20 2 0 36 136 3 0 0 0 38 59% 601 1 0 13398 374 0 0 0 0 38 82% 398 16 0 9009 291 4684 14874 0 0 38 73% 572 23 0 12229 363 2972 7208 0 0 38 87% 457 2 0 10112 326 3688 16404 0 0 38 80% 327 0 0 9509 284 5980 14176 0 0 38 73% 520 15 0 14158 405 1093 5053 0 0 38 93% 342 0 0 8070 269 7148 18589 0 0 38 68% 356 2 0 9640 283 5428 11073 0 0 38 82% 591 0 0 11667 346 4112 9208 0 0 38 88% 562 3 0 8520 506 6740 15836 0 0 38 32% 135 1 0 4585 271 1077 4032 0 0 38 3% 19 0 0 4 4 0 0 0 0 38 CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 3% 64 0 0 3 2 0 0 0 0 38 3% 48 0 0 14 12 0 0 0 0 38 3% 17 2 0 13 10 0 0 0 0 38 3% 4 12 0 30 5 0 0 0 0 38 3% 4 12 0 4 2 0 0 0 0 38
On Wed, 06 Sep 2000, Paul Albers wrote:
! Marcus, ! ! Do you have flow control enabled on both Rx and Tx on the ! port the filer is connected to on the switch? If not, try enabling ! it and retest. How does the filer look during writes and ! reads ( sysstat 1 )? Also, what is the configuration of the ! filer ( cards in what slots? ). ! ! Regards, ! ! -paul ! ! Marcus Smiley wrote: ! ! > slot 8 ! > ! > On Wed, 06 Sep 2000, Larry Armstrong wrote: ! > ! > ! Howdy! ! > ! ! > ! Out of curiousity, what slot do you have your GbE card in? ! > ! ! > ! ---larry >:) ! > ! _ ! > ! * Marcus Smiley (marcus.smiley@ericsson.com) done spit this rhetoric: ! > ! > Does anyone have any benchmarks/suggestions for poor performace with ! > ! > gigabit ethernet between Sun enterprise 220R and NetApp 740 with Intel ! > ! > GBII card? I have an open ticket w/Netapp and it's been open ! > ! > forever. These machines are directly attached (private network), and ! > ! > I've tried a mkfile and copying that file back during the day and at ! > ! > night (no load) and it makes no difference. ! > ! > ! > ! > The performance is ~ 10 MB/s, no matter what. ! > ! > ! > ! > The Sun is running Solaris 8, with latest GB Ethernet 3.0 drivers ! > ! > and patches. Also, the Sun box's only function is Legato server, ! > ! > so I've even stopped all nsr daemons while the test copy/mkfile ! > ! > is in progress, & it makes no difference. ! > ! > ! > ! > I've tried NFSv2 vs. NFSv3, with 32k size packets and 8k size packets. ! > ! > I've tried tcp and udp, with the same results. ! > ! > ! > ! > The /etc/system file on the E220R looks like this, for the ge adapter: ! > ! > ! > ! > * Increase size of STREAMS syncronized queues to increase network ! > ! > * performance. Release notes for qfe card recommends setting this ! > ! > * to 25 per 64Mbytes of RAM in the system. It also prevents ! > ! > * receive overrun on the GbE interface. msmiley 7/20/00 ! > ! > ! > ! > set sq_max_size=775 ! > ! > set ge:ge_adv_1000autoneg_cap=0 ! > ! > set ge:ge_adv_1000fdx_cap=1 ! > ! > set ge:ge_adv_pauseTX=1 ! > ! > ! > ! > Also, I've set tcp/udp specific stuff per the Netapp tech suppt. folks: ! > ! > ! > ! > ndd -set /dev/udp udp_recv_hiwat 65535 ! > ! > ndd -set /dev/udp udp_xmit_hiwat 65535 ! > ! > ndd -set /dev/tcp tcp_recv_hiwat 65535 ! > ! > ndd -set /dev/tcp tcp_xmit_hiwat 65535 ! > ! > ! > ! > The netapp is a 740 (5.3.6R1P1) with over 100GB of free space available on the ! > ! > volume I'm copying to/from. ! > ! > ! > ! > Interestingly enough, I have done a packet trace (pktt) on the GBII ! > ! > card and it looks OK. Also, the throughput from my 100BaseT card to ! > ! > the netapp (thru a catalyst 5500) does ~ 7.5 MB/s. ! > ! > ! > ! > *Any* input here would be much appreciated. ! > ! > ! > ! > -Marc ! > ! > ! > ! > ! > ! > ! > ! > Marcus Smiley | Ericsson Wireless Communications, Inc. ! > ! > Unix Sys Admin | 6210 Spine Rd. Boulder, CO 80301 | Ph (303) 473-6903 ! > ! > ! > ! ! > ! -- ! > ! Larry Armstrong ! > ! surfer@netapp.com ! > ! ! > ! bovarism n. - A magnified opinion of one's own abilities. ! > ! > Marcus Smiley | Ericsson Wireless Communications, Inc. ! > Unix Sys Admin | 6210 Spine Rd. Boulder, CO 80301 | Ph (303) 473-6903 ! ! -- ! "Nothing will benefit human health and increase the chances of survival ! of life on earth as much as the evolution to a vegetarian diet." ! ! -Albert Einstein !