Crap :-(
NetApp - when are you going to enable ToE and EtherChannel together?
This bombs my plans pretty quickly. Maybe I can change it now before it's too late.
________________________________
From: Myles Uyema [mailto:mlists@uyema.net] Sent: Wednesday, May 21, 2008 10:21 PM To: Glenn Walker Cc: Jean-Noel Filippi; Milazzo Giacomo; toasters@mathworks.com Subject: Re: 10 Gbps curiosity
With TOE disabled we maxxed out a 6070 head at 375MBytes per second on 7.2.4. NFS only. Network domain pegged at 100%.
With TOE enabled on 7.3RC1 we saw 815MBytes per second. 60% network domain.
PCI-X single port TOE, 100 clients reading sequentially.
</phone>
On May 21, 2008, at 2:58 PM, "Glenn Walker" ggwalker@mindspring.com wrote:
We're deploying FAS6070s with 2 x Active\ 2 x Passive 10GbE Single Mode, multi-level VIFs (Etherchannel) per head for VMWare over NFS. Looks good so far, so I'll let the group know how this turns out...
FWIW, I have the same concerns over CPU, but I'm hedging my bets that the FAS6070s are such beasts that they won't really care.
________________________________
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Jean-Noel Filippi Sent: Wednesday, May 21, 2008 2:18 PM To: Milazzo Giacomo; mailto:toasters@mathworks.com toasters@mathworks.com Subject: RE: 10 Gbps curiosity
We use 2 x FAS6080 with redundant 10GE in a VIF single mode. They are connected to Force10 C300 switches.
We generated up to 4Gbit of CIFS traffic and everything works well.
________________________________
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 8:11 AM To: mailto:toasters@mathworks.com toasters@mathworks.com Subject: 10 Gbps curiosity
Hi all
Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I'm looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches :-) - and so on. So that, more on the relatively new world of 10 Gbps networks.
Does anyone direct experience? Are you using it in your site?
Thanks in advance
FWIW, the documentation states that ToE with 10GbE is disabled when part of a VIF. I originally thought this meant 'etherchannel' given that LACP wasn't supported with 10GbE, but re-reading it appears to imply _any_ VIF, even single-mode (it wasn't specified, so I have to assume any VIF).
This is less than stellar - what good is having an interface that is a SPOF? Unless this documentation is incorrect, I have no choice but to remain without ToE :-(
________________________________
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Glenn Walker Sent: Wednesday, May 21, 2008 11:05 PM To: Myles Uyema Cc: Jean-Noel Filippi; Milazzo Giacomo; toasters@mathworks.com Subject: RE: 10 Gbps curiosity
Crap :-(
NetApp - when are you going to enable ToE and EtherChannel together?
This bombs my plans pretty quickly. Maybe I can change it now before it's too late.
________________________________
From: Myles Uyema [mailto:mlists@uyema.net] Sent: Wednesday, May 21, 2008 10:21 PM To: Glenn Walker Cc: Jean-Noel Filippi; Milazzo Giacomo; toasters@mathworks.com Subject: Re: 10 Gbps curiosity
With TOE disabled we maxxed out a 6070 head at 375MBytes per second on 7.2.4. NFS only. Network domain pegged at 100%.
With TOE enabled on 7.3RC1 we saw 815MBytes per second. 60% network domain.
PCI-X single port TOE, 100 clients reading sequentially.
</phone>
On May 21, 2008, at 2:58 PM, "Glenn Walker" ggwalker@mindspring.com wrote:
We're deploying FAS6070s with 2 x Active\ 2 x Passive 10GbE Single Mode, multi-level VIFs (Etherchannel) per head for VMWare over NFS. Looks good so far, so I'll let the group know how this turns out...
FWIW, I have the same concerns over CPU, but I'm hedging my bets that the FAS6070s are such beasts that they won't really care.
________________________________
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Jean-Noel Filippi Sent: Wednesday, May 21, 2008 2:18 PM To: Milazzo Giacomo; mailto:toasters@mathworks.com toasters@mathworks.com Subject: RE: 10 Gbps curiosity
We use 2 x FAS6080 with redundant 10GE in a VIF single mode. They are connected to Force10 C300 switches.
We generated up to 4Gbit of CIFS traffic and everything works well.
________________________________
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 8:11 AM To: mailto:toasters@mathworks.com toasters@mathworks.com Subject: 10 Gbps curiosity
Hi all
Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I'm looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches :-) - and so on. So that, more on the relatively new world of 10 Gbps networks.
Does anyone direct experience? Are you using it in your site?
Thanks in advance
Glenn Walker wrote:
FWIW, the documentation states that ToE with 10GbE is disabled when part of a VIF. I originally thought this meant 'etherchannel' given that LACP wasn't supported with 10GbE, but re-reading it appears to imply _any_ VIF, even single-mode (it wasn't specified, so I have to assume any VIF).
I can confirm that TOE gets disabled even with a single vif. The filer showed the following message while creating a single vif with 2 10 Gb ports:
"The system-wide TCP Offload Engine (TOE) functionality was changed to off due to vif on TOE restriction."
And I looks even worse considering it turns it off system wide, meaning you can't have TOE on a non-vif 10 Gb port next to a 10 Gb vif!
I hope they will enable TOE with vifs in the near future.
Yeah - I noticed the 'system-wide' part myself.
ToE and VIFs go together like peanut butter and jelly - time to make it happen, guys! :)
-----Original Message----- From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Pascal Dukers Sent: Thursday, May 22, 2008 1:57 AM To: toasters@mathworks.com Subject: RE: 10 Gbps curiosity
Glenn Walker wrote:
FWIW, the documentation states that ToE with 10GbE is disabled when
part
of a VIF. I originally thought this meant 'etherchannel' given that LACP wasn't supported with 10GbE, but re-reading it appears to imply _any_ VIF, even single-mode (it wasn't specified, so I have to assume any VIF).
I can confirm that TOE gets disabled even with a single vif. The filer showed the following message while creating a single vif with 2 10 Gb ports:
"The system-wide TCP Offload Engine (TOE) functionality was changed to off due to vif on TOE restriction."
And I looks even worse considering it turns it off system wide, meaning you can't have TOE on a non-vif 10 Gb port next to a 10 Gb vif!
I hope they will enable TOE with vifs in the near future.
-
Glenn Walker -
Pascal Dukers