Depends on how many nodes you have.
They reserve port 13-20 (8 ports) as an ISL.
That allows you to connect up to 12 nodes.
There is an expansion slot on the 5010 to allow
for more ISL's and more nodes, if needed. I think they take you to
a set of 5020's for a full 24-node cluster.

Oh, and you may think it seems excessive, it is if you only have a handful of nodes.
But, if you are purchasing from NetApp, they basically, "throw in" the extra switches.
i.e. the 5010's and the 2960's

SFO - Storage failover
CFO - Controller Failover

CFO is used when you have a two node system. It is basically the same thing as failover in 7-mode/ONTAP7

Storage Failover allows for only aggregates to failover, not necessarily waiting on the controller. Since there is a global
namespace and logical interfaces, controller failover is not needed when using more than 2 nodes.

And as been said a few times now...you get no SFO/CFO capability in the simulator. they are only
stand alone nodes.

--tmac
         Tim McCarthy
     Principal Consultant

  RedHat Certified Engineer
   804006984323821 (RHEL4)
   805007643429572 (RHEL5)


On Mon, Jul 23, 2012 at 10:57 AM, John Stoffel <john.stoffel@taec.toshiba.com> wrote:

tmac> It is not terribly bad, but the filesystems are not compatible
tmac> at all.  ALL data is wiped/disks are zero'd

tmac> Plus you need to get license keys from NetApp for cluster mode.
tmac> Set some environment variables.

tmac> Make sure you have proper networking...  i.e. 2 x Cisco 5010
tmac> switches solely for the cluster backend and 2 x Cisco 2960
tmac> switches for the administration network and then whatever
tmac> networking you want to add on top of that for your data
tmac> network(s).

This seems amazingly excessive.  You can't use those same two Cisco
5010s for boththe cluster *and* the management?  It's got 20 10gib/s
ethernet ports, how many do you need for the backend?

tmac> Make sure you have multi-path storage properly configured.

tmac> You are best off getting the simulator and playing with that for
tmac> a while to see how it goes. The downside to the simulator is
tmac> that it now longer supports ha mode (it did way back in 7.x
tmac> days, but not not so much) so you end up with two single nodes
tmac> with now sfo/cfo capability.

I assume you meant "no sfo/cfo" instead?  But could you please explain
sfo/cfo as well?  Is that 'single failover/cluster failover' like I
suspect?  I'm certainly motivated to spin up the simulator to start
getting used to this new OS and to see how it would impact us if/when
we upgrde our existing systems.

John
    John Stoffel - Senior Staff Systems Administrator - System LSI Group
  Toshiba America Electronic Components, Inc. - http://www.toshiba.com/taec
             john.stoffel@taec.toshiba.com - 508-486-1087