assuming i have two loops (id 00-04, and 10-18) 1 4 port sas card (0a-0d)
loop 1 00A connects to 001a 0a 00B connects to 001b 0a ... 04A connects to 001b 0b 04B connects to 001a 0b loop2 10A connects to 001a 0c 10B connects to001b 0c ... 18A connects to 001b 0d 18B connects to 001a 0d
KEY = 00A = Shelf ID 00 Module A 001A = Filer 001a/b 0a = SAS port A
Its been a long three days of no sleep, but this is mpha, correct ?
Are you running 7.3.3 or later? What does sysconfig -a tell you? The top part tells you if it's Multi-Path HA or Mixed-Path.
NetApp Release 8.0.1P4 7-Mode: Sat Apr 2 13:41:25 PDT 2011 ....... System Rev: A2 System Storage Configuration: Multi-Path HA System ACP Connectivity: Full Connectivity ........
-Blake
On Wed, Nov 16, 2011 at 3:27 PM, Chaim Rieger chaim.rieger@gmail.com wrote:
assuming i have two loops (id 00-04, and 10-18) 1 4 port sas card (0a-0d)
loop 1 00A connects to 001a 0a 00B connects to 001b 0a ... 04A connects to 001b 0b 04B connects to 001a 0b loop2 10A connects to 001a 0c 10B connects to001b 0c ... 18A connects to 001b 0d 18B connects to 001a 0d
KEY = 00A = Shelf ID 00 Module A 001A = Filer 001a/b 0a = SAS port A
Its been a long three days of no sleep, but this is mpha, correct ?
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Chaim,
Download WireGauge (http://now.netapp.com/NOW/download/tools/wiregauge/) and try it out. It is very handy for trying to figure out mixed path configuration.
Jeff
On Wed, Nov 16, 2011 at 5:04 PM, Blake Golliher thelastman@gmail.com wrote:
Are you running 7.3.3 or later? What does sysconfig -a tell you? The top part tells you if it's Multi-Path HA or Mixed-Path.
NetApp Release 8.0.1P4 7-Mode: Sat Apr 2 13:41:25 PDT 2011 ....... System Rev: A2 System Storage Configuration: Multi-Path HA System ACP Connectivity: Full Connectivity ........
-Blake
On Wed, Nov 16, 2011 at 3:27 PM, Chaim Rieger chaim.rieger@gmail.com wrote:
assuming i have two loops (id 00-04, and 10-18) 1 4 port sas card (0a-0d)
loop 1 00A connects to 001a 0a 00B connects to 001b 0a ... 04A connects to 001b 0b 04B connects to 001a 0b loop2 10A connects to 001a 0c 10B connects to001b 0c ... 18A connects to 001b 0d 18B connects to 001a 0d
KEY = 00A = Shelf ID 00 Module A 001A = Filer 001a/b 0a = SAS port A
Its been a long three days of no sleep, but this is mpha, correct ?
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Running 732, don't have access to the cluster, physical or cli. Just trying to double check my layout before i ask the local folks to cable her up. On Nov 16, 2011 4:04 PM, "Blake Golliher" thelastman@gmail.com wrote:
Are you running 7.3.3 or later? What does sysconfig -a tell you? The top part tells you if it's Multi-Path HA or Mixed-Path.
NetApp Release 8.0.1P4 7-Mode: Sat Apr 2 13:41:25 PDT 2011 ....... System Rev: A2 System Storage Configuration: Multi-Path HA System ACP Connectivity: Full Connectivity ........-Blake
On Wed, Nov 16, 2011 at 3:27 PM, Chaim Rieger chaim.rieger@gmail.com wrote:
assuming i have two loops (id 00-04, and 10-18) 1 4 port sas card (0a-0d)
loop 1 00A connects to 001a 0a 00B connects to 001b 0a ... 04A connects to 001b 0b 04B connects to 001a 0b loop2 10A connects to 001a 0c 10B connects to001b 0c ... 18A connects to 001b 0d 18B connects to 001a 0d
KEY = 00A = Shelf ID 00 Module A 001A = Filer 001a/b 0a = SAS port A
Its been a long three days of no sleep, but this is mpha, correct ?
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
You've got the paths starting from one head, going down the stack of shelves, and then the final cable crossing over to the other head. That's how it is supposed to be cabled. Just need your ACP connections and you're all set.
----- Original Message ----- From: "Chaim Rieger" chaim.rieger@gmail.com To: "Blake Golliher" thelastman@gmail.com Cc: toasters@teaparty.net Sent: Wednesday, November 16, 2011 5:08:18 PM Subject: Re: mpha confusion
Running 732, don't have access to the cluster, physical or cli. Just trying to double check my layout before i ask the local folks to cable her up. On Nov 16, 2011 4:04 PM, "Blake Golliher" < thelastman@gmail.com > wrote:
Are you running 7.3.3 or later? What does sysconfig -a tell you? The top part tells you if it's Multi-Path HA or Mixed-Path.
NetApp Release 8.0.1P4 7-Mode: Sat Apr 2 13:41:25 PDT 2011 ....... System Rev: A2 System Storage Configuration: Multi-Path HA System ACP Connectivity: Full Connectivity ........
-Blake
On Wed, Nov 16, 2011 at 3:27 PM, Chaim Rieger < chaim.rieger@gmail.com > wrote:
assuming i have two loops (id 00-04, and 10-18) 1 4 port sas card (0a-0d)
loop 1 00A connects to 001a 0a 00B connects to 001b 0a ... 04A connects to 001b 0b 04B connects to 001a 0b loop2 10A connects to 001a 0c 10B connects to001b 0c ... 18A connects to 001b 0d 18B connects to 001a 0d
KEY = 00A = Shelf ID 00 Module A 001A = Filer 001a/b 0a = SAS port A
Its been a long three days of no sleep, but this is mpha, correct ?
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Chaim,
The only thing I see from the DS4243 installation guide is they want ports A&B connecting to different stacks if there are multiple stacks. As far as I know, this is more of a redundancy issue on the SAS card chips and should work anyway.
If the local folks have access to a NOW account, they can install WireGauge on a PC there. It can check the array via the network. The package is just over 16 MB which you might be able to email to them. Just be aware the default setting is to generate an autosupport each time you run it :-)
What is the core of the confusion that is keeping you up at night? Are you not seeing some disks, only one path, etc? The SAS cabling on the DS4243 shelves can be rather confusing. You might have the local people make sure all the connectivity lights are on at each port on the shelf. It is easy to have a cable in the slot but not fully clicked in.
Jeff
On Wed, Nov 16, 2011 at 6:08 PM, Chaim Rieger chaim.rieger@gmail.com wrote:
Running 732, don't have access to the cluster, physical or cli. Just trying to double check my layout before i ask the local folks to cable her up.
On Nov 16, 2011 4:04 PM, "Blake Golliher" thelastman@gmail.com wrote:
Are you running 7.3.3 or later? What does sysconfig -a tell you? The top part tells you if it's Multi-Path HA or Mixed-Path.
NetApp Release 8.0.1P4 7-Mode: Sat Apr 2 13:41:25 PDT 2011 ....... System Rev: A2 System Storage Configuration: Multi-Path HA System ACP Connectivity: Full Connectivity ........
-Blake
On Wed, Nov 16, 2011 at 3:27 PM, Chaim Rieger chaim.rieger@gmail.com wrote:
assuming i have two loops (id 00-04, and 10-18) 1 4 port sas card (0a-0d)
loop 1 00A connects to 001a 0a 00B connects to 001b 0a ... 04A connects to 001b 0b 04B connects to 001a 0b loop2 10A connects to 001a 0c 10B connects to001b 0c ... 18A connects to 001b 0d 18B connects to 001a 0d
KEY = 00A = Shelf ID 00 Module A 001A = Filer 001a/b 0a = SAS port A
Its been a long three days of no sleep, but this is mpha, correct ?
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
You might want to look up the "Universal SAS and ACP Cabling Guide" to see the Best Practice rules for doing this. As one of the other posters suggested, the resiliency would be better if you swapped a few paths below. The "Universal...Guide" explains why, defines an algorithm you can follow to come up with a cable plan and shows a handful of examples that should be helpful. If the doc isn't helpful, tell us (the list and/or NetApp) what's confusing so we can improve it.
BTW, in the doc we tend to say things like "top of stack" and "bottom of stack". In your example below, one stack is shelf ID's 0-4, and the other stack is shelf ID's 10-18. Assuming you have shelves in each stack chained together sequentially, you can then define the lowest number in each stack as the top and the highest number in each stack as the bottom (or vice versa; it's arbitrary). Then follow the rules in the guide.
Brad.
From: Chaim Rieger <chaim.rieger@gmail.commailto:chaim.rieger@gmail.com> Date: Wed, 16 Nov 2011 17:08:18 -0800 To: Blake Golliher <thelastman@gmail.commailto:thelastman@gmail.com> Cc: <toasters@teaparty.netmailto:toasters@teaparty.net> Subject: Re: mpha confusion
Running 732, don't have access to the cluster, physical or cli. Just trying to double check my layout before i ask the local folks to cable her up.
On Nov 16, 2011 4:04 PM, "Blake Golliher" <thelastman@gmail.commailto:thelastman@gmail.com> wrote: Are you running 7.3.3 or later? What does sysconfig -a tell you? The top part tells you if it's Multi-Path HA or Mixed-Path.
NetApp Release 8.0.1P4 7-Mode: Sat Apr 2 13:41:25 PDT 2011 ....... System Rev: A2 System Storage Configuration: Multi-Path HA System ACP Connectivity: Full Connectivity ........
-Blake
On Wed, Nov 16, 2011 at 3:27 PM, Chaim Rieger <chaim.rieger@gmail.commailto:chaim.rieger@gmail.com> wrote:
assuming i have two loops (id 00-04, and 10-18) 1 4 port sas card (0a-0d)
loop 1 00A connects to 001a 0a 00B connects to 001b 0a ... 04A connects to 001b 0b 04B connects to 001a 0b loop2 10A connects to 001a 0c 10B connects to001b 0c ... 18A connects to 001b 0d 18B connects to 001a 0d
KEY = 00A = Shelf ID 00 Module A 001A = Filer 001a/b 0a = SAS port A
Its been a long three days of no sleep, but this is mpha, correct ?
Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
If this is a new installation, there is step by step guide: https://now.netapp.com/NOW/knowledge/docs/hardware/filer/215-05500_A0.pdf
As already mentioned, it is recommended to not use adjacent HBA ports for the same stack (i.e. a/b or c/d). There is nothing new, the same rules existed for FC HBA. According to above document, "canonical" layout would be a/d and c/b. ________________________________________ From: toasters-bounces@teaparty.net [toasters-bounces@teaparty.net] On Behalf Of Chaim Rieger [chaim.rieger@gmail.com] Sent: Thursday, November 17, 2011 05:08 To: Blake Golliher Cc: toasters@teaparty.net Subject: Re: mpha confusion
Running 732, don't have access to the cluster, physical or cli. Just trying to double check my layout before i ask the local folks to cable her up.
On Nov 16, 2011 4:04 PM, "Blake Golliher" <thelastman@gmail.commailto:thelastman@gmail.com> wrote: Are you running 7.3.3 or later? What does sysconfig -a tell you? The top part tells you if it's Multi-Path HA or Mixed-Path.
NetApp Release 8.0.1P4 7-Mode: Sat Apr 2 13:41:25 PDT 2011 ....... System Rev: A2 System Storage Configuration: Multi-Path HA System ACP Connectivity: Full Connectivity ........
-Blake
On Wed, Nov 16, 2011 at 3:27 PM, Chaim Rieger <chaim.rieger@gmail.commailto:chaim.rieger@gmail.com> wrote:
assuming i have two loops (id 00-04, and 10-18) 1 4 port sas card (0a-0d)
loop 1 00A connects to 001a 0a 00B connects to 001b 0a ... 04A connects to 001b 0b 04B connects to 001a 0b loop2 10A connects to 001a 0c 10B connects to001b 0c ... 18A connects to 001b 0d 18B connects to 001a 0d
KEY = 00A = Shelf ID 00 Module A 001A = Filer 001a/b 0a = SAS port A
Its been a long three days of no sleep, but this is mpha, correct ?
Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
thanx all,
i had the guys cable it as i stated, modified ports so that no loop goes to two adjacent sas port, and it is mpha.
the three days was because of another issue.
have a real issue now, and will be posting shortly
-
Blake Golliher -
Borzenkov, Andrey -
Chaim Rieger -
Jeff Bryer -
Jeff Cleverley -
Reger, Brad