toasters March 2009

toasters@lists.teaparty.net

51 participants
26 discussions

Re: FCP Partner Path Misconfigured - Host I/O access through a non-primary and non-optimal path was detected.
by Angelescu, Silviu 06 Mar '09

06 Mar '09

Make sure ALUA is enabled on Solaris as well as on NetApp and set the cfmode to single image on NetApp. I suspect ALUA may be off on Solaris. If you installed the host utilities for solaris run "basic_config -ssd_set", "reboot -- -r", "stmsboot -e" (do not let stmsboot to reboot; use reboot instead in next step), "reboot -- -r". This should work. Silviu . ________________________________ From: Linux Admin To: Brad Knowles Cc: Jack Lyons ; NetApp Toasters List Sent: Thu Mar 05 17:15:45 2009 Subject: Re: FCP Partner Path Misconfigured - Host I/O access through a non-primary and non-optimal path was detected. I am bit confused, even Solaris 10 with MPIO has problme figure out what correct path to take It has 2 path on san (sw1 and sw2) and efectivly 4 path to lun (netapp1 and netapp2 are connected each into sw1 and sw2) Why would both Solaris and ESX server access netapp1 luns via netapp2 for most parts? Should I just kill fabric mash and have netap1-sw1 and netap2-sw2 to simplify things? Do host utulities for Solaris help with that at all? On Thu, Mar 5, 2009 at 3:59 PM, Brad Knowles <brad(a)shub-internet.org> wrote: Linux Admin wrote: I solaris 10 as bad about this as ESX server? I also see the same issue with Solaris server Ironically, I overheard my co-workers talking about this very subject outside my office just a few minutes ago. There are apparently still problems with ESX with Linux (and maybe Solaris) VMs where there is a minor hiccup and the pre-configured primary path is replaced by ESX with the alternate path. Unlike what happens when you do a VMotion, the OS is not stopped by ESX during this process -- all the VM sees is that the disks have gone away (albeit for a brief period of time), so they mark the disks as read-only and then you're hosed until someone logs in and reboots the VM or otherwise fixes it. I think this is caused by a disconnect with the multipathing done at the ESX level and no multipathing done at the VM level. I strongly suspect you'll need to install multipathing software at the VM level that is compatible with the multipathing used by your storage -- so, EMC PowerPath, if the underlying storage is on EMC, etc.... Even if ESX is doing multipathing just fine, that doesn't necessarily mean that the hosted VMs can also automatically do multipathing in a way that will work with what the storage vendor supplies, what ESX does, and so on. Our solution is that the storage is simply never allowed to go down, and we don't touch anything that is served to the ESX machines without first getting prior approval and coordination with the ESX administrators, as well as with the appropriate VM administrators. And when you have hundreds of VMs on a set of ESX servers in a single infrastructure which could potentially be VMotion'ed at any time from one node to another, that is a hell of a lot of pre-coordination. Even the slightest bump of a cable could do something that the storage or ESX doesn't like, they do their multipath thing, and then all the affected VMs on the box are screwed. Oops. -- Brad Knowles <brad(a)shub-internet.org> If you like Jazz/R&B guitar, check out LinkedIn Profile: my friend bigsbytracks on YouTube at <http://tinyurl.com/y8kpxu> http://preview.tinyurl.com/bigsbytracks

2 1

fcp stats command
by ifstat 06 Mar '09

06 Mar '09

Hi Not sure if I should be paranoid or not. but can anyone explain to me what interrupts are when using hte fcp stats command? I having a performance problem and ESX Administration says that certain ESX servers are loosing connection to their LUNs, but the Netapp doesn't report anything and neither do the FC switches. Statistics for adapter 1b Read Ops: 871 Write Ops: 10987 Other Ops: 412 KBytes In: 71180 KBytes Out: 7713 Adapter Resets: 0 Frame Overruns: 0 Frame Underruns: 0 Initiators Connected: 18 Link Breaks: 0 LIP Resets: 0 SCSI Requests Dropped: 0 Interrupts: 31203 Spurious Interrupts: 0 Total Logins: 0 Total Logouts: 0 CRC Errors: 0 Queue Depth: 0 -- View this message in context: http://www.nabble.com/fcp-stats-command-tp22367594p22367594.html Sent from the Network Appliance - Toasters mailing list archive at Nabble.com.

1 0

Re: FCP Partner Path Misconfigured - Host I/O access through a non-primary and non-optimal path was detected.
by Linux Admin 05 Mar '09

05 Mar '09

I am bit confused, even Solaris 10 with MPIO has problme figure out what correct path to take It has 2 path on san (sw1 and sw2) and efectivly 4 path to lun (netapp1 and netapp2 are connected each into sw1 and sw2) Why would both Solaris and ESX server access netapp1 luns via netapp2 for most parts? Should I just kill fabric mash and have netap1-sw1 and netap2-sw2 to simplify things? Do host utulities for Solaris help with that at all? On Thu, Mar 5, 2009 at 3:59 PM, Brad Knowles <brad(a)shub-internet.org> wrote: > Linux Admin wrote: > > I solaris 10 as bad about this as ESX server? >> I also see the same issue with Solaris server >> > > Ironically, I overheard my co-workers talking about this very subject > outside my office just a few minutes ago. > > There are apparently still problems with ESX with Linux (and maybe Solaris) > VMs where there is a minor hiccup and the pre-configured primary path is > replaced by ESX with the alternate path. Unlike what happens when you do a > VMotion, the OS is not stopped by ESX during this process -- all the VM sees > is that the disks have gone away (albeit for a brief period of time), so > they mark the disks as read-only and then you're hosed until someone logs in > and reboots the VM or otherwise fixes it. > > I think this is caused by a disconnect with the multipathing done at the > ESX level and no multipathing done at the VM level. I strongly suspect > you'll need to install multipathing software at the VM level that is > compatible with the multipathing used by your storage -- so, EMC PowerPath, > if the underlying storage is on EMC, etc.... > > Even if ESX is doing multipathing just fine, that doesn't necessarily mean > that the hosted VMs can also automatically do multipathing in a way that > will work with what the storage vendor supplies, what ESX does, and so on. > > > Our solution is that the storage is simply never allowed to go down, and we > don't touch anything that is served to the ESX machines without first > getting prior approval and coordination with the ESX administrators, as well > as with the appropriate VM administrators. > > And when you have hundreds of VMs on a set of ESX servers in a single > infrastructure which could potentially be VMotion'ed at any time from one > node to another, that is a hell of a lot of pre-coordination. > > Even the slightest bump of a cable could do something that the storage or > ESX doesn't like, they do their multipath thing, and then all the affected > VMs on the box are screwed. Oops. > > -- > Brad Knowles > <brad(a)shub-internet.org> If you like Jazz/R&B guitar, check out > LinkedIn Profile: my friend bigsbytracks on YouTube at > <http://tinyurl.com/y8kpxu> http://preview.tinyurl.com/bigsbytracks >

1 0

SnapMirror between N-series and FAS?
by Nils Vogels 04 Mar '09

04 Mar '09

Hi list! Just a quick question: Has anyone ever tried to make SnapMirror work between IBM N-series and NetApp FAS? And most importantly: Did it work? ;) Greetings, Nils -- Simple guidelines to happiness: Work like you don't need the money, Love like your heart has never been broken and Dance like no one can see you.

5 5

programs to stress/saturate nfs traffic on filer
by Roscoe P Coltraine 03 Mar '09

03 Mar '09

i want to generate and measure as much load as possible on a unix host via nfs to our filer to capture the max throughput the host can generate. we have used iozone but this does not generally saturate the server or the filer. what i am looking for is something along the lines of host can sustain X MB/sec throughput and at the same time measure the filers performance/response. im sure someone has a page with tools on this somewhere

4 3

How to determine how new (yet to be installed) systems FC ports are configured?
by Romeo Theriault 01 Mar '09

01 Mar '09

Hello all, We have a 3050 cluster that we will be upgrading to a 3170 cluster soon. Our 3050 cluster uses the onboard fiber channel ports 0c and 0d as targets. I'm wondering if the 3170 will use these same ports as targets or if it comes preconfigured with some other set of ports as targets? I know you can specify if you want a port as a target or an initiator with the fcadmin command but would like to avoid the step in the upgrade process if their was some way for me to tell which ports it was going to use as targets ahead of time. Thanks for any help. -- Romeo Theriault System Administrator Information Technology Services

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters March 2009