toasters August 2013

toasters@lists.teaparty.net

38 participants
21 discussions

System status degraded after hot adding 2 DS4243 shelves
by Alexander Griesser 19 Aug '13

19 Aug '13

Hey there, the second question today, sorry for that :) I did attach two DS4243 shelves to a FAS3240HA system today and followed all the instructions, the shelf firmware has been updated in this process and everything looks good as far as I can tell, I can see the 6 shelves now on both controllers, all shelves are multi path ready, disks are visible, etc. One controller shows its health status as OK but the other one shows degraded: robin> system health status show Status --------------- Degraded The reason for that seems to be: Node: robin Resource: Disk 0a.06.10 Severity: Major Probable Cause: Disk 0a.06.10 does not have two paths to controller robin but the containing disk shelf 6 does have two paths. Disk 0a.06.10 may be faulty. Possible Effect: Access to disk 0a.06.10 via controller robin will be lost with a single hardware component failure (e.g. cable, HBA, or IOM failure). Corrective Actions: 1. Reseat disk 0a.06.10 following the rules in the Installation and Service Guide. 2. Wait six minutes for the alert condition to clear. 3. If reseating disk 0a.06.10 fails to clear the alert condition, replace disk 0a.06.10. 4. Wait six minutes for the alert condition to clear. 5. Contact support personnel if the alert persists. 48 entries were displayed. There are exactly 48 entries in the log for all the new 48 disks I added to the systems. If it would really be a disk or shelf fault, I guess I should see these errors on the second controller too, but I cannot see them there. Any ideas what I could to now to diagnose this issue further? I think the usual problems like broken cables, etc. can be ruled out since the second controller is not showing these issues, right? Thanks in advance, bye, Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH Telefon: +43-463-208501-320 Telefax: +43-463-208501-500 E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

4 19

Identifying Heavily Accessed Files / Clients
by Ray Van Dolson 13 Aug '13

13 Aug '13

Dear Lazyweb; Wondering if there's a sysstat/nfsstat type command that will show me which "files" (or which initiating NFS clients) are absorbing or generating the most traffic? Trying to figure out which VMDK files or ESX clients are to blame for a recent spike in activity. Ray

4 3

options weirdness
by Peter D. Gray 13 Aug '13

13 Aug '13

Can someone who knows tell me whats going on here? We recently discovered a security issue with our netapp filers when using NFS. The netapps where allowing NFS mounts and operations from non-privilaged client ports. Investigation found the options nfs.nfs_rootonly and nfs.mount_rootonly options. nfs.mount_rootonly was true, but nfs.nfs_rootonly was false. I was kind of surprized by this, since I had no recollection of ever altering either of these options yet the settings were identical across all our filers. The environment is: 3170A running 8.2 3240 running 8.2 3240 running 8.1 (reverted from 8.2) Ok, so I asked another nearby site to check there filers for me and they tell me their filers have no such setting, all on 8.1 So, I guess my questions are: 1) has ONTAP always allowed NFS from non-privilaged ports? 2) was nfs.nfs_rootonly introduced in 8.2 and why is the default off? 3) why does this setting stay around after revert to 8.1? It would seem to me that allowing NFS from non-privilages ports is kind of bad. Any help appreciated. Regards, pdg

4 7

vFiler DR and Oncommand Core (DFM)
by Martin 09 Aug '13

09 Aug '13

We've been using vFiler DR for some time now without any issues. Recently we noticed that some of our qtrees on some new vFilers were not being discovered in Oncommand Core (5.1). After speaking with Netapp support they highlighted that there is a known issue (no bug or KB article AFAIK) where the passive DR vFilers cause exactly the issue we are seeing. On their advice we deleted the DR vFilers from Oncommand Core via the DFM CLI. As soon as we did this the new qtrees on the vFilers were detected. However when we flipped our vFilers from one site to another using vFiler DR: 1. Stop the active vFiler. 2. Resync the previously active to the DR vFiler. 3. Activate the DR vFiler 4. Cleanup snapmirrors and reverse snapmirror. We found that none of the volumes on the vFilers that were activated could be seen. On checking the vFilers on DFM we could see the active vFiler and several deleted instances of the DR vFilers. When I attempted to delete the vFilers so that I could readd them I got an SQL error as they were references by views and other objects in the DFM database. Netapp support then pointed me to this article: https://kb.netapp.com/support/index?page=content&id=3012455 which mentions: “With the ONTAP vFiler DR feature, it is possible to have two instances of the exact same path; one path on the active vFiler and one path on the standby vFiler.”. The article relates to Protection Manager but the root cause is the same. Support then mentioned that Vfiler DR appears to be incompatible with Oncommand Core. Has anyone else experienced this or have a workaround for it? Currently we would have to flip the vFilers, delete the vFilers, purge the database (after taking backup) and then restart the database so that it can rediscover the vFilers. This isn't workable but really don't want to go back to manually destroying and creating vFilers as it's time consuming and error prone. -- View this message in context: http://network-appliance-toasters.10978.n7.nabble.com/vFiler-DR-and-Oncomma… Sent from the Network Appliance - Toasters mailing list archive at Nabble.com.

1 0

7.3.4 10gb question
by David Byte 08 Aug '13

08 Aug '13

Hey folks, I have a lab box that is a 3020 with 7.3.4.(I know, I should go 7.3.7) and I have an x1005a-r5 (chelsio 10gb) in it. The network config is a 2 layer vif with leg1 being a multi of 4-1gb ports and leg2 being the 10gb nic. The 2 legs are in a single mode vif favoring the 10gb. All ports are connected to a stack of extreme networks summit 400-48t switches. When running over the 10Gb leg, I cannot get any jumbo frame packets to show crossing the switch. However, if I flip to leg1 (the multi of 1gb) jumbo frames are flying across. It's tough for me to admit as a former Netapp SE, but I am stumped. Any thoughts or suggestions? Sent from my iPhone. Typos are Apple's fault.

3 3

RPC error during ndmpcopy
by Jeff Cleverley 08 Aug '13

08 Aug '13

Greetings, I'm getting the following error when I run a ndmpcopy from one filer to another. Both are 8.1.2P4. Command: ndmpcopy -sa ndmpuser:QIxwKig5bnpwdAyB -d -l 0 source:/vol/old_sd28/Gold /vol/restore_test/Gold Error: Ndmpcopy: source: Log: DATA: Backup terminated: backup configuration failure (2) on RPC error: ERROR: BAD ENV OP (for /vol/old_sd28/Gold) I've looked in the messages, ndmpd, ems, and other logs and can't find anything useful. I thought using the -d was turning on debugging so I'm not sure what else to try. I assume it is telling me there is a bad environmental option but I don't know what it is. Ultimately I'm trying to find the fastest way to get data from a secondary filer that is a snapvault destination back to the primary filers. We don't currently have the SnapRestore licenses on these heads. Thanks, Jeff -- Jeff Cleverley Unix Systems Administrator 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611

1 0

Snapmirror throttle not working
by Jeff Cleverley 06 Aug '13

06 Aug '13

Greetings, I'm running 8.1.2P4, 7-mode on some 6290s. I need to do some snapmirrors to re-balance some disk space. The -k option to throttle the transfer doesn't seem to be having any effect. I've tried modifying the placement of the -k but it doesn't seem to matter. I also tried to modify it after it was running and it doesn't seem to help either. Here is the command I'm running: snapmirror initialize -S sm15_3 -k 10000 new_sm15_3 If I'm understanding correctly, this should be allowing 10MB/s. The source and destination are on the same file system. Here is a cut of a sysstat 3 after starting it: CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 73% 598 0 0 2091 349080 338016 271 0 0 7 71% 1019 0 0 2046 319892 324019 13114 0 0 0s 71% 2800 0 0 3880 330527 343528 17379 0 0 7 69% 1440 0 0 3405 330279 392647 22343 0 0 0s 87% 1614 0 0 2128 320151 607753 168553 0 0 0s 87% 827 0 0 5652 244701 584436 371689 0 0 0s 91% 897 0 0 4242 344072 680454 386373 0 0 0s As you can see, the disk read/write counts go way up. This is causing some noticeable latency in the nfs access for clients. While I really like the new hardware can pump data around, I need to be able to control it. What am I doing wrong? Thanks, Jeff -- Jeff Cleverley Unix Systems Administrator 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611

7 13

Re: updating disk qual files on many controllers
by Jack Lyons 05 Aug '13

05 Aug '13

You can use unc's and not worry drive letters Jack ------Original Message------ From: Scott Eno To: Jack Lyons Cc: Jordan Slingerland Cc: toasters-bounces(a)teaparty.net Cc: tmac Cc: Toasters Subject: Re: updating disk qual files on many controllers Sent: Aug 5, 2013 11:03 AM Correct. Not enough letters in the alphabet and my dfm host is win2008, although I cheated a bit by installing Cygwin and associated sshd service. ---- Scott Eno s.eno(a)me.com On Aug 5, 2013, at 11:00 AM, Jack Lyons <jack1729(a)gmail.com> wrote: > You can do this similarly with cifs and unc's. I assume the significance of 30+ is due to drive mappings? > Sent from my Verizon Wireless BlackBerry > > -----Original Message----- > From: Jordan Slingerland <Jordan.Slingerland(a)independenthealth.com> > Sender: toasters-bounces(a)teaparty.net > Date: Mon, 5 Aug 2013 14:53:24 > To: tmac<tmacmd(a)gmail.com>; Scott Eno<s.eno(a)me.com> > Cc: Toasters<Toasters(a)teaparty.net> > Subject: RE: updating disk qual files on many controllers > > _______________________________________________ > Toasters mailing list > Toasters(a)teaparty.net > http://www.teaparty.net/mailman/listinfo/toasters > > Sent from my Verizon Wireless BlackBerry

4 3

updating disk qual files on many controllers
by Scott Eno 05 Aug '13

05 Aug '13

Hi, I've got an environment of 30+ controllers, some with NFS licensed and some without, but all with CIFS. I'm trying to figure out a way to push drive qual files (and eventually the firmware files) to all the controllers without going one-at-a-time (batch vs. by hand). 30+ means I can't mount them all via CIFS at the same time, and with half of them without NFS licensed I can't mount them via NFS to, say, a linux host. I was looking into using DFM to push the files to all the controllers, but it doesn't seem to work with anything but the config files it can pull off the controllers first. Anyone have a favorite method?

6 7

Recommendations for adding new bigger disk shelves to existing system
by Alexander Griesser 03 Aug '13

03 Aug '13

Hey there, I just got two new DS4243 450GB 15k SAS Shelves and am about to add them to our FAS3240HA. Right now, 4 DS4243 300GB 15k SAS disks are attached to this HA pair, 2 shelves for each controller. Since 300GB disks cannot be purchased anymore, we got the 450GB shelves and I'm reluctant to just "throw away" about 5TB of usable SAS space by downsizing the 450GB disks to 300GB when adding them to the existing aggregates, or does this only apply to RAID groups? So if I create new RAID groups in the existing aggregates, will I then be able to use the "full" [0] size of the 450GB disks? Thanks, [0] After rightsizing and all other nice things NetApp does to the full capacity of the disks :) Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH Telefon: +43-463-208501-320 Telefax: +43-463-208501-500 E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

3 5

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters August 2013