toasters June 2015

toasters@lists.teaparty.net

47 participants
29 discussions

Mystery quota on qtree?
by Jeff Cleverley 12 Jun '15

12 Jun '15

Greetings, I have a 8.1.2 7-mode cluster and was asked to adjust a couple of quotas. The problem is there doesn't appear to be a quota set on the trees. If I cd to the top of the volume and do a "df -h .", I get the volume totals. When I go into any of the sub-directories, it shows me different numbers for size allocated and used. The free is consistent at all levels but not the size and used. I've looked at the /etc/quotas, quota report, and viewed it through OnCommand. Nothing shows a quota limit. I've also run pwd-P and the df -h . both show I'm in the same file system and have not followed a symlink. The space reservation is volume and guaranteed, and snap reserve is at 0% utilized and has not grown beyond it's reserve. Below is the best I can give for details. Thanks, Jeff [root@admin storage1]# df -h . ## top level volume Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 2.4T 1.1T 1.3T 45% /net/filer2/vol/storage1 [root@admin storage1]# cd tools [root@admin tools]# df -h . Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 1.4T 71G 1.3T 6% /net/filer2/vol/storage1 [root@admin tools]# cd ../home [root@admin home]# df -h . Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1/home 1.5T 118G 1.3T 9% /net/filer2/vol/storage1/home [root@admin home]# cd .. [root@admin storage1]# df -h win_shares Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 2.2T 843G 1.3T 39% /net/filer2/vol/storage1 [root@admin etc]# cat quotas #Auto-generated by setup Tue Jun 4 03:55:56 GMT 2013 /vol/aus_ntshares/ashares tree - - - - - /vol/storage1/apps tree - - - - - /vol/storage1/home tree - - - - - /vol/storage1/tools tree - - - - - /vol/storage1/win_shares tree - - - - - [root@admin storage1]# ssh filer2 quota report K-Bytes Files Type ID Volume Tree Used Limit Used Limit Quota Specifier ----- -------- -------- -------- --------- --------- ------- ------- --------------- tree 1 storage1 apps 10421344 - 46712 - /vol/storage1/apps tree 2 storage1 home 123265872 - 796745 - /vol/storage1/home tree 3 storage1 tools 73659616 - 773186 - /vol/storage1/tools -- Jeff Cleverley IT Engineer 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611

4 4

Re: Disk auto assign
by Edward Rolison 12 Jun '15

12 Jun '15

Spot on - that's done the trick. Had '0a.01.0' with a foreign owner ID hiding in the list somewhere. I can only assume as part of a reboot/rebuild/pre-ship-test or something. Reassigned it to 'unowned' and all good. (well, a 'foreign aggr0(1)' showed up). On 11 June 2015 at 13:15, tmac <tmacmd(a)gmail.com> wrote: > SO, look at the output of disk show -a > The -n shows all non-owned disks. > > Look for disks not owned by either of your two nodes now. > If there are any disks owned by another party....ugh, little bit of work > involved. > > If not, do your best to verify which disks on which shelves are owned and > where. > > Sometimes it is helpful to run through the disks one by one, if possible, > use a sorting routine to put the disks in order to make looking at the list > easier. > > Let us know! > > > --tmac > > *Tim McCarthy* > *Principal Consultant* > > On Thu, Jun 11, 2015 at 8:12 AM, tmac <tmacmd(a)gmail.com> wrote: > >> any chance you can copy to a flash drive or the like? or is it more >> secure than that ;) >> >> >> --tmac >> >> *Tim McCarthy* >> *Principal Consultant* >> >> >> >> On Thu, Jun 11, 2015 at 8:11 AM, Edward Rolison <ed.rolison(a)gmail.com> >> wrote: >> >>> Sadly I can't - this is a system on an isolated network. I can re-type >>> parts of it, but that's probably not as useful. :/ >>> >>> On 11 June 2015 at 12:42, tmac <tmacmd(a)gmail.com> wrote: >>> >>>> Hey Edward, just for kicks, how about posting the "disk show -a" for us. >>>> >>>> Thanks >>>> >>>> --tmac >>>> >>>> *Tim McCarthy* >>>> *Principal Consultant* >>>> >>>> >>>> On Thu, Jun 11, 2015 at 7:26 AM, Edward Rolison <ed.rolison(a)gmail.com> >>>> wrote: >>>> >>>>> New disks are all listed in 'disk show -n'. I think that means they're >>>>> not assigned. (And a disk I've deliberately unassigned is also not being >>>>> reassigned). >>>>> >>>>> On 11 June 2015 at 12:12, Borzenkov, Andrei < >>>>> andrei.borzenkov(a)ts.fujitsu.com> wrote: >>>>> >>>>>> Are you sure new disks are unowned? It is not uncommon to get >>>>>> repurposed hardware. >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> *From:* Edward Rolison [mailto:ed.rolison@gmail.com] >>>>>> *Sent:* Thursday, June 11, 2015 2:09 PM >>>>>> *To:* Borzenkov, Andrei >>>>>> *Cc:* toasters(a)teaparty.net >>>>>> *Subject:* Re: Disk auto assign >>>>>> >>>>>> >>>>>> >>>>>> Sorry, should have said - also did this with the spares. I can see no >>>>>> drives on 'head1' sysconfig -r that are 'wrong' and likewise on 'head2'. >>>>>> >>>>>> >>>>>> Checked this with grepping 'partner' and ensuring they're all the >>>>>> right pair of controllers. (On both sides) >>>>>> >>>>>> >>>>>> >>>>>> On 11 June 2015 at 11:56, Borzenkov, Andrei < >>>>>> andrei.borzenkov(a)ts.fujitsu.com> wrote: >>>>>> >>>>>> If you just performed “replace” without un-/re-assigning drives that >>>>>> became spare, this is expected. Spares still belong to controller and will >>>>>> block auto assignment. >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> *From:* toasters-bounces(a)teaparty.net [mailto: >>>>>> toasters-bounces(a)teaparty.net] *On Behalf Of *Edward Rolison >>>>>> *Sent:* Thursday, June 11, 2015 1:09 PM >>>>>> *To:* toasters(a)teaparty.net >>>>>> *Subject:* Disk auto assign >>>>>> >>>>>> >>>>>> >>>>>> I've just added some new shelves to a (7-mode) filer pair, bring them >>>>>> up to two stacks of 10 shelves. >>>>>> >>>>>> I'm trying to get 'autoassign' working, and it isn't. >>>>>> >>>>>> I have: >>>>>> - swapped drives such that each 'head' has only disks from one >>>>>> 'stack'. >>>>>> >>>>>> Head 1 has 0a/5b >>>>>> >>>>>> Head 2 has 5a/5d >>>>>> >>>>>> >>>>>> >>>>>> I've had to manually trigger a small number of 'replace' operations. >>>>>> And then switched on autoassign in the options. >>>>>> >>>>>> I _think_ that should be it, but ... there's something I'm missing, >>>>>> because autoassign isn't working. >>>>>> >>>>>> >>>>>> >>>>>> Does anyone have suggestions for why this might be, or what else I >>>>>> could check? (I'm wondering if there's a misassigned but 'failed' drive >>>>>> that otherwise isn't showing up?) >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Toasters mailing list >>>>> Toasters(a)teaparty.net >>>>> http://www.teaparty.net/mailman/listinfo/toasters >>>>> >>>>> >>>> >>> >> >

1 0

Multiple (more than 2) controllers in a cluster
by Philip Gardner, Jr. 11 Jun '15

11 Jun '15

Hi all - We are currently building out a new space (long time in the making), and some employees have come and go in between the process. We ended up with a 2240, a 3250, and an 8040. The 8040 is fully updated with CDOT 8.3. We are now preparing to do the same to the 2240 and 3250. The 2240 has the 10Gb mezzanine card, and the 3250 has two 10Gb PCI cards. I'm still learning, basically as I go, but does it make any sense to put all these filers in the same cluster? If not, does it make sense to use the CN1610's for each of the filers' cluster connections? I'm trying to think of a reason the 2240 needs to be in the same cluster, but can't really think of one. The 3250...maybe, since it is a decent amount of power. I know from some of the docs I've seen that the 2240 can use one of the 10Gb ports to connect to the other head in a non-redundant fashion, while still allowing the use of the other 10Gb ports for the data connection. Googling for things about multiple filers in the same cluster is difficult, or no one is talking about it. Thoughts or ideas? -- GPG keyID: 0xFECC890C Phil Gardner

3 4

Max number of hosts.
by Brad Thompson 11 Jun '15

11 Jun '15

Hi all, Has anyone ever seen these messages or know what causes them: lmgr.hosts.maxedout: Number of hosts active 50000 has reached the maximum number of hosts supported 50000. No additional host structures can be created. Thanks! Brad

3 3

Disk auto assign
by Edward Rolison 11 Jun '15

11 Jun '15

I've just added some new shelves to a (7-mode) filer pair, bring them up to two stacks of 10 shelves. I'm trying to get 'autoassign' working, and it isn't. I have: - swapped drives such that each 'head' has only disks from one 'stack'. Head 1 has 0a/5b Head 2 has 5a/5d I've had to manually trigger a small number of 'replace' operations. And then switched on autoassign in the options. I _think_ that should be it, but ... there's something I'm missing, because autoassign isn't working. Does anyone have suggestions for why this might be, or what else I could check? (I'm wondering if there's a misassigned but 'failed' drive that otherwise isn't showing up?)

3 9

cluster OS vs 7-mode
by Iluhes 11 Jun '15

11 Jun '15

For years I been complaining how much I dont like Cluster OS over 7-mode.I been telling netapp folks to keep 7 mode as an option and parallel OSThe storage field is evolving and there are so many more options now and reading this, looks like people are might voiting against cluster OS with their feet. Am I right? NetApp 4Q: Channel Sales Fall, Clustered Data OnTap Transition Tough, Layoffs Coming | | | | | | | | | | | NetApp 4Q: Channel Sales Fall, Clustered Data OnTap Tra...NetApp told analysts that fourth-quarter 2015 sales and earnings took a big hit because of a slower-than-expected transition of customers to the company's new Clust... | | | | View on www.crn.com | Preview by Yahoo | | | | |

8 8

Dedicated ONTAP disks?
by Fletcher Cocquyt 06 Jun '15

06 Jun '15

I’m curious how many admins dedicate 3 disks for ONTAP aggr0/vol0 vs having one big aggr0 and vol0 residing on the same aggr as the other data volumes? Is there a compelling reason to dedicate disks to ONTAP besides “best practice” ? thanks

5 4

RE: Dedicated ONTAP disks? (Fletcher Cocquyt)
by Woods, Bill 05 Jun '15

05 Jun '15

The latest install was configured with dedicated aggregates just for vol0 (NetApp Best Practice - especially for CDOT systems). If you have an issue where the aggregate containing vol0 (with data volumes) "drops-out" or loses multiple drives, you MAY NOT be able to recover that aggregate. Regards, Bill ------------------------------ Message: 3 Date: Fri, 5 Jun 2015 13:44:14 -0700 From: Fletcher Cocquyt <fcocquyt(a)stanford.edu> To: "<toasters(a)teaparty.net> Lists" <toasters(a)teaparty.net> Subject: Dedicated ONTAP disks? Message-ID: <77C0C02C-A86A-4EE8-B281-C41510845454(a)stanford.edu> Content-Type: text/plain; charset="utf-8" I?m curious how many admins dedicate 3 disks for ONTAP aggr0/vol0 vs having one big aggr0 and vol0 residing on the same aggr as the other data volumes? Is there a compelling reason to dedicate disks to ONTAP besides ?best practice? ? thanks

1 0

need some reallocate advice
by Rhodes, Richard L. 05 Jun '15

05 Jun '15

Hi, A bunch of IBM NSeries 3220 (NetApp FAS2240-2) OnTap 8.1.2p1 I'm about to start adding 2 disks to a bunch of NetApp systems - 2 disks into each system to expand CIFS shares. I will need to run reallocate to spread the vols in the expanded aggregates. There are around 30 vols in each aggr, some tiny and some a couple TB. Reallocate start -f -p /vol/<vol> How have you handled reallocate of a large number of vols in a aggr? Would you just start them all and let them run? If not doing them all at once, I could script them one at a time from AIX via ssh, but I don't see a "-w" (wait) option to allow easy single threading. I would need a loop to monitor for a particular reallocate cmd completes before starting another. I'd rather not get into that much scripting effort. Note that there is snapmirror and snapvault running every 6 hours on these vols. I don't want to hit the systems so hard that these have problems. Thanks! Rick ----------------------------------------- The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters June 2015