toasters July 2015

toasters@lists.teaparty.net

47 participants
40 discussions

cDOT and Oracle
by Milazzo Giacomo 06 Jul '15

06 Jul '15

Hi everybody, one million dollar questions ;-) aka transition to cDot could be really a nightmare! The questions come not only from best practice and TR I've read (or I could read...) but your ideas about best ways to bring in cDot what now is deeply optimized in 7Mode. AS is - 7 Mode A lot of NFS volumes where to separate data/log/temp of each Oracle instance. Each volume is exported for access only to the hosts that manage binaries and db. In the production environment all instances are RAC while in development test most of them are RAC but some are also composed just by one server. 90% of hosts are VMware VM, some are phyical for RAC instances composed by a phys-virtual pair of hosts. Volumes are hosted on aggregates composed by SAS or FC discs depending on type and importance of workload. In test/dev there are mostly SATA vols but non only. Of course, all the instances are managed and replicated with the concurrent usage of Snapcreator and its integration with DFM Protection Manager that it's then integrated with Snapmirror To be - cDOT (8.3.1) <- we hope to be able to use SVM DR features somewhere... Each instance in a its own SVM? This could be a nightmare to manage ipspaces, dedicated lifs, flexvol that once assigned are locked to that SVM and so on.... Just one SVM for all NFS RAC? Maybe creating differente FlexVols with qtree for data/log/temp? Or on different aggregates? One or more SVM, few, just to balance the workloads between controllers? Is there an advantage offered by the juction paths that should be created? Every idea is accepted also is recently has been demonstrated that brainstorming is useless :) Regards, Dott. Giacomo Milazzo Senior Consultant & Technical Account Manager mobile: +39 340.6001045 @-mail: g.milazzo(a)sinergy.it<mailto:g.milazzo@sinergy.it> Web: http://www.sinergy.it<http://www.sinergy.it/> [cid:4DB1B876-8A76-4829-9B40-9B136E344F73@fastwebnet.it] SINERGY SpA Viale dei Santi Pietro e Paolo 50 00144 - Roma RM Tel. +39 06 44243674 Fax +39 06 44245272

2 2

NFS & TR4067
by Mark Flint 06 Jul '15

06 Jul '15

Think this may be a version specific issue, but I’m trying to get client stats out of an 8.2P6 CDOT system, preferably sorted so that I can see the top few clients. I’ve found the above TR by Justin (thanks :) ) but one of the useful commands seems not to work. I’m using “statistics settings modify -client-stats enabled” and it returns a not found, only reference is that the statistics setting modify command can only change the counter display rate :( Must be a way to do this, or do I have to try and write something? Got a bit of help from Douglas’ comments here yesterday, but still struggling…. ~Mark mark.flint(a)sanger.ac.uk

3 5

Re: Another SSD question
by Basil 05 Jul '15

05 Jul '15

I couldn't find anything about CIFS and Flash Pool not working together- could you send me a link? Flash Pool is at the aggregate level and shouldn't care what kind of data is in the volumes. On Sat, Jul 4, 2015 at 7:34 PM, Neil Stichbury <Neil.Stichbury(a)spark.co.nz> wrote: > As FlashPool & CIFS are (currently) mutually exclusive I can only see > FlashCache in CIFS environments in the future. The Netapp FlashPool sizing > suggestions are a good place to start and you can start small, keep an eye > on the stats and avoid diminishing returns. cDOT 8.3 supports partitions > and adding partitions is fine though removing them is not somewhere you > want to go! > > > > Speaking of future, the point at which it becomes more expensive to > assemble and provide a spinning disk assembly than a similar high-capacity > SSD will be an overnight game-changer consigning these arguments to the > archives. Any predictions on year/month? Sweepstake anyone? I’m not > sure that the industry really wants to see this happen, so make take a > while ;-) > > Neil > > > > *From:* toasters-bounces(a)teaparty.net [mailto: > toasters-bounces(a)teaparty.net] *On Behalf Of *Basil > *Sent:* Saturday, 4 July 2015 7:31 a.m. > *To:* Tony Bar > *Cc:* toasters(a)teaparty.net > *Subject:* Re: Another SSD question > > > > Thanks for the note about the card slots- I'm checking to see whether we > even have a spare. Also, that wafl awa command is precisely what I was > looking for, thanks! > > > > On Fri, Jul 3, 2015 at 2:57 PM, Tony Bar <tbar(a)berkcom.com> wrote: > > Basil - > > > > I would be very careful with choosing in this case. FlexPool may be > marginally more expensive but seeing as how the 8020 only has two PCIe > slots adding a FlashCache module will severely limit your expansion > options. If that other slot is occupied by another 10GbE card you'll be > limited to one SAS stack (10 shelves). Furthermore, per best practices, > mixing SAS/SATA drive types on the same stack is not encouraged (although > it can be done), so you're essentially limiting yourself to one drive > type. On the other hand, if the other slot is occupied by a SAS card then > you're limiting your connectivity options. If you're running CDOT you're > already going to be giving up two 10GbE onboard ports for the cluster > interconnect so effectively you have two 10GbE/FC ports per controller. If > in the future you decided you wanted to add a tape drive (FC) or more 10GbE > ports you'd be out of luck. > > > > Regarding performance, PCS doesn't really differentiate, and to be honest > for most real world situations I've seen it's a wash. The ability to have > write caching via FlashPool is very helpful for random overwrite workloads. > 'wafl awa' can help you determine the impact adding cache of either kind > will have on writes/reads and how much optimally you would need. It is > important to run it at a peak time to see what the recommendations are, as > running it during a relatively low activity period won't give much useful > information. > > Anthony Bar > 650.207.5368 > > tbar(a)berkcom.com > > > On Jul 3, 2015, at 10:03 AM, Basil <basilberntsen(a)gmail.com> wrote: > > So I'm looking at upgrading a few 8020s and trying to choose between > flashpool and flashcache. Flashpool is more expensive, even with just > 12x200 SSD drives, and we'd need to find space in a very tight rack for it. > The workload is 80% exchange and 20% VMWare, and we would like to use > deduplication without snapshots. > > > > Is it possible to use PCS to compare flashcache and flashpool benefits? > How can I translate the data I see from a stats show -p flexscale-access > into real numbers, like reduction of latency? > > _______________________________________________ > Toasters mailing list > Toasters(a)teaparty.net > http://www.teaparty.net/mailman/listinfo/toasters > > >

2 1

v3170 Setup
by Chris hansen 05 Jul '15

05 Jul '15

I have a old v3170 in my lab with one MK2 SATA shelve. I am trying to find documentation on setup for wiring and HA setup. I have one side working but can’t seem to get both sides working….assume I have some wiring wrong. Searching online I can’t find much out on this model. Thanks -Chris

3 2

Quickest way to format
by Camillo Gornati 03 Jul '15

03 Jul '15

Hello All! Via console, what is the quickest, easiest and safest way to destroy an aggregate and CIFS. Basically the best way to bring a FAS2040 to its factory condition. Thanks

4 3

Fixing NTFS permissions in cDOT 8.3 CIFS share
by John Stoffel 03 Jul '15

03 Jul '15

Guys, I've got a strange problem with a CIFS share on a cDOT 8.3 system. It's a small 2250 with some NFS storage for ESX and one volume with a single CIFS share. The local admin to making changes to permissions and managed to lock himself out completely. The top level share name is /MIS, and we can get into sub-folders (luckily!) but can't actually map the top level any more. I've opened a ticket, and I'm reading the man pages at: https://library.netapp.com/ecmdocs/ECMP1196891/html/GUID-3D32772D-B4E8-4497… but I'm hesitant to make changes. So here's some example info: ntap_019::*> vserver security file-directory show -vserver filestorage -path /MIS Vserver: filestorage File Path: /MIS Security Style: ntfs Effective Style: ntfs DOS Attributes: 10 DOS Attributes in Text: ----D--- Expanded Dos Attributes: - Unix User Id: 0 Unix Group Id: 0 Unix Mode Bits: 0 Unix Mode Bits in Text: --------- ACLs: NTFS Security Descriptor Control:0x9504 Owner:BUILTIN\Administrators Group:BUILTIN\Administrators DACL - ACEs ALLOW-FOO\MIT Admins-0x1f01ff-OI|IO ntap_019::*> vserver security file-directory show -vserver filestorage -path /MIS/UserDrives Vserver: filestorage File Path: /MIS/UserDrives Security Style: ntfs Effective Style: ntfs DOS Attributes: 10 DOS Attributes in Text: ----D--- Expanded Dos Attributes: - Unix User Id: 65534 Unix Group Id: 65534 Unix Mode Bits: 0 Unix Mode Bits in Text: --------- ACLs: NTFS Security Descriptor Control:0x8504 Owner:FOO\someone Group:FOO\Domain Users DACL - ACEs ALLOW-FOO\MIT Admins-0x1f01ff-OI|IO (Inherited) And since I'm a Linux/Netapp admin with limited understand of NTFS or Windows, I'm wondering what I can do to fix the permissions, or at least be able to open things up so that we can go in and fix it properly. I have tried setting up a 'vserver security trace filter create ...' but it never seemed to give me any results back. Is there any simple way I can just change the top level permissions to make them WIDE open, so they can be modified again? I even tried creating a new share, thinking that it was a share level issue, but it looks more like it's an NTFS permissions issue, which is why I'm stuck. Thanks, John

2 2

API calls to replicate a 'df'
by Edward Rolison 03 Jul '15

03 Jul '15

I'm currently fiddling with a project using the ONTAPI (perf stats monitoring sort of thing). What I'm wanting to do is reproduce the information from 'df' and 'df -s'. Doing well so far, because the api 'volume-list-info' seems to have most of the information I want. There's just one thing missing - how much of the 'snap reserve' I'm actually using. I can't seem to find it in either that, or the 'snapshot' counters. I would ideally be able to do this without having to do a per-volume calculation, because one of the things I'm hoping to do is support a lightweight proxy client that 'just' fetches source XML for processing on a server. Or is there a way I can calculate this from the size/used/available in the volume-list-info? Thanks, Ed

4 6

maxdirsize
by Rhodes, Richard L. 03 Jul '15

03 Jul '15

IBM N3220 - 2857-A22 (NetApp FAS2240-2) Data ONTAP Release 8.1.2P1 7-Mode We are trying to move a share from a EMC CX4 to a nSeries system. The method for moving is to mount both shares to a Win server and robocopy. The application using this share has a BUG - it creates little files and NEVER deletes them. There is now almost 10m files in the share, almost all of them in one directory. This bug won't be resolved anytime soon. ==> PROBLEM The robocopy runs, then fails with out of space condition. The filer gets the following these messages - all the same - all for the same directory "Resubmitted". ___ Thu 06 11 17:28:28 EDT [isnapr0664a:wafl.dir.size.max:warning]: Directory /vol/v_prdieeapp_cifs/q_prdieeapp_cifs/XXXXData/Data/HVRI/Resubmitted/ reached the maxdirsize limit. Reduce the number of files or use the vol options command to increase this limit. ==> Comments/Questions So we've hit the maxdirsize on something, but on what? The Win admin doing the robocopy ran TreeSize Professional on both shares, and it looks like the copy is almost complete. The REALLY WEIRD THING is that the dir "WorkBIn" with +8m files did NOT get any errors. But the dir "Resubmitted" with +470k files DOES get the errors. Q) Why would we hit maxdirsize on a dir with +460k files, but not hit maxdirsize on a dir with +8m files? Q) Is maxdirsize for an entire dir structure, or, for an individual dir? I have a case open with IBM support, but not getting very far. ==> maxdirsize ssh -q xxxxxxxx options wafl.maxdirsize wafl.maxdirsize 45875 ==> vol size Size = 1tb, used = 564gb, avail = 484gb Thin, autogrow = 5g ssh -q xxxxxxxx df /vol/v_prdieeapp_cifs/ Filesystem kbytes used avail capacity Mounted on /vol/v_prdieeapp_cifs/ 1048576000 564393044 484182956 54% /vol/v_prdieeapp_cifs/ /vol/v_prdieeapp_cifs/.snapshot 0 0 0 ---% /vol/v_prdieeapp_cifs/.snapshot => inodes Used = +10m, Free = +21m ssh -q xxxxxxxx df -i /vol/v_prdieeapp_cifs/ Filesystem iused ifree %iused Mounted on /vol/v_prdieeapp_cifs/ 10056313 21073268 32% /vol/v_prdieeapp_cifs/ => vol options ssh -q xxxxxxxx vol options /vol/v_prdieeapp_cifs nosnap=on, nosnapdir=off, minra=off, no_atime_update=off, nvfail=off, ignore_inconsistent=off, snapmirrored=off, create_ucode=on, convert_ucode=on, maxdirsize=45875, schedsnapname=ordinal, fs_size_fixed=off, guarantee=none, svo_enable=off, svo_checksum=off, svo_allow_rman=off, svo_reject_errors=off, no_i2p=off, fractional_reserve=0, extent=off, try_first=volume_grow, read_realloc=off, snapshot_clone_dependency=off, dlog_hole_reserve=off, nbu_archival_snap=off ==> TreeSize info of SOURCE and TARGET shares SOURCE share ------------ Full Path Size Allocated Files Folders Y:\ 513,366.5 MB 564,771.9 MB 10,077,444.00 713 Y:\XXXXData 513,366.2 MB 564,771.7 MB 10,077,437.00 710 Y:\XXXXData\Data 513,181.4 MB 564,585.9 MB 10,077,161.00 609 Y:\XXXXData\Data\HVRI 345,036.1 MB 394,556.1 MB 9,597,937.00 476 Y:\XXXXData\Data\HVRI\Readings 312,822.8 MB 312,898.3 MB 18,255.00 0 Y:\XXXXData\Data\HVRI\WorkBin 22,386.3 MB 68,378.2 MB 8,768,414.00 473 Y:\XXXXData\Data\HVRI\Resubmitted 9,827.0 MB 13,279.6 MB 811,268.00 0 Y:\XXXXData\Data\Import 167,672.7 MB 169,541.3 MB 475,794.00 102 Y:\XXXXData\Data\Export 470.3 MB 486.1 MB 3,420.00 27 Y:\XXXXData\Data\XMLExamples 2.3 MB 2.4 MB 10.00 0 Y:\XXXXData\CRFFiles 144.0 MB 144.9 MB 255.00 83 Y:\XXXXData\IEE Installs 29.4 MB 29.5 MB 20.00 12 Y:\XXXXData\RODSData 11.4 MB 11.4 MB 1.00 2 Y:\.etc 0.3 MB .3 MB 7.00 0 Y:\lost+found 0.0 MB .0 MB 0.00 0 TARGET share ------------ Full Path Size Allocated Files Folders Z:\ 490,573.6 MB 518,678.1 MB 9,776,433.00 714 Z:\XXXXData 490,573.3 MB 518,677.8 MB 9,776,426.00 710 Z:\XXXXData\Data 490,388.6 MB 518,492.5 MB 9,776,150.00 609 Z:\XXXXData\Data\HVRI 322,961.8 MB 350,056.7 MB 9,299,556.00 476 Z:\XXXXData\Data\HVRI\Readings 294,757.3 MB 294,792.3 MB 17,375.00 0 Z:\XXXXData\Data\HVRI\WorkBin 22,621.6 MB 48,775.0 MB 8,823,422.00 473 Z:\XXXXData\Data\HVRI\Resubmitted 5,582.8 MB 6,489.4 MB 458,759.00 0 Z:\XXXXData\Data\Import 166,956.4 MB 167,957.6 MB 473,182.00 102 Z:\XXXXData\Data\Export 468.0 MB 475.8 MB 3,402.00 27 Z:\XXXXData\Data\XMLExamples 2.3 MB 2.4 MB 10.00 0 Z:\XXXXData\CRFFiles 144.0 MB 144.5 MB 255.00 83 Z:\XXXXData\IEE Installs 29.4 MB 29.4 MB 20.00 12 Z:\XXXXData\RODSData 11.4 MB 11.4 MB 1.00 2 Z:\.etc 0.3 MB 0.3 MB 7.00 0 Z:\~snapshot 0.0 MB 0.0 MB 0.00 0 Z:\lost+found 0.0 MB 0.0 MB 0.00 0 ----------------------------------------- The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.

3 2

cDOT 8.3P2
by Momonth 02 Jul '15

02 Jul '15

Hi All, Found that $subj is actually available (just by probing URLs), but NetApp didn't publish references to that anywhere. Is it "production ready"? What do you think guys? Cheers,

5 6

CDOT failover groups in 8.2.1P6
by Mark Flint 02 Jul '15

02 Jul '15

Does anyone know if you can re-order the entries within a failover group? My understanding of this is that it’s an automagically created list, but I’d be real happy to find out I’m misunderstanding the docs :) ~Mark mark.flint(a)sanger.ac.uk

9 17

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters July 2015