toasters

toasters@lists.teaparty.net

13531 discussions

Is there somewhere a list with description/explanation of the /etc/ files?
by slemmesmi 24 Jun '08

24 Jun '08

Would like a list with a description/explanation of the /etc/ files - do you know if there is a such? What I'm looking for is something that would e.g. explain something like: *** /etc/rc - The /etc/rc file contains commands that the storage system executes at boot time to configure the system. Commands in the /etc/rc file configure the storage system to: - Communicate on your network - Use the NIS and DNS services - Save the core dump that might exist if the storage system panicked before it was booted *** I can of course begin to dig out the information from NOW, sysadmin guide etc., but would safe a LOT of time if such a list already exist. -- View this message in context: http://www.nabble.com/Is-there-somewhere-a-list-with-description-explanatio… Sent from the Network Appliance - Toasters mailing list archive at Nabble.com.

2 2

Is there a way to destroy a plex with out killing the aggr on it?
by Page, Jeremy 23 Jun '08

23 Jun '08

I have enough free space, but when I built my aggregate I didn't have the raid size set properly, so now I have one plex with only 4 disks. Not a good thing when using DP. Is there a way I can blow this away and add those disks to other raid groups with out loosing all my data? Jeremy M. Page________________ Systems Architect Gilbarco Veeder-Root, a Danaher Company 7300 West Friendly Avenue Greensboro, NC 22087 * email:Jeremy.Page@gilbarco.com - * phone: 336.547.5399 - 6 fax: 336.547.5163 - * cell: 336.601.7274 This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

3 2

Qtree UGO permissions
by Robert K. Borowicz 20 Jun '08

20 Jun '08

When I create a qtree on my 7.2.4 filer the default permissions are 777. Is there an option to modify this default behavior? Thanks -Robert

1 1

Quota panic in 7.2.5
by JONES P.S. 20 Jun '08

20 Jun '08

We've just moved to Ontap 7.2.5 to solve a panic problem with our previous 7.2.2 release. However we've immediately been hit with another panic which appears related to quota initialisation. The bug number/title says :- 300385 / Quota doesn't seems to be prealloc while handling multiuser members But we have less than 1000 entries in our user quota file for this volume, although it is mixed mode and draws from a user population of around 25,000 across AD and NIS. Currently we are running without quotas; not good for an extended period because we have downstream repercussions related to snapvault replicas which are designed to be 'near limit'. Just a warning for anyone with similar user numbers to be aware of. ... Paul Paul Jones, B.Sc, M.Sc, Ph.D. - Head of Systems Services, Information Technology Service, Durham University, South Road, Durham DH1 3LE Email: p.s.jones(a)durham.ac.uk, Phone/Fax: 0191 334 2749/2701

10 10

Flaw with SATA disks - not suitable for deduplication environment
by Chong, Jenson 13 Jun '08

13 Jun '08

Hi, Anybody have insights on this article? Does our ONTAP "Lost Write Protection" address this issue? Regards, Jenson A bit of a flaw with SATA disk drives June 03, 2008 By Jerome Wendt Network World Asia High-capacity serial ATA (SATA) disk drives are now a mainstay in many storage systems and make it feasible for almost any company to obtain a storage system with terabytes of capacity at a reasonable cost. Yet these systems reveal a specific, known deficiency of SATA disk drives that demand companies exercise caution as to what environments they deploy these systems into. A minor flaw with SATA disk drives that high capacity storage systems expose is their bit error rate. Bit errors occur infrequently - about once for every 100 trillion bits. However RAID technology, which is normally used by storage systems to protect against data loss, does not detect if a specific bit on a SATA drive becomes unreadable. While this is normally not a problem on smaller systems, as storage systems add more capacity, the issue becomes more acute. On systems with more than 10TB of capacity the probability of a specific bit of data becoming unreadable is a distinct possibility. On systems with over 100TB, it becomes almost a certainty. So the question becomes: Does losing access to one bit of data really matter? Often, it doesn't unless one stores deduplicated data on these systems which is now the fastest growing trend in data storage. When data is deduplicated, the storage system's need to read every bit of data becomes paramount. The inability to access even a bit of data can result in multiple files becoming unreadable since they all may depend on a specific bit of data to complete their reconstruction. High capacity SATA-based storage systems are the answer to many companies' archiving and backup problems. But SATA bits can bite and using SATA drives to store large amounts of deduplicated data is not always the match made in heaven that vendors make them out to be. Jerome Wendt is the president and lead analyst at DCIG Inc. You may read his blogs at www.dciginc.com <http://www.dciginc.com/> .

5 5

CIFS trace
by Steffen Kammerer 13 Jun '08

13 Jun '08

Hi all, i have enabled #options cifs.trace_login on #options cifs.trace_dc_connection on I have a share called BI on the filer which I try to mount with correct or wrong password and get always this message: Fri Jun 13 16:02:24 CEST [XXXXXXXX: auth.trace.authenticateUser.loginAccepted:info]: AUTH: Login by NULL user from 10.10.46.2 accepted. If I look at other shares like home shares I get a lot more log files: XXXXXXX> 16:19:50 CEST [xxxxxxx: auth.trace.mapNTToUnix:info]: AUTH: Mapping Windows user dewmew$ to Unix user pcuser. XXXXXXX> 16:19:50 CEST [xxxxxxx: auth.trace.authenticateUser.loginAccepted:info]: AUTH: Login by dewmew$ from 10.10.38.102 accepted. XXXXXXX> 16:19:50 CEST [xxxxxxx: auth.trace.authenticateUser.loginTraceIP:info]: AUTH: Login attempt by user dewmew$ of domain BRAINLAB f XXXXXXX> machine 10.10.38.102 (DEWMEW). xxxxxxx> 16:19:50 CEST [xxxxxxx: auth.trace.spnegoAuthentication.statusMsg:info]: AUTH: SPNEGO- Attempting to map PC user to UNIX user de Whats wrong with my BI share?? What means NULL user? Kind Regards, Steffen

2 1

RE: Another 7.2.5 quota bug
by Christopher Mende 12 Jun '08

12 Jun '08

You should be able to use the revert_to command in order to get to 7.2.3, but should check w/ support first. Christopher Mende Sr Solutions Architect Peak UpTime +1 913 523 4263 -----Original Message----- From: Conner, Neil <neil(a)mbari.org> Sent: Thursday, June 12, 2008 12:31 To: Pascal Dukers <pascal.dukers(a)asml.com>; Toasters <toasters(a)mathworks.com> Subject: Re: Another 7.2.5 quota bug I downgraded to 7.2.4 last night and that solved the problem. It was a real show stopper for me because the only way to quiet the errors was to turn quotas off. On 6/11/08 11:20 PM, "Pascal Dukers" <pascal.dukers(a)asml.com> wrote: > > > > Conner, Neil wrote: >> >> Since upgrading from 7.2.3 to 7.2.5 on a pair of clustered 3020s, the >> consoles has been overrun with the following errors: >> >> [toaster: quota.softlimit.normal:notice]: Soft file limit returned to >> normal for tree 92 on volume vol0 >> >> The syslog buffers are getting overrun, messages are getting dropped, and >> the syslog is ready to fill the root volume. >> >> We don¹t set file quotas at all. Tried stopping and restarting quotas and >> disabling SNMP all to no avail. Support has no fix for this so they >> recommended I downrev to 7.2.4. I can¹t revert back to 7.2.3 because >> something changed in WAFL. >> >> Anyone else seen this? >> >> > > > I have hit exactly the same bug on multiple filers and also don't use (soft) > file limits. Hopefully support comes with a workaround in 7.2.5 and/or a > patch soon.

3 2

Another 7.2.5 quota bug
by Conner, Neil 12 Jun '08

12 Jun '08

Since upgrading from 7.2.3 to 7.2.5 on a pair of clustered 3020s, the consoles has been overrun with the following errors: [toaster: quota.softlimit.normal:notice]: Soft file limit returned to normal for tree 92 on volume vol0 The syslog buffers are getting overrun, messages are getting dropped, and the syslog is ready to fill the root volume. We don¹t set file quotas at all. Tried stopping and restarting quotas and disabling SNMP all to no avail. Support has no fix for this so they recommended I downrev to 7.2.4. I can¹t revert back to 7.2.3 because something changed in WAFL. Anyone else seen this?

2 2

Re: How to identify a hot disk
by Blackmor, Chris 11 Jun '08

11 Jun '08

My understanding of reallocate is that it will put a definite load on your filer and shouldn't be run during prime time. ----- Original Message ----- From: owner-toasters(a)mathworks.com <owner-toasters(a)mathworks.com> To: 'Page, Jeremy' <jeremy.page(a)gilbarco.com>; toasters(a)mathworks.com <toasters(a)mathworks.com> Sent: Thu Jun 05 10:57:12 2008 Subject: RE: How to identify a hot disk It’s good you are at 50% aggr usage, as you’ll need 50% free space in each volume you run the reallocate on. I think running the reallocate is the best first step as it is fairly un-intrusive and you can run it during the day unless you are hammering the filer constantly. When we run it we use the parameter –f to force reallocation without caring how well it is already laid out. Not sure about your question on A-SIS. HTH, - Hadrian From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Page, Jeremy Sent: Thursday, June 05, 2008 7:13 AM To: toasters(a)mathworks.com Subject: RE: How to identify a hot disk Thu Jun 5 10:06:02 EDT [gvr-array02: wafl.scan.layout.advise:info]: WAFL layout ratio for volume nfs2 is 4.01. A ratio of 1 is optimal. Based on your free space, 1.42 is expected. Would you say I need to do a reallocate? I’m not sure why this is so fragmented, this file system has never been more then 50% full, could A-SIS have something to do with it? Jeremy M. Page____________________ Systems Architect * email:Jeremy.Page@gilbarco.com - ( phone: 336.547.5399 - 6 fax: 336.547.5163 - ( cell: 336.601.7274 ________________________________ From: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] Sent: Thursday, June 05, 2008 9:38 AM To: Page, Jeremy; toasters(a)mathworks.com Subject: RE: How to identify a hot disk hmmm very interesting.... looks like those are max out do wafl scan measure layout and see where you stand.... if needed do reallocate..... I have seen hundreds of cases where it helped a lot -uddhav From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Page, Jeremy Sent: Thursday, June 05, 2008 8:27 AM To: toasters(a)mathworks.com Subject: Re: How to identify a hot disk Not sure why but I have two disks that are maxed out while the rest are far lower utilization. What would cause this, the raid groups where created all at the same time, there are 10 disks per raid group and 3 groups in the aggragate. /aggr0/plex0/rg0: 1c.16 2 0.94 0.18 1.00 42250 0.49 12.18 1396 0.27 11.83 521 0.00 .... . 0.00 .... . 1c.32 6 2.56 0.49 1.00 104545 1.80 4.18 1323 0.27 11.83 634 0.00 .... . 0.00 .... . 1c.48 98 116.05 114.20 1.62 18481 1.53 4.24 1743 0.31 11.00 2649 0.00 .... . 0.00 .... . 1c.17 41 55.21 54.76 2.17 5697 0.27 20.17 1537 0.18 16.25 600 0.00 .... . 0.00 .... . 1c.33 49 72.07 71.62 1.84 4760 0.27 20.67 871 0.18 16.75 1239 0.00 .... . 0.00 .... . 1c.49 45 61.42 60.97 2.18 4047 0.22 23.00 913 0.22 14.40 931 0.00 .... . 0.00 .... . 1c.64 5 117.40 116.86 1.61 307 0.36 15.25 1336 0.18 18.00 319 0.00 .... . 0.00 .... . 1c.65 4 71.76 71.17 1.83 292 0.27 20.67 1298 0.31 10.43 370 0.00 .... . 0.00 .... . 1c.80 4 49.50 49.05 2.36 333 0.22 22.80 1333 0.22 14.60 712 0.00 .... . 0.00 .... . 1c.81 5 95.14 94.69 1.71 292 0.22 22.80 1325 0.22 14.60 548 0.00 .... . 0.00 .... . /aggr0/plex0/rg1: 1c.66 1 0.67 0.00 .... . 0.31 19.29 1311 0.36 10.50 238 0.00 .... . 0.00 .... . 1c.83 1 0.67 0.00 .... . 0.31 19.29 1415 0.36 10.50 190 0.00 .... . 0.00 .... . 1c.82 4 48.60 48.24 2.21 320 0.22 22.80 1553 0.13 21.33 234 0.00 .... . 0.00 .... . 1c.19 51 67.89 67.44 1.92 5315 0.22 22.80 1281 0.22 13.20 788 0.00 .... . 0.00 .... . 1c.18 55 72.75 72.34 1.90 4996 0.22 23.00 1122 0.18 16.00 1109 0.00 .... . 0.00 .... . 1c.35 30 36.10 35.52 2.67 3190 0.31 15.86 1802 0.27 11.33 588 0.00 .... . 0.00 .... . 1c.34 41 52.97 52.43 2.04 4207 0.31 16.29 1570 0.22 13.60 750 0.00 .... . 0.00 .... . 1c.51 100 119.82 119.46 1.57 25873 0.22 22.80 1588 0.13 21.33 2313 0.00 .... . 0.00 .... . 1c.50 59 72.03 71.44 1.83 7750 0.27 19.33 1233 0.31 10.86 1289 0.00 .... . 0.00 .... . 1c.67 4 94.60 94.15 1.68 279 0.18 24.50 1071 0.27 12.33 338 0.00 .... . 0.00 .... . /aggr0/plex0/rg2: 1c.85 1 0.94 0.00 .... . 0.54 12.00 1806 0.40 10.11 538 0.00 .... . 0.00 .... . 1c.84 1 0.94 0.00 .... . 0.54 12.00 1729 0.40 10.11 495 0.00 .... . 0.00 .... . 1c.21 47 67.40 66.90 1.86 4701 0.27 19.17 1452 0.22 14.20 845 0.00 .... . 0.00 .... . 1c.20 56 73.56 73.02 1.79 4866 0.18 25.50 1039 0.36 9.63 870 0.00 .... . 0.00 .... . 1c.37 51 68.79 68.21 1.76 6072 0.27 19.17 1174 0.31 11.43 988 0.00 .... . 0.00 .... . 1c.36 42 50.85 50.18 2.31 3807 0.40 12.78 1852 0.27 13.33 800 0.00 .... . 0.00 .... . 1c.53 59 75.85 75.18 1.86 5024 0.36 14.25 2237 0.31 10.43 493 0.00 .... . 0.00 .... . 1c.52 18 21.27 20.77 3.83 2205 0.27 19.17 1496 0.22 14.20 465 0.00 .... . 0.00 .... . 1c.69 5 71.76 71.00 1.96 296 0.40 12.78 2087 0.36 9.63 610 0.00 .... . 0.00 .... . 1c.68 5 71.58 71.13 1.84 352 0.22 23.60 1314 0.22 14.80 514 0.00 .... . 0.00 .... . This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

7 8

Re: strange behaviour, Linux and NFS on NTFS qtree
by Webster, Stetson 11 Jun '08

11 Jun '08

Use 'ifstat -z' to zero the stats and see if the errors are still currently occurring. If they are occurring, and if still CRC's, check hardware starting with the easiest first: cable. This would be why UDP *seems* to work while TCP "blows the whistle" on the errors. ----- Original Message ----- From: James Beal <james.beal(a)sanger.ac.uk> To: Webster, Stetson Cc: dh3(a)sanger.ac.uk <dh3(a)sanger.ac.uk>; toasters(a)mathworks.com <toasters(a)mathworks.com>; Blakemore, Steven Sent: Wed Jun 11 13:40:52 2008 Subject: Re: strange behaviour, Linux and NFS on NTFS qtree Webster, Stetson wrote: > > Any errors or strange numbers in 'ifstat -av' ? > netapp1a*> ifstat -v e4a -- interface e4a (7 days, 10 hours, 23 minutes, 16 seconds) -- RECEIVE Frames/second: 311 | Bytes/second: 2251k | Errors/minute: 4864 Discards/minute: 0 | Total frames: 277m | Total bytes: 63451m Total errors: 36939k | Total discards: 0 | Multi/broadcast: 108k No buffers: 0 | Non-primary u/c: 101k | Tag drop: 0 Vlan tag drop: 0 | Vlan untag drop: 0 | Mac octets: 132g UCast pkts: 1187m | MCast pkts: 17000 | BCast pkts: 91533 CRC errors: 36939k | Bus overrun: 0 | Alignment errors: 0 Long frames: 0 | Jabber: 0 | Pause frames: 0 Runt frames: 0 | Symbol errors: 0 | Jumbo frames: 0 TRANSMIT Frames/second: 433 | Bytes/second: 1506k | Errors/minute: 0 Discards/minute: 0 | Total frames: 563m | Total bytes: 3323g Total errors: 0 | Total discards: 0 | Multi/broadcast: 7559 Queue overflows: 0 | No buffers: 0 | Frames queued: 0 Buffer coalesces: 4 | MTUs too big: 0 | Mac octets: 3462g UCast pkts: 2452m | MCast pkts: 2922 | BCast pkts: 4637 Bus underruns: 0 | Pause frames: 0 | Jumbo frames: 0 LINK_INFO Current state: up | Up to downs: 1 | Speed: 10000m Duplex: full | Flowcontrol: full It's using a 10Gig card with no vif's ( I believe ) . When we stress the system we see the following on the console , although when we do this test we don't see the problem ( We see it when I throw about 1000 cores at the system and the 10Gig card is at about 60% and the CPU is around 100% ). I have asked our presales engineer about this. >> >> >> XXX restart_tx >> restart_offloadq >> XXX restart_tx >> XXX restart_tx >> restart_offloadq >> XXX restart_tx >> XXX restart_tx > > ----- Original Message ----- > From: Dave Holland <dh3(a)sanger.ac.uk> > To: Webster, Stetson > Cc: toasters(a)mathworks.com <toasters(a)mathworks.com> > Sent: Wed Jun 11 11:58:38 2008 > Subject: Re: strange behaviour, Linux and NFS on NTFS qtree > > On Wed, Jun 11, 2008 at 11:30:22AM -0400, Webster, Stetson wrote: > > What ONTAP release, what Linux kernel, what NFS mount options? > > I knew I'd missed things... > > It's ONTAP 7.2.4. I can upgrade to 7.2.5 if that'll help. > > The Linux kernel is 2.6.18-6-686 (Debian 4.0, 2.6.18.dfsg.1-18etch4), > and the problem also shows with 2.6.8-2-686-smp and > 2.6.5--286tg3susesfs. > > I noticed this when mounting with proto=tcp,vers=3,rsize=8192,wsize=8192. > I'd also tried UDP, and the problem persisted. > > But after your email I tried vers=2 and the problem goes away (with both > TCP and UDP) which is interesting indeed. Although with the crazy size > files and filesystems around here, NFSv3 is very desirable. > -- james beal -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

1 0

Re: strange behaviour, Linux and NFS on NTFS qtree
by Webster, Stetson 11 Jun '08

11 Jun '08

Any errors or strange numbers in 'ifstat -av' ? ----- Original Message ----- From: Dave Holland <dh3(a)sanger.ac.uk> To: Webster, Stetson Cc: toasters(a)mathworks.com <toasters(a)mathworks.com> Sent: Wed Jun 11 11:58:38 2008 Subject: Re: strange behaviour, Linux and NFS on NTFS qtree On Wed, Jun 11, 2008 at 11:30:22AM -0400, Webster, Stetson wrote: > What ONTAP release, what Linux kernel, what NFS mount options? I knew I'd missed things... It's ONTAP 7.2.4. I can upgrade to 7.2.5 if that'll help. The Linux kernel is 2.6.18-6-686 (Debian 4.0, 2.6.18.dfsg.1-18etch4), and the problem also shows with 2.6.8-2-686-smp and 2.6.5--286tg3susesfs. I noticed this when mounting with proto=tcp,vers=3,rsize=8192,wsize=8192. I'd also tried UDP, and the problem persisted. But after your email I tried vers=2 and the problem goes away (with both TCP and UDP) which is interesting indeed. Although with the crazy size files and filesystems around here, NFSv3 is very desirable. thanks, Dave -- ** Dave Holland ** Systems Support -- Infrastructure Management ** ** 01223 496923 ** The Sanger Institute, Hinxton, Cambridge, UK ** -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

1 0

Re: strange behaviour, Linux and NFS on NTFS qtree
by Webster, Stetson 11 Jun '08

11 Jun '08

What ONTAP release, what Linux kernel, what NFS mount options? ----- Original Message ----- From: Dave Holland <dh3(a)sanger.ac.uk> To: Toasters <toasters(a)mathworks.com> Sent: Wed Jun 11 09:56:10 2008 Subject: strange behaviour, Linux and NFS on NTFS qtree Hello, I'm seeing some strange behaviour with a FAS3040 filer I have on evaluation at the moment. I have an NTFS-style qtree exported by NFS and CIFS. Debian Linux clients see odd behaviour relating to open() and stat64() system calls. This strace output from "vim" captures it in a nutshell: uname({sys="Linux", node="acheron", ...}) = 0 stat64("ffff", 0xbfb4d030) = -1 ENOENT (No such file or directory) stat64("ffff", 0xbfb4d0b0) = -1 ENOENT (No such file or directory) access("ffff", W_OK) = -1 ENOENT (No such file or directory) open("ffff", O_RDONLY) = -1 ENOENT (No such file or directory) readlink("ffff", 0xbfb4c7cc, 1023) = -1 ENOENT (No such file or directory) open(".ffff.swp", O_RDONLY) = -1 ENOENT (No such file or directory) open(".ffff.swp", O_RDWR|O_CREAT|O_EXCL, 0600) = -1 EACCES (Permission denied) stat64(".ffff.swp", {st_mode=S_IFREG|0777, st_size=0, ...}) = 0 Note that the open(O_RDWR...) call fails with EACCES; but the following stat64() call succeeds. The file ffff.swp was created on disk despite the reported failure of the open() call. This behaviour is seen using "vim" to edit files, and causes an error message about the swap file being present (due to the swap file being created even though the open() return value implies it was not). Trying the same "vim" command on a Tru64 NFS client, correct behaviour is seen: the open(O_RDWR...) succeeds and a filehandle is returned. I asked Netapp support and they suggested a mixed-style qtree. But I've read on this list about the last-change-wins problem on permissions and ACLs, and I'd really rather not go there. I've worked through the troubleshooting guide: http://now.netapp.com/NOW/knowledge/docs/olio/guides/ontap_troubleshooting with no luck. Is there anything else I can configure (on the filer or on the clients) to avoid this problem? Thanks for any suggestions! Dave -- ** Dave Holland ** Systems Support -- Infrastructure Management ** ** 01223 496923 ** The Sanger Institute, Hinxton, Cambridge, UK ** -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

4 4

CIFS quota question
by Zeeshan 11 Jun '08

11 Jun '08

Hello all... I have a 100GB XXX CIFS share in a FlexVol qtree. The qtree size is 100GB. The qtree has only USER quota restriction of 1GB per user. When the number of AD users (who have been allocated XXX share as storage) exceeds 100, a. Will ONTAP give me some sort of a warning like: The volume or qtree has been fully allocated or almost full???Although the space used by users data is much less than 100GB, but allocation for 100 users has been made? b. Will the AD be able to create more than 100 users and allocate XXX share as storage for each user???or will ONTAP disallow AD to allocate XXX share to more than 100 users??? Thanx

1 0

strange behaviour, Linux and NFS on NTFS qtree
by Dave Holland 11 Jun '08

11 Jun '08

Hello, I'm seeing some strange behaviour with a FAS3040 filer I have on evaluation at the moment. I have an NTFS-style qtree exported by NFS and CIFS. Debian Linux clients see odd behaviour relating to open() and stat64() system calls. This strace output from "vim" captures it in a nutshell: uname({sys="Linux", node="acheron", ...}) = 0 stat64("ffff", 0xbfb4d030) = -1 ENOENT (No such file or directory) stat64("ffff", 0xbfb4d0b0) = -1 ENOENT (No such file or directory) access("ffff", W_OK) = -1 ENOENT (No such file or directory) open("ffff", O_RDONLY) = -1 ENOENT (No such file or directory) readlink("ffff", 0xbfb4c7cc, 1023) = -1 ENOENT (No such file or directory) open(".ffff.swp", O_RDONLY) = -1 ENOENT (No such file or directory) open(".ffff.swp", O_RDWR|O_CREAT|O_EXCL, 0600) = -1 EACCES (Permission denied) stat64(".ffff.swp", {st_mode=S_IFREG|0777, st_size=0, ...}) = 0 Note that the open(O_RDWR...) call fails with EACCES; but the following stat64() call succeeds. The file ffff.swp was created on disk despite the reported failure of the open() call. This behaviour is seen using "vim" to edit files, and causes an error message about the swap file being present (due to the swap file being created even though the open() return value implies it was not). Trying the same "vim" command on a Tru64 NFS client, correct behaviour is seen: the open(O_RDWR...) succeeds and a filehandle is returned. I asked Netapp support and they suggested a mixed-style qtree. But I've read on this list about the last-change-wins problem on permissions and ACLs, and I'd really rather not go there. I've worked through the troubleshooting guide: http://now.netapp.com/NOW/knowledge/docs/olio/guides/ontap_troubleshooting with no luck. Is there anything else I can configure (on the filer or on the clients) to avoid this problem? Thanks for any suggestions! Dave -- ** Dave Holland ** Systems Support -- Infrastructure Management ** ** 01223 496923 ** The Sanger Institute, Hinxton, Cambridge, UK ** -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

2 2

RE: At which point does high disk utilization impact IO requests?
by Christopher Mende 10 Jun '08

10 Jun '08

Normally if a client is starting to see latency in an app, I use perfstat for a snapshot measurement and consider changes if disk utilization starts creeping up towards 80%. DFM/OM or SNMP-based monitoring tools have been useful in alerting on sustained high disk utilization or volume latency. Christopher Mende Sr Solutions Architect Peak UpTime +1 913 523 4263 ________________________________ From: Hadrian Baron <Hadrian.Baron(a)vegas.com> Sent: Tuesday, June 10, 2008 13:39 To: toasters(a)mathworks.com <toasters(a)mathworks.com> Subject: At which point does high disk utilization impact IO requests? When average disk utilization across all disks in an aggregate becomes high, IO requests are delayed. My question is what should this threshold be? I’ve heard from one performance consultant that 40% disk utilization is where you start seeing latency (this was in regards to a HDS array). The Netapp Storage Performance Management using DFM TR-3525 says 70% is the industry accepted disk utilization threshold. http://www-download.netapp.com/edm/TOT/docs/3525.pdf (page 17) Here is some interesting EMC FUD comparing a 3050 and a CX3-40 which says the Netapp beats the CX3 until disk utilization passes 20% then latency increases dramatically (page 7). http://www.dell.com/downloads/global/products/pvaul/en/netapp_performance_s… (page 7) Every environment is different, so the proper answer is of course – It depends – and you should test for yourself. It depends on whether you can accept 5ms more latency, or 50ms more. It depends on what kind of IO you do. But my question is what *your* threshold is, and how can you automate the monitoring of disk utilization? TIA, Hadrian

1 0

Map CIFS homedir based on share name instead of username?
by Adam McDougall 10 Jun '08

10 Jun '08

Without manually creating a share for each user, is it possible for the filer to use the supplied share name as the connecting user, instead of the username from the credentials? I am trying to mimic the samba behavior where I can connect to \\samba\someuser with ANY credentials, and if those credentials do not work, it prompts me for user/pass. I added our home directory paths in cifs_homedir.cfg and tried different settings for cifs.home_dir_namestyle but they all seem to use the username from the credentials that are connecting, not the requested share name. For example, if I am logged into windows as mcdouga9, I can connect to \\filer\mcdouga9 just fine, but if I connect to \\filer\anothervaliduser, it claims "\\filer\anothervaliduser No network provider accepted the given network path.". I'd rather be prompted for credentials so I can enter the username/password. It does work if I supply the username/pass while connecting. Thanks.

2 1

At which point does high disk utilization impact IO requests?
by Hadrian Baron 10 Jun '08

10 Jun '08

When average disk utilization across all disks in an aggregate becomes high, IO requests are delayed. My question is what should this threshold be? I've heard from one performance consultant that 40% disk utilization is where you start seeing latency (this was in regards to a HDS array). The Netapp Storage Performance Management using DFM TR-3525 says 70% is the industry accepted disk utilization threshold. http://www-download.netapp.com/edm/TOT/docs/3525.pdf (page 17) Here is some interesting EMC FUD comparing a 3050 and a CX3-40 which says the Netapp beats the CX3 until disk utilization passes 20% then latency increases dramatically (page 7). http://www.dell.com/downloads/global/products/pvaul/en/netapp_performance_s… (page 7) Every environment is different, so the proper answer is of course - It depends - and you should test for yourself. It depends on whether you can accept 5ms more latency, or 50ms more. It depends on what kind of IO you do. But my question is what *your* threshold is, and how can you automate the monitoring of disk utilization? TIA, Hadrian

1 0

Rename aggregate :: SnapLock and V-Series
by Kevin Parker 10 Jun '08

10 Jun '08

Hi Folks, Have any of you renamed a SnapLock (enterprise) aggregate? I don't see that renaming the aggr would have any effect or even need to change any data within. These are true aggregates (i.e.: not tradvols) with FlexVols. DOT 7.2.3 and above. Is there anything else to watch out for? What was your experience? Smooth as aggr rename on an otherwise standard aggr? Next question is about renaming a v-series aggregate. Experience? Cheers, Best regards, Kevin Parker

2 1

R: Where to get more tech specs?
by Milazzo Giacomo 06 Jun '08

06 Jun '08

I know! I got this from a guy here and I'm just reading now the data. I share with others that didn't know it http://www.storageperformance.org/results/benchmark_results_all There's some that can help. As others I expect some about FAS6xxx series. Regards Da: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] Inviato: venerdì 6 giugno 2008 15.34 A: Milazzo Giacomo; 'Glenn Walker'; toasters(a)mathworks.com Oggetto: RE: Where to get more tech specs? I wish this would come from somewhere inside Netapp R&D Performance Matrix Dept Hey, but don't worry. We are here to help out if you are not getting right numbers, you know...... just ping us -uddhav From: Milazzo Giacomo [mailto:G.Milazzo@sinergy.it] Sent: Friday, June 06, 2008 9:21 AM To: Uddhav Regmi; Glenn Walker; toasters(a)mathworks.com Subject: R: Where to get more tech specs? And last, since years and years there's always been "secrets" and "nda" on detailed tech specs of computers, appliances or, generally, IT relatad hardware!... Could this be the proof that IT is not science? J After all when I compare two cars I can have exact data from the two vendors... ;-) Da: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] Inviato: venerdì 6 giugno 2008 15.12 A: 'Glenn Walker'; Milazzo Giacomo; toasters(a)mathworks.com Oggetto: RE: Where to get more tech specs? Performance is not something which cannot be compared vis-a-vis with other platform/hardware..... In real life there could be so many variables ........ OnTAP tuning and hardwares can play the role Switching, paths , routing.....can play the role then finally your front end Server Platform, hardware and application can play the role...... All these are very tightly related..... -uddhav From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Glenn Walker Sent: Friday, June 06, 2008 8:46 AM To: Milazzo Giacomo; toasters(a)mathworks.com Subject: RE: Where to get more tech specs? You could look at specfs numbers (there's an organization that publishes this), and you can get the docs you've already seen from your sales team. It's not something that is typically given to customers. Check with your sales team (Channel perhaps?). Glenn ________________________________ From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Milazzo Giacomo Sent: Friday, June 06, 2008 3:02 AM To: toasters(a)mathworks.com Subject: Where to get more tech specs? Hi all Long times ago I was able to obtain from some NetApp guys documentation that regarded detailed tech specs of filer appliances with data on performances such us iops, throughput and so on with also comparison between models both from NetApp and competitor too. The data regarded NAS ans SAN (iSCSI and FCP) aspects. Do you know if there are available docs on new filers? Sometime it happens that customers ask us for comparison charts (i.e. now we could need data for IBM DS8000 storage and FAS3xxx and/or 6xxx filers regarding SAN FCP performances) regards

2 1

snapshot copy
by Mailing Lists 06 Jun '08

06 Jun '08

two filers, have a need to copy the data from source:vol:snap1 to dest:vol what would be the fastest way to do this, mounting and scp is pretty slow for me, is there some sort of mirroring that i can use to accomplish this ? -- eats the blues for breakfast, does unix for rent, plays harp for food, will play the flute for kicks rides for the freedom scrapes for the challenge

13 26

R: Where to get more tech specs?
by Milazzo Giacomo 06 Jun '08

06 Jun '08

And last, since years and years there's always been "secrets" and "nda" on detailed tech specs of computers, appliances or, generally, IT relatad hardware!... Could this be the proof that IT is not science? J After all when I compare two cars I can have exact data from the two vendors... ;-) Da: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] Inviato: venerdì 6 giugno 2008 15.12 A: 'Glenn Walker'; Milazzo Giacomo; toasters(a)mathworks.com Oggetto: RE: Where to get more tech specs? Performance is not something which cannot be compared vis-a-vis with other platform/hardware..... In real life there could be so many variables ........ OnTAP tuning and hardwares can play the role Switching, paths , routing.....can play the role then finally your front end Server Platform, hardware and application can play the role...... All these are very tightly related..... -uddhav From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Glenn Walker Sent: Friday, June 06, 2008 8:46 AM To: Milazzo Giacomo; toasters(a)mathworks.com Subject: RE: Where to get more tech specs? You could look at specfs numbers (there's an organization that publishes this), and you can get the docs you've already seen from your sales team. It's not something that is typically given to customers. Check with your sales team (Channel perhaps?). Glenn ________________________________ From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Milazzo Giacomo Sent: Friday, June 06, 2008 3:02 AM To: toasters(a)mathworks.com Subject: Where to get more tech specs? Hi all Long times ago I was able to obtain from some NetApp guys documentation that regarded detailed tech specs of filer appliances with data on performances such us iops, throughput and so on with also comparison between models both from NetApp and competitor too. The data regarded NAS ans SAN (iSCSI and FCP) aspects. Do you know if there are available docs on new filers? Sometime it happens that customers ask us for comparison charts (i.e. now we could need data for IBM DS8000 storage and FAS3xxx and/or 6xxx filers regarding SAN FCP performances) regards

1 0

R: Where to get more tech specs?
by Milazzo Giacomo 06 Jun '08

06 Jun '08

I perfectly agree and I can add that "numbers alone often are without meaning" J But, if we can ideally think to something that can be compared analyzing numbers, graph and tables can let us have an idea of what we can expect... Just as sample, it's quite obvious that in terms of "fire power" there no story between a DS8xxx and a FAS6xxx (same size and type of disks, same F/C channels and speed, same hosts and apps and so on) but reading at the values we can do more that with no specs at all. My best regards, Da: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] Inviato: venerdì 6 giugno 2008 15.12 A: 'Glenn Walker'; Milazzo Giacomo; toasters(a)mathworks.com Oggetto: RE: Where to get more tech specs? Performance is not something which cannot be compared vis-a-vis with other platform/hardware..... In real life there could be so many variables ........ OnTAP tuning and hardwares can play the role Switching, paths , routing.....can play the role then finally your front end Server Platform, hardware and application can play the role...... All these are very tightly related..... -uddhav From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Glenn Walker Sent: Friday, June 06, 2008 8:46 AM To: Milazzo Giacomo; toasters(a)mathworks.com Subject: RE: Where to get more tech specs? You could look at specfs numbers (there's an organization that publishes this), and you can get the docs you've already seen from your sales team. It's not something that is typically given to customers. Check with your sales team (Channel perhaps?). Glenn ________________________________ From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Milazzo Giacomo Sent: Friday, June 06, 2008 3:02 AM To: toasters(a)mathworks.com Subject: Where to get more tech specs? Hi all Long times ago I was able to obtain from some NetApp guys documentation that regarded detailed tech specs of filer appliances with data on performances such us iops, throughput and so on with also comparison between models both from NetApp and competitor too. The data regarded NAS ans SAN (iSCSI and FCP) aspects. Do you know if there are available docs on new filers? Sometime it happens that customers ask us for comparison charts (i.e. now we could need data for IBM DS8000 storage and FAS3xxx and/or 6xxx filers regarding SAN FCP performances) regards

1 0

Where to get more tech specs?
by Milazzo Giacomo 06 Jun '08

06 Jun '08

Hi all Long times ago I was able to obtain from some NetApp guys documentation that regarded detailed tech specs of filer appliances with data on performances such us iops, throughput and so on with also comparison between models both from NetApp and competitor too. The data regarded NAS ans SAN (iSCSI and FCP) aspects. Do you know if there are available docs on new filers? Sometime it happens that customers ask us for comparison charts (i.e. now we could need data for IBM DS8000 storage and FAS3xxx and/or 6xxx filers regarding SAN FCP performances) regards

2 1

RE: How to identify a hot disk
by Page, Jeremy 06 Jun '08

06 Jun '08

No LUNs on the volumes, they are NFS mounts. About 70 VMDK files (50ish VMs). I probably did reduce the volume size at one point, but it would have been before any data was on it. I think I made it 1.25TB when I wanted it 1.2. Are you talking about FC multipathing? I do have fibre channel hba's in the filer but they are there to take over from it's partner, there are no LUNs on this head at all. -----Original Message----- From: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] Sent: Friday, June 06, 2008 8:07 AM To: Page, Jeremy; 'Hadrian Baron'; 'Blake Golliher'; 'Blackmor, Chris' Cc: toasters(a)mathworks.com Subject: RE: How to identify a hot disk It is more interesting now.... I'm interested to see little bit about " Both aggr are DP with 36 disks each" Is multipathing involved ? So, you confirm that no issues of ownership and mismatch of disks in either path ? and we sure that you created this whole aggregate just one time and you have never changed anything.... And also I hope volume size was not added / reduced in its life cycle..... If we are all clear on above, I can think of only two things the way vmdk disks behave and a sis OK, lets dive more here.....how many luns you have inside nfs2 ? and size ? I have seen some sis issues while making copying / writing - in particular to vmdk files -----Original Message----- From: Page, Jeremy [mailto:jeremy.page@gilbarco.com] Sent: Friday, June 06, 2008 7:42 AM To: Uddhav Regmi; Hadrian Baron; Blake Golliher; Blackmor, Chris Cc: toasters(a)mathworks.com Subject: RE: How to identify a hot disk Very few large files. The ONLY things on this volume are VMs, so the average file size is likely several gig. The volume has never reached more then 50% full...but I'm getting 45% savings from ASIS, so maybe theats the issue. No errors on the console. 7.2.4. /vol/nfs3 is the same type of information as /vol/vmware and /vol/nfs2, but obviously I have not run sis on it yet. The problem volume is /vol/nfs2, which is on a different aggr then the others (it's with /shares and /vol0 on the aggr0, the others are on aggr1). Both aggr are DP with 36 disks each. All the disks where added at the same time (before any data was added to the filer). Filesystem used saved %saved /vol/vmware/ 513GB 492GB 49% /vol/vol0/ 267MB 0MB 0% /vol/shares/ 1770GB 561GB 24% /vol/nfs2/ 268GB 619GB 70% < pretty nice :) /vol/nfs3/ 275GB 0GB 0% -----Original Message----- From: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] Sent: Thursday, June 05, 2008 9:20 PM To: 'Hadrian Baron'; Page, Jeremy; 'Blake Golliher'; 'Blackmor, Chris' Cc: toasters(a)mathworks.com Subject: RE: How to identify a hot disk what kind of files is coming to this volume after de-dup ( sis ) millions of small files, large chunk of lun files or vmdk files ? have you ever deleted some large files thinking it has reached to its max limit ? I'm still thinking how this may have happened.... Any messages showing at system console about those hot disks ? which ontap version is this -uddhav -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Hadrian Baron Sent: Thursday, June 05, 2008 8:39 PM To: 'Page, Jeremy'; Blake Golliher; Blackmor, Chris Cc: toasters(a)mathworks.com Subject: RE: How to identify a hot disk I searched disk layout ratio on NOW and found a community post stating it could become bad if your volumes reach 100% usage, did that ever happen? - Hadrian -----Original Message----- From: Page, Jeremy [mailto:jeremy.page@gilbarco.com] Sent: Thursday, June 05, 2008 5:38 PM To: Blake Golliher; Blackmor, Chris Cc: Hadrian Baron; toasters(a)mathworks.com Subject: RE: How to identify a hot disk I don't understand how the fragmentation occurred in the first place, this is a brand new filer, we've not even had any snapshots age out yet. All the disks where added to the aggr at the same time, lots of free space. The only thing odd is that we did have ASIS run, I wonder if the fragmentation is from all the stuff getting de-duped (it's a bunch of VMs) -----Original Message----- From: Blake Golliher [mailto:thelastman@gmail.com] Sent: Thursday, June 05, 2008 5:17 PM To: Blackmor, Chris Cc: Hadrian.Baron(a)vegas.com; Page, Jeremy; toasters(a)mathworks.com Subject: Re: How to identify a hot disk It'll depend on how busy your disks are during prime time. Safety first people! On Thu, Jun 5, 2008 at 1:38 PM, Blackmor, Chris <Chris.Blackmor(a)amd.com> wrote: > My understanding of reallocate is that it will put a definite load on your > filer and shouldn't be run during prime time. > > ----- Original Message ----- > From: owner-toasters(a)mathworks.com <owner-toasters(a)mathworks.com> > To: 'Page, Jeremy' <jeremy.page(a)gilbarco.com>; toasters(a)mathworks.com > <toasters(a)mathworks.com> > Sent: Thu Jun 05 10:57:12 2008 > Subject: RE: How to identify a hot disk > > It's good you are at 50% aggr usage, as you'll need 50% free space in each > volume you run the reallocate on. I think running the reallocate is the > best first step as it is fairly un-intrusive and you can run it during the > day unless you are hammering the filer constantly. When we run it we use > the parameter -f to force reallocation without caring how well it is already > laid out. Not sure about your question on A-SIS. > > > > HTH, > > > > - Hadrian > > > > From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On > Behalf Of Page, Jeremy > Sent: Thursday, June 05, 2008 7:13 AM > To: toasters(a)mathworks.com > Subject: RE: How to identify a hot disk > > > > Thu Jun 5 10:06:02 EDT [gvr-array02: wafl.scan.layout.advise:info]: WAFL > layout ratio for volume nfs2 is 4.01. A ratio of 1 is optimal. Based on your > free space, 1.42 is expected. > > > > Would you say I need to do a reallocate? I'm not sure why this is so > fragmented, this file system has never been more then 50% full, could A-SIS > have something to do with it? > > > > Jeremy M. Page____________________ > > Systems Architect > > * email:Jeremy.Page@gilbarco.com - ( phone: 336.547.5399 - 6 fax: > 336.547.5163 - ( cell: 336.601.7274 > > ________________________________ > > From: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] > Sent: Thursday, June 05, 2008 9:38 AM > To: Page, Jeremy; toasters(a)mathworks.com > Subject: RE: How to identify a hot disk > > > > hmmm > > very interesting.... > > looks like those are max out > > do wafl scan measure layout and see where you stand.... > > if needed do reallocate..... > > I have seen hundreds of cases where it helped a lot > > > > -uddhav > > > > From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On > Behalf Of Page, Jeremy > Sent: Thursday, June 05, 2008 8:27 AM > To: toasters(a)mathworks.com > Subject: Re: How to identify a hot disk > > > > Not sure why but I have two disks that are maxed out while the rest are far > lower utilization. What would cause this, the raid groups where created all > at the same time, there are 10 disks per raid group and 3 groups in the > aggragate. > > > > > > /aggr0/plex0/rg0: > > 1c.16 2 0.94 0.18 1.00 42250 0.49 12.18 1396 0.27 > 11.83 521 0.00 .... . 0.00 .... . > > 1c.32 6 2.56 0.49 1.00 104545 1.80 4.18 1323 > 0.27 11.83 634 0.00 .... . 0.00 .... . > > 1c.48 98 116.05 114.20 1.62 18481 1.53 4.24 1743 0.31 > 11.00 2649 0.00 .... . 0.00 .... . > > 1c.17 41 55.21 54.76 2.17 5697 0.27 20.17 1537 0.18 > 16.25 600 0.00 .... . 0.00 .... . > > 1c.33 49 72.07 71.62 1.84 4760 0.27 20.67 871 0.18 > 16.75 1239 0.00 .... . 0.00 .... . > > 1c.49 45 61.42 60.97 2.18 4047 0.22 23.00 913 0.22 > 14.40 931 0.00 .... . 0.00 .... . > > 1c.64 5 117.40 116.86 1.61 307 0.36 15.25 1336 0.18 > 18.00 319 0.00 .... . 0.00 .... . > > 1c.65 4 71.76 71.17 1.83 292 0.27 20.67 1298 0.31 > 10.43 370 0.00 .... . 0.00 .... . > > 1c.80 4 49.50 49.05 2.36 333 0.22 22.80 1333 0.22 > 14.60 712 0.00 .... . 0.00 .... . > > 1c.81 5 95.14 94.69 1.71 292 0.22 22.80 1325 0.22 > 14.60 548 0.00 .... . 0.00 .... . > > /aggr0/plex0/rg1: > > 1c.66 1 0.67 0.00 .... . 0.31 19.29 1311 0.36 > 10.50 238 0.00 .... . 0.00 .... . > > 1c.83 1 0.67 0.00 .... . 0.31 19.29 1415 0.36 > 10.50 190 0.00 .... . 0.00 .... . > > 1c.82 4 48.60 48.24 2.21 320 0.22 22.80 1553 0.13 > 21.33 234 0.00 .... . 0.00 .... . > > 1c.19 51 67.89 67.44 1.92 5315 0.22 22.80 1281 0.22 > 13.20 788 0.00 .... . 0.00 .... . > > 1c.18 55 72.75 72.34 1.90 4996 0.22 23.00 1122 0.18 > 16.00 1109 0.00 .... . 0.00 .... . > > 1c.35 30 36.10 35.52 2.67 3190 0.31 15.86 1802 0.27 > 11.33 588 0.00 .... . 0.00 .... . > > 1c.34 41 52.97 52.43 2.04 4207 0.31 16.29 1570 0.22 > 13.60 750 0.00 .... . 0.00 .... . > > 1c.51 100 119.82 119.46 1.57 25873 0.22 22.80 1588 0.13 > 21.33 2313 0.00 .... . 0.00 .... . > > 1c.50 59 72.03 71.44 1.83 7750 0.27 19.33 1233 0.31 > 10.86 1289 0.00 .... . 0.00 .... . > > 1c.67 4 94.60 94.15 1.68 279 0.18 24.50 1071 0.27 > 12.33 338 0.00 .... . 0.00 .... . > > /aggr0/plex0/rg2: > > 1c.85 1 0.94 0.00 .... . 0.54 12.00 1806 0.40 > 10.11 538 0.00 .... . 0.00 .... . > > 1c.84 1 0.94 0.00 .... . 0.54 12.00 1729 0.40 > 10.11 495 0.00 .... . 0.00 .... . > > 1c.21 47 67.40 66.90 1.86 4701 0.27 19.17 1452 0.22 > 14.20 845 0.00 .... . 0.00 .... . > > 1c.20 56 73.56 73.02 1.79 4866 0.18 25.50 1039 > 0.36 9.63 870 0.00 .... . 0.00 .... . > > 1c.37 51 68.79 68.21 1.76 6072 0.27 19.17 1174 0.31 > 11.43 988 0.00 .... . 0.00 .... . > > 1c.36 42 50.85 50.18 2.31 3807 0.40 12.78 1852 0.27 > 13.33 800 0.00 .... . 0.00 .... . > > 1c.53 59 75.85 75.18 1.86 5024 0.36 14.25 2237 0.31 > 10.43 493 0.00 .... . 0.00 .... . > > 1c.52 18 21.27 20.77 3.83 2205 0.27 19.17 1496 0.22 > 14.20 465 0.00 .... . 0.00 .... . > > 1c.69 5 71.76 71.00 1.96 296 0.40 12.78 2087 > 0.36 9.63 610 0.00 .... . 0.00 .... . > > 1c.68 5 71.58 71.13 1.84 352 0.22 23.60 1314 0.22 > 14.80 514 0.00 .... . 0.00 .... . > > > > This message (including any attachments) contains confidential > and/or proprietary information intended only for the addressee. > Any unauthorized disclosure, copying, distribution or reliance on > the contents of this information is strictly prohibited and may > constitute a violation of law. If you are not the intended > recipient, please notify the sender immediately by responding to > this e-mail, and delete the message from your system. If you > have any questions about this e-mail please notify the sender > immediately. > > This message (including any attachments) contains confidential > and/or proprietary information intended only for the addressee. > Any unauthorized disclosure, copying, distribution or reliance on > the contents of this information is strictly prohibited and may > constitute a violation of law. If you are not the intended > recipient, please notify the sender immediately by responding to > this e-mail, and delete the message from your system. If you > have any questions about this e-mail please notify the sender > immediately. > > This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

1 0

RE: How to identify a hot disk
by Page, Jeremy 06 Jun '08

06 Jun '08

Very few large files. The ONLY things on this volume are VMs, so the average file size is likely several gig. The volume has never reached more then 50% full...but I'm getting 45% savings from ASIS, so maybe theats the issue. No errors on the console. 7.2.4. /vol/nfs3 is the same type of information as /vol/vmware and /vol/nfs2, but obviously I have not run sis on it yet. The problem volume is /vol/nfs2, which is on a different aggr then the others (it's with /shares and /vol0 on the aggr0, the others are on aggr1). Both aggr are DP with 36 disks each. All the disks where added at the same time (before any data was added to the filer). Filesystem used saved %saved /vol/vmware/ 513GB 492GB 49% /vol/vol0/ 267MB 0MB 0% /vol/shares/ 1770GB 561GB 24% /vol/nfs2/ 268GB 619GB 70% < pretty nice :) /vol/nfs3/ 275GB 0GB 0% -----Original Message----- From: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] Sent: Thursday, June 05, 2008 9:20 PM To: 'Hadrian Baron'; Page, Jeremy; 'Blake Golliher'; 'Blackmor, Chris' Cc: toasters(a)mathworks.com Subject: RE: How to identify a hot disk what kind of files is coming to this volume after de-dup ( sis ) millions of small files, large chunk of lun files or vmdk files ? have you ever deleted some large files thinking it has reached to its max limit ? I'm still thinking how this may have happened.... Any messages showing at system console about those hot disks ? which ontap version is this -uddhav -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Hadrian Baron Sent: Thursday, June 05, 2008 8:39 PM To: 'Page, Jeremy'; Blake Golliher; Blackmor, Chris Cc: toasters(a)mathworks.com Subject: RE: How to identify a hot disk I searched disk layout ratio on NOW and found a community post stating it could become bad if your volumes reach 100% usage, did that ever happen? - Hadrian -----Original Message----- From: Page, Jeremy [mailto:jeremy.page@gilbarco.com] Sent: Thursday, June 05, 2008 5:38 PM To: Blake Golliher; Blackmor, Chris Cc: Hadrian Baron; toasters(a)mathworks.com Subject: RE: How to identify a hot disk I don't understand how the fragmentation occurred in the first place, this is a brand new filer, we've not even had any snapshots age out yet. All the disks where added to the aggr at the same time, lots of free space. The only thing odd is that we did have ASIS run, I wonder if the fragmentation is from all the stuff getting de-duped (it's a bunch of VMs) -----Original Message----- From: Blake Golliher [mailto:thelastman@gmail.com] Sent: Thursday, June 05, 2008 5:17 PM To: Blackmor, Chris Cc: Hadrian.Baron(a)vegas.com; Page, Jeremy; toasters(a)mathworks.com Subject: Re: How to identify a hot disk It'll depend on how busy your disks are during prime time. Safety first people! On Thu, Jun 5, 2008 at 1:38 PM, Blackmor, Chris <Chris.Blackmor(a)amd.com> wrote: > My understanding of reallocate is that it will put a definite load on your > filer and shouldn't be run during prime time. > > ----- Original Message ----- > From: owner-toasters(a)mathworks.com <owner-toasters(a)mathworks.com> > To: 'Page, Jeremy' <jeremy.page(a)gilbarco.com>; toasters(a)mathworks.com > <toasters(a)mathworks.com> > Sent: Thu Jun 05 10:57:12 2008 > Subject: RE: How to identify a hot disk > > It's good you are at 50% aggr usage, as you'll need 50% free space in each > volume you run the reallocate on. I think running the reallocate is the > best first step as it is fairly un-intrusive and you can run it during the > day unless you are hammering the filer constantly. When we run it we use > the parameter -f to force reallocation without caring how well it is already > laid out. Not sure about your question on A-SIS. > > > > HTH, > > > > - Hadrian > > > > From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On > Behalf Of Page, Jeremy > Sent: Thursday, June 05, 2008 7:13 AM > To: toasters(a)mathworks.com > Subject: RE: How to identify a hot disk > > > > Thu Jun 5 10:06:02 EDT [gvr-array02: wafl.scan.layout.advise:info]: WAFL > layout ratio for volume nfs2 is 4.01. A ratio of 1 is optimal. Based on your > free space, 1.42 is expected. > > > > Would you say I need to do a reallocate? I'm not sure why this is so > fragmented, this file system has never been more then 50% full, could A-SIS > have something to do with it? > > > > Jeremy M. Page____________________ > > Systems Architect > > * email:Jeremy.Page@gilbarco.com - ( phone: 336.547.5399 - 6 fax: > 336.547.5163 - ( cell: 336.601.7274 > > ________________________________ > > From: Uddhav Regmi [mailto:uddhav.regmi@worldnet.att.net] > Sent: Thursday, June 05, 2008 9:38 AM > To: Page, Jeremy; toasters(a)mathworks.com > Subject: RE: How to identify a hot disk > > > > hmmm > > very interesting.... > > looks like those are max out > > do wafl scan measure layout and see where you stand.... > > if needed do reallocate..... > > I have seen hundreds of cases where it helped a lot > > > > -uddhav > > > > From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On > Behalf Of Page, Jeremy > Sent: Thursday, June 05, 2008 8:27 AM > To: toasters(a)mathworks.com > Subject: Re: How to identify a hot disk > > > > Not sure why but I have two disks that are maxed out while the rest are far > lower utilization. What would cause this, the raid groups where created all > at the same time, there are 10 disks per raid group and 3 groups in the > aggragate. > > > > > > /aggr0/plex0/rg0: > > 1c.16 2 0.94 0.18 1.00 42250 0.49 12.18 1396 0.27 > 11.83 521 0.00 .... . 0.00 .... . > > 1c.32 6 2.56 0.49 1.00 104545 1.80 4.18 1323 > 0.27 11.83 634 0.00 .... . 0.00 .... . > > 1c.48 98 116.05 114.20 1.62 18481 1.53 4.24 1743 0.31 > 11.00 2649 0.00 .... . 0.00 .... . > > 1c.17 41 55.21 54.76 2.17 5697 0.27 20.17 1537 0.18 > 16.25 600 0.00 .... . 0.00 .... . > > 1c.33 49 72.07 71.62 1.84 4760 0.27 20.67 871 0.18 > 16.75 1239 0.00 .... . 0.00 .... . > > 1c.49 45 61.42 60.97 2.18 4047 0.22 23.00 913 0.22 > 14.40 931 0.00 .... . 0.00 .... . > > 1c.64 5 117.40 116.86 1.61 307 0.36 15.25 1336 0.18 > 18.00 319 0.00 .... . 0.00 .... . > > 1c.65 4 71.76 71.17 1.83 292 0.27 20.67 1298 0.31 > 10.43 370 0.00 .... . 0.00 .... . > > 1c.80 4 49.50 49.05 2.36 333 0.22 22.80 1333 0.22 > 14.60 712 0.00 .... . 0.00 .... . > > 1c.81 5 95.14 94.69 1.71 292 0.22 22.80 1325 0.22 > 14.60 548 0.00 .... . 0.00 .... . > > /aggr0/plex0/rg1: > > 1c.66 1 0.67 0.00 .... . 0.31 19.29 1311 0.36 > 10.50 238 0.00 .... . 0.00 .... . > > 1c.83 1 0.67 0.00 .... . 0.31 19.29 1415 0.36 > 10.50 190 0.00 .... . 0.00 .... . > > 1c.82 4 48.60 48.24 2.21 320 0.22 22.80 1553 0.13 > 21.33 234 0.00 .... . 0.00 .... . > > 1c.19 51 67.89 67.44 1.92 5315 0.22 22.80 1281 0.22 > 13.20 788 0.00 .... . 0.00 .... . > > 1c.18 55 72.75 72.34 1.90 4996 0.22 23.00 1122 0.18 > 16.00 1109 0.00 .... . 0.00 .... . > > 1c.35 30 36.10 35.52 2.67 3190 0.31 15.86 1802 0.27 > 11.33 588 0.00 .... . 0.00 .... . > > 1c.34 41 52.97 52.43 2.04 4207 0.31 16.29 1570 0.22 > 13.60 750 0.00 .... . 0.00 .... . > > 1c.51 100 119.82 119.46 1.57 25873 0.22 22.80 1588 0.13 > 21.33 2313 0.00 .... . 0.00 .... . > > 1c.50 59 72.03 71.44 1.83 7750 0.27 19.33 1233 0.31 > 10.86 1289 0.00 .... . 0.00 .... . > > 1c.67 4 94.60 94.15 1.68 279 0.18 24.50 1071 0.27 > 12.33 338 0.00 .... . 0.00 .... . > > /aggr0/plex0/rg2: > > 1c.85 1 0.94 0.00 .... . 0.54 12.00 1806 0.40 > 10.11 538 0.00 .... . 0.00 .... . > > 1c.84 1 0.94 0.00 .... . 0.54 12.00 1729 0.40 > 10.11 495 0.00 .... . 0.00 .... . > > 1c.21 47 67.40 66.90 1.86 4701 0.27 19.17 1452 0.22 > 14.20 845 0.00 .... . 0.00 .... . > > 1c.20 56 73.56 73.02 1.79 4866 0.18 25.50 1039 > 0.36 9.63 870 0.00 .... . 0.00 .... . > > 1c.37 51 68.79 68.21 1.76 6072 0.27 19.17 1174 0.31 > 11.43 988 0.00 .... . 0.00 .... . > > 1c.36 42 50.85 50.18 2.31 3807 0.40 12.78 1852 0.27 > 13.33 800 0.00 .... . 0.00 .... . > > 1c.53 59 75.85 75.18 1.86 5024 0.36 14.25 2237 0.31 > 10.43 493 0.00 .... . 0.00 .... . > > 1c.52 18 21.27 20.77 3.83 2205 0.27 19.17 1496 0.22 > 14.20 465 0.00 .... . 0.00 .... . > > 1c.69 5 71.76 71.00 1.96 296 0.40 12.78 2087 > 0.36 9.63 610 0.00 .... . 0.00 .... . > > 1c.68 5 71.58 71.13 1.84 352 0.22 23.60 1314 0.22 > 14.80 514 0.00 .... . 0.00 .... . > > > > This message (including any attachments) contains confidential > and/or proprietary information intended only for the addressee. > Any unauthorized disclosure, copying, distribution or reliance on > the contents of this information is strictly prohibited and may > constitute a violation of law. If you are not the intended > recipient, please notify the sender immediately by responding to > this e-mail, and delete the message from your system. If you > have any questions about this e-mail please notify the sender > immediately. > > This message (including any attachments) contains confidential > and/or proprietary information intended only for the addressee. > Any unauthorized disclosure, copying, distribution or reliance on > the contents of this information is strictly prohibited and may > constitute a violation of law. If you are not the intended > recipient, please notify the sender immediately by responding to > this e-mail, and delete the message from your system. If you > have any questions about this e-mail please notify the sender > immediately. > > This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

1 0

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters