toasters

toasters@lists.teaparty.net

13531 discussions

SnapRestore very slow
by Markus.Schlegel＠roto-frank.com 04 Aug '14

04 Aug '14

Hello, i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage. It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself. I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster... Best Regards, Markus Schlegel Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier

5 7

ndmpcopy from netapp to oracle zs3?
by Jordan Slingerland 31 Jul '14

31 Jul '14

<removed image> I am trying to do an ndmpcopy from a 7m 8.1.4P1 to an Oracle ZS3. I am not even sure if this is possible, but It authenticates successfully then dies with a network communication error. Looking at a pkkt capture, there is 2 way protocol communication for about 15 seconds then the netapp sends a reset. --Jordan toaster*> ndmpcopy -d -da user:pass /vol/vm_store101 zs31:/export/test123/ Ndmpcopy: Starting copy [ 24 ] ... Ndmpcopy: toaster: Notify: Connection established Ndmpcopy: zs31: Notify: Connection established Ndmpcopy: toaster: Connect: Authentication successful Ndmpcopy: zs31: Connect: Authentication successful Ndmpcopy: zs31: Log: Running Restore without Direct Access RestoreNdmpcopy: zs31: Log: Restoring to "/export/test123/". Ndmpcopy: zs31: Log: Tape server: remote at 10.41.1.205:33866. Ndmpcopy: toaster: Log: DUMP: creating "/vol/vm_store101/../snapshot_for_backup.3267" snapshot. Ndmpcopy: toaster: Log: DUMP: Using Full Volume Dump Ndmpcopy: toaster: Log: DUMP: Date of this level 0 dump: Thu Jul 31 11:07:51 2014. Ndmpcopy: toaster: Log: DUMP: Date of last level 0 dump: the epoch. Ndmpcopy: toaster: Log: DUMP: Dumping /vol/vm_store101 to NDMP connection Ndmpcopy: toaster: Log: DUMP: mapping (Pass I)[regular files] Ndmpcopy: toaster: Log: DUMP: mapping (Pass II)[directories] Ndmpcopy: toaster: Log: DUMP: estimated 2616811716 KB. Ndmpcopy: toaster: Log: DUMP: dumping (Pass III) [directories] Ndmpcopy: toaster: Log: DUMP: dumping (Pass IV) [regular files] Ndmpcopy: zs31: Notify: restore successful Ndmpcopy: toaster: Log: DUMP: Network communication error Ndmpcopy: toaster: Log: DUMP: DUMP IS ABORTED Ndmpcopy: toaster: Log: DUMP: Deleting "/vol/vm_store101/../snapshot_for_backup.3267" snapshot. Ndmpcopy: toaster: Log: DATA: Backup terminated: EVENT: I/O ERROR (for /vol/vm_store101) Ndmpcopy: toaster: Connection halted: HALT: Internal error! Ndmpcopy: Notify: Transfer failed For the seventh consecutive year, Independent Health was named one of the best companies to work for in New York State. The Buffalo News also named Independent Health one of the Top Workplaces in Western New York for 2014. Go to www.independenthealth.com to view careers and available positions. We are an Equal Opportunity Employer. CONFIDENTIALITY NOTICE: This e-mail and its attachments (collectively referred to as "e-mail") may contain confidential information that is privileged and protected from disclosure by Federal and State confidentiality laws, rules or regulations. This e-mail is intended for the designated addressee only. If you are not the designated addressee, you are notified that any disclosure, copying or distribution of this e-mail may be unlawful and may subject you to legal consequences. If you have received this e-mail in error, please contact me immediately by telephone at (716) 631 - 3001 and delete the e-mail from your computer immediately. Thank you for your attention.

4 3

Issues controller takeover/givebacks
by Andrew Laurence 29 Jul '14

29 Jul '14

Greetings all. Do you ever find issues with takeover/giveback events? We've had two relatively recently which resulted in service outages. Some months ago we had a service outage during an upgrade to 8.1.4p1 on our 3240 pair. During one of the givebacks, the controller came back without any networking. NetApp speculates the 10GE driver didn't initialize on when the controller rebooted. Either way, our storage service was AWOL as a result. And then Friday we had a real controller crash. This one occurred on an offsite HA pair of 2040s. Lately we have been chasing down a PCI error on one controller; NetApp eventually came out to replace that controller. After moving operations via 'cf takeover', it turned out that the new controller had very old SP firmware, older than is supported for the running 8.1.4.P1. The tech called an engineer for guidance, but just as the engineer came on WebEx the running controller panicked; all services were offline. (NetApp is still investigating this; we're uploading different files and working through the process.) While we can look at each of these and consider them anomalies for different reasons, it's still very worrisome that the core availability technology has twice resulted in service outages. Any thoughts? Thanks, Andrew -- Andrew Laurence Office of Information Technology atlauren(a)uci.edu University of California, Irvine

3 3

cDOT - Move Volume from vserver to another?
by Alexander Griesser 29 Jul '14

29 Jul '14

Hey there, is it possible to move a volume from one vserver to another one on the same node and by using the same aggregate? I can find plenty of possibilities to move a volume to a different physical node or aggregate, but not for what I want to do. node01 -> aggr01 -> vFiler01 -> Volume01 -> LUN01 node01 -> aggr01 -> vFiler02 -> Volume01 -> LUN01 so basically, I want to "dismount" Volume01 from "vFiler01" and mount it on "vFiler02" - is that possible at all? Best, Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at<http://www.anexia.at/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

4 7

Disk Shelf Firmware 173?
by Alexander Griesser 16 Jul '14

16 Jul '14

Good morning, latest Config Advisor 3.5 suggests that I need to update my disk shelf firmware on DS2246 and DS4246 shelves from 162 to 173 - but I'm unable to find this firmware on the support site. Is this an error in CA or can someone point me to the download location of this new shelf firmware? Best, Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at<http://www.anexia.at/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

2 1

PANIC: raid: there are no data or parity disks in SK process rc on release 8.2.1
by Sri Chan 16 Jul '14

16 Jul '14

I've cleared the config info and trying to boot into 7-mode. (Flash has 8.2.1 OS) After disk initialization (option 4), NetApp Controller will not boot and the process gets hung. If I try to power cycle and reboot, it says no data disk or parity disk. How do I fix it? Thanks

1 0

ndmpcopy error
by Jordan Slingerland 15 Jul '14

15 Jul '14

Any idea? ToasterA> ndmpcopy -l 1 /vol/share/.snapshot/hourly.0/folder vol/share/folder_restore Ndmpcopy: Starting copy [ 13 ] ... Ndmpcopy: ntap2: Notify: Connection established Ndmpcopy: ntap2: Notify: Connection established Ndmpcopy: No Level 0 entry found for this dump, forcing a level 0 dump Ndmpcopy: ntap2: Connect: Authentication successful Ndmpcopy: ntap2: Connect: Authentication successful Ndmpcopy: ntap2: Log: DATA: Backup terminated: backup configuration failure (2) on RPC error: ERROR: BAD ENV OP (for /vol/share/.snapshot/hourly.0/Folder) Ndmpcopy: ntap2: Connection halted: HALT: Internal error! Ndmpcopy: ntap2: Log: RESTORE: Read Socket received EOF. Ndmpcopy: Notify: Transfer failed Ndmpcopy: Done For the seventh consecutive year, Independent Health was named one of the best companies to work for in New York State. The Buffalo News also named Independent Health one of the Top Workplaces in Western New York for 2014. Go to www.independenthealth.com to view careers and available positions. We are an Equal Opportunity Employer. CONFIDENTIALITY NOTICE: This e-mail and its attachments (collectively referred to as "e-mail") may contain confidential information that is privileged and protected from disclosure by Federal and State confidentiality laws, rules or regulations. This e-mail is intended for the designated addressee only. If you are not the designated addressee, you are notified that any disclosure, copying or distribution of this e-mail may be unlawful and may subject you to legal consequences. If you have received this e-mail in error, please contact me immediately by telephone at (716) 631 - 3001 and delete the e-mail from your computer immediately. Thank you for your attention.

1 1

SSH Public Key Authentication in Clustered Data OnTap
by Alexander Griesser 15 Jul '14

15 Jul '14

Hey there, I've tried to set up SSH public key authentication on a new cluster pair (8.2.1P1) today and failed miserably - has anyone configured that as of yet? What I've done (and what seems to be the correct procedure) is: security login create -username admin -application ssh -authmethod publickey -role admin -vserver CLUSTERNAME security login publickey create -vserver CLUSTERNAME -username admin -index 0 -publickey "ssh-rsa AAAAB3....C8=" -comment ANEXIA The resulting configuration looks like that: ::> security login show -application ssh Vserver: CLUSTERNAME Authentication Acct UserName Application Method Role Name Locked ---------------- ----------- -------------- ---------------- ------ admin ssh password admin no admin ssh publickey admin - 2 entries were displayed. ::> security login publickey show Vserver: CLUSTERNAME UserName: admin Index: 0 Public Key: ssh-rsa AAAAB3....C8= Fingerprint: a7:08:e1:0d:22:ea:59:97:f9:3e:5c:1d:2a:84:ec:40 Bubblebabble fingerprint: xokel-...-soxex Comment: ANEXIA But when I try to login using username "admin" and my private key (which works on hundreds of other boxes and also on all of my 7-mode filers), the filer just seems to refuse my key and prompts me for the password. Also (maybe unrelated), when logging in via SSH, I do always get this warning message: Could not chdir to home directory /var/home/admin: No such file or directory Getting this on two Clustered Data Ontap systems so far, both running 8.2.1. Thanks, Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at<http://www.anexia.at/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

4 7

Re: SSH Public Key Authentication in Clustered Data OnTap
by Daniel Burkland 14 Jul '14

14 Jul '14

Alexander, The issue you are experiencing with the "/var/home/admin" error message is related to Bug #820968. To resolve this issue perform the following on each node in the cluster: 1. Login to systemshell: *Note:* You might need to unlock the diag account. For more information, see 1012484 <https://kb.netapp.com/support/index?page=content&id=1012484>: Data ONTAP 8: How to unlock the diag user account ::> set diag ::*> systemshell -node <node_name> % cd /var/home % sudo mkdir diag % sudo mkdir admin % sudo chown diag:nogroup diag % sudo chown admin:nogroup admin Dan Burkland Sent from my mobile device, please excuse typos.

2 1

cDOT deployment: racks layout planning
by Momonth 11 Jul '14

11 Jul '14

Hi All, I'm looking at deploying cDOT cluster based on "FAS 8040 HA" from scratch (to serve both NAS + SAN environment), current plan is to start with 2 HA pairs ie 4 nodes, each node: DS4246 24*4TB SATA x3 DS2246 24*1.2TB SAS x5 and then continue to grow with another HA pair ie + 2 more nodes. I'd also like to plan for 4th HA pair for purposes of (possible) HW upgrades. For each HA pair I plan to allocate two racks (a standard 42U rack). I wonder if anyone has had similar deployment to see what was racks layout design. "FAS 8040 HA" is a single chassis two controllers appliance so it has to be in one rack. How to distribute shelves, given that I plan to add both SAS and SATA shelves later on. Also what would be the best place to put 10Gb cluster interconnect switches? Cheers, Vladimir

4 5

Re: Re: LACP oddness
by isaac.gonzalez 02 Jul '14

02 Jul '14

Hi guys, Have you solved this problem? I've the same problem since the upgrade to 8.2 and Cisco switches. Have you tried disabling fast path ? ip.fastpath.enable OFF I tried to disable it, but the problem continues, I've opened a case with Netapp. Isaac

1 0

"Best" way to create and manage SnapVault relationships?
by Ray Van Dolson 02 Jul '14

02 Jul '14

I have a FlexVol on Filer1 and a second filer ("Filer2") at a remote site. Filer2 already has aggregates and volumes carved out on it, but does have an aggregate with quite a bit of free space. I'd like to SnapVault my volume on Filer1 to Filer2 as well as create some snapshot retention schedules on both sides. Curious what all of you out there see as your preferred way to set this up: - CLI - System Manager - Management Console (Protection Manager) -- this is the thick client - Operations Manager (web interface -- formerly DFM?) The Management Console route seems to possibly be the most elegant, but is also fairly confusing. And it seems like it wants to work with unprovisioned storage rather than storage which has already been carved up and is in active use. Thanks, Ray

2 1

vol lang undefined
by Philbert Rupkins 29 Jun '14

29 Jun '14

Hello Toasters, We inherited an array with vol0's volume language set to undefined. As a result, most of this array's user volumes also do not have vol lang defined. This includes both NFS and CIFS shares. There are currently no problems but we would like to align ourselves with best practices. Generally speaking, vol lang should be set to eng_us across the environment. A couple questions in regard to making the change from 'undefined' to 'en_us': 1. What does a volume language of 'undefined' effectively mean? Does NetApp default to a language code (POSIX, en_us, other?) when the volume language is set to undefined? 2. Can the volume language be safely changed? In the event that files are inaccessible after changing the volume language, can we simply revert the vol lang setting back to 'undefined' in order to again allow access to the files? I ask the second question because I see the documentation states that changing the volume language of an existing volume may render some files inaccessible. Thanks in advance for any insight you have into this matter! Any other suggestions on handling this appropriately would be appreciated! -Phil

3 4

3rd party support for 'older' systems
by Paul Letta 25 Jun '14

25 Jun '14

Anyone out there have recommendations for 3rd party support once a filer gets 4+yr old and/or EOL? HW and phone support I can see being pretty easy to provide.... but how does s/w support go.. I guess no s/w contract with NetApp...then no s/w updates? Just wondering what others have done. Thanks, Paul

2 1

Install Wildcard Certificate for OnCommand Unified Manager / Performance Manager
by Alexander Griesser 21 Jun '14

21 Jun '14

Hey, has anyone ever tried to install a wildcard certificate for OCUM or OCPM? The only options I have is to download a CSR from the appliance but there does not seem to be a way to upload my own SSL key + certificate. Best, Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH Telefon: +43-5-0556-320 Telefax: +43-5-0556-500 E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at<http://www.anexia.at/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

1 0

CLI method to get shelf PSU fru
by Jordan Slingerland 20 Jun '14

20 Jun '14

I cannot seem to find a CLI method to get the FRU of the PSU's in a DS14-Mk4-FC shelf. 8.1.4P1 7m. Any ideas? For the seventh consecutive year, Independent Health was named one of the best companies to work for in New York State. Go to www.independenthealth.com to view careers and available positions. We are an Equal Opportunity Employer. CONFIDENTIALITY NOTICE: This e-mail and its attachments (collectively referred to as "e-mail") may contain confidential information that is privileged and protected from disclosure by Federal and State confidentiality laws, rules or regulations. This e-mail is intended for the designated addressee only. If you are not the designated addressee, you are notified that any disclosure, copying or distribution of this e-mail may be unlawful and may subject you to legal consequences. If you have received this e-mail in error, please contact me immediately by telephone at (716) 631 - 3001 and delete the e-mail from your computer immediately. Thank you for your attention.

2 2

v-series lun ownership
by Svein Harang 18 Jun '14

18 Jun '14

Hi everybody, I came across a strange problem today, and all the well-meaning people on google and netapp community could not provide an answer as far as I could see. Nutshell: New environment, first v-series, fabric metro cluster. After assigning the disks wrongly the first time (missing -p <pool>) I’ve tried "disk assign <disk_id> -o unowned ” without luck, I did a "disk remove_ownership”. It worked, sort of. There is one LUN left, which both controllers claim that the other controller own. Since the controllers can’t unown luns they don’t own, I am finding myself in a bit of a pickle. Has anyone come across this situation before? -- Sincerely / Mvh Svein Harang <sh(a)basefarm.com> +47 4000 4200 Direct: +47 417 36 019

3 2

AUTO: Markus Schlegel ist außer Haus bis 22.06.2014 / Markus Schlegel is out of office until 22/6/2014
by Markus.Schlegel＠roto-frank.com 17 Jun '14

17 Jun '14

Guten Tag, ich bin ab 16.06.2014 nicht im Büro. Ich kehre zurück am 23.06.2014. Bitte beachten Sie den Feiertag am: 19.06.2014 Mit freundlichen Grüßen Markus Schlegel Dear Sir / Madam, I will be out of the office on 16/6/2014 and will return on 23/6/2014. Please take note of the public holiday on: 19/06/2014 Kind regards Markus Schlegel Hinweis: Dies ist eine automatische Antwort auf Ihre Nachricht "v-series lun ownership" gesendet am 18/6/2014 0:13:34. Sie erhalten keine weiteren Benachrichtigungen, während diese Person abwesend ist. Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier

1 0

wafltop / wafl scan status
by Will.Burchell＠skanska.co.uk 17 Jun '14

17 Jun '14

1 0

wafl scan status / Wafltop
by Will.Burchell＠skanska.co.uk 17 Jun '14

17 Jun '14

Hello I attach a wafltop output run for 10 minutes. We are experiencing a fair amount of CPU contention and latency. Does anyone have any input on the below? I also show a wafl scan status which shows there is a lot of activity. Is that normal? wafltop stop CPU Utilization Percent Application Total STRIPE VOL_LOG VOL_VBN VBN VOL AGGR_VBN AGGR SERIAL XCleaner ----------- -------- -------- -------- -------- -------- -------- -------- -------- -------- ------- aggrsata2:SV_L_LUN_VOL0199:other:_WAFL_BACKDOOR: 15 0 0 0 0 0 0 0 15 0 other:other:other:FREE_CACHE_REFILL: 8 5 0 3 0 0 0 0 0 0 aggrsata2:SV_L_LUN_VOL0199:scanner:_WAFL_BACKDOOR: 5 0 0 0 0 0 0 0 5 0 other:other:other:RAIDIO_READ_DONE: 5 4 0 1 0 0 0 0 0 0 aggrvm:L_NFS_VOL0178:nfsv3:WAFL_WRITE: 4 4 0 0 0 0 0 0 0 0 other:other:other:WAFL_WRITE_DONE: 4 4 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0176:nfsv3:WAFL_READ: 3 3 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0183:nfsv3:WAFL_WRITE: 3 3 0 0 0 0 0 0 0 0 aggrsata1:L_LUN_VOL0198:iscsi:WAFL_READ: 3 3 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0176:nfsv3:WAFL_WRITE: 3 3 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0177:nfsv3:WAFL_WRITE: 3 3 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0179:nfsv3:WAFL_READ: 2 2 0 0 0 0 0 0 0 0 aggrsata1:L_LUN_VOL0198:iscsi:WAFL_WRITE: 2 2 0 0 0 0 0 0 0 0 aggrsata2:SV_L_LUN_VOL0198:scanner:_WAFL_BACKDOOR: 2 0 0 0 0 0 0 0 2 0 aggrsata2:L_LUN_VOL0199:iscsi:WAFL_READ: 2 2 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0179:nfsv3:WAFL_WRITE: 2 2 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0161:nfsv3:WAFL_WRITE: 1 1 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0174:nfsv3:WAFL_WRITE: 1 1 0 0 0 0 0 0 0 0 aggrvm::walloc:WAFL_BLKFREE_PVOL_CO: 1 0 0 0 0 0 1 0 0 0 other:other:other:WAFFINITY_NVLOG_COMP: 1 1 0 0 0 0 0 0 0 0 CPU Time us Application Total STRIPE VOL_LOG VOL_VBN VBN VOL AGGR_VBN AGGR SERIAL XCleaner ----------- -------- -------- -------- -------- -------- -------- -------- -------- -------- ------- aggrsata2:L_LUN_VOL0199:file i/o:WAFL_LOOKUP: 46164 0 0 0 0 0 0 0 46164 0 aggr0:vol0:file i/o:WAFL_LOOKUP: 33469 0 0 0 0 0 0 0 33469 0 aggr0:vol0:file i/o:WAFL_READDIR: 31339 0 0 0 0 0 0 0 31339 0 aggrsata1::file i/o:WAFL_LOOKUP: 4725 0 0 0 0 0 0 0 4725 0 aggrvm:L_NFS_VOL0179:nfsv3:WAFL_READ: 4479 4349 130 0 0 0 0 0 0 0 aggrsata2:SV_L_LUN_VOL0198:file i/o:WAFL_GETATTR: 3639 3639 0 0 0 0 0 0 0 0 aggrsata2:SV_L_LUN_VOL0198:file i/o:WAFL_READ: 2397 1635 0 0 0 0 0 0 762 0 aggrsata1:L_LUN_VOL0201:iscsi:WAFL_READ: 2252 2191 55 0 0 0 0 0 6 0 aggrvm:L_NFS_VOL0183:nfsv3:WAFL_READDIR: 1650 1628 22 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0174:nfsv3:WAFL_READ: 1542 1514 28 0 0 0 0 0 0 0 aggrvm:P_NFS_WPF0160:nfsv3:WAFL_DOACCESS: 1525 1525 0 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0161:nfsv3:WAFL_READ: 1520 1497 23 0 0 0 0 0 0 0 aggrsata2:L_LUN_VOL0199:iscsi:WAFL_READ: 1480 1441 39 0 0 0 0 0 0 0 aggrvm:L_NFS_VOL0158:nfsv3:WAFL_READ: 1378 1355 23 0 0 0 0 0 0 0 aggr0:vol0:spinvfs:WAFL_READ: 1296 1289 7 0 0 0 0 0 0 0 aggrsata2:L_LUN_VOL0199:file i/o:WAFL_READ: 1283 900 0 0 0 357 0 0 26 0 aggrvm:L_NFS_VOL0181:nfsv3:WAFL_READ: 1270 1263 7 0 0 0 0 0 0 0 aggrvm:L_LUN_VOL0152:iscsi:WAFL_READ: 1234 1213 21 0 0 0 0 0 0 0 aggr0:vol0:file i/o:WAFL_READ: 1198 1189 1 0 0 0 0 0 8 0 aggrsata2:SV_L_LUN_VOL0199:file i/o:WAFL_READ: 1195 791 0 0 0 0 0 0 404 0 Latency Application Latency ms ----------- ---------- aggrvm:L_NFS_VOL0180:nfsv3:WAFL_SETATTR: 936.000 aggrvm:L_NFS_VOL0179:nfsv3:WAFL_READ: 13.501 aggrvm:L_NFS_VOL0183:nfsv3:WAFL_READ: 10.962 aggrvm:P_NFS_WPF0160:nfsv3:WAFL_READ: 9.148 aggrvm:L_NFS_VOL0180:nfsv3:WAFL_READ: 8.713 aggrvm:L_NFS_VOL0181:nfsv3:WAFL_READ: 8.205 aggrsata1:L_LUN_VOL0198:iscsi:WAFL_READ: 8.082 aggrvm:L_NFS_VOL0161:nfsv3:WAFL_READ: 7.525 aggrvm:L_NFS_VOL0179:nfsv3:WAFL_READDIR: 6.000 aggrvm:L_NFS_VOL0177:nfsv3:WAFL_READ: 5.825 aggrvm:L_NFS_VOL0180:nfsv3:WAFL_LOOKUP: 5.000 aggrvm:L_NFS_VOL0183:nfsv3:WAFL_READDIR: 5.000 aggrvm:L_NFS_VOL0158:nfsv3:WAFL_READ: 4.926 aggrvm:L_NFS_VOL0178:nfsv3:WAFL_READ: 4.775 aggrvm:L_NFS_VOL0174:nfsv3:WAFL_GETATTR: 4.666 aggr0:vol0:spinvfs:WAFL_READ: 3.250 aggrsata1:L_LUN_VOL0201:iscsi:WAFL_READ: 3.111 aggrvm:P_NFS_WPF0160:nfsv3:WAFL_STATFS: 3.000 aggrsata1:L_LUN_VOL0200:iscsi:WAFL_WRITE: 2.435 aggrsata2:L_LUN_VOL0199:iscsi:WAFL_READ: 2.289 Application System Latency ms ----------- ----------------- aggrsata2:SV_L_LUN_VOL0198:file i/o:WAFL_WRITE: 21.786 aggrsata2:SV_L_LUN_VOL0198:file i/o:WAFL_READ: 21.000 aggrsata2:SV_L_LUN_VOL0198:file i/o:WAFL_GETATTR: 8.000 aggrsata1:L_LUN_VOL0198:file i/o:WAFL_READ: 4.454 aggrvm:L_NFS_VOL0158:file i/o:WAFL_WRITE: 4.000 aggrsata2:L_LUN_VOL0199:file i/o:WAFL_READ: 3.333 aggrvm:L_NFS_VOL0180:file i/o:WAFL_WRITE: 3.261 aggrsata1:L_LUN_VOL0198:file i/o:WAFL_VDISK_SETTYPE: 3.000 aggrvm:L_NFS_VOL0224:file i/o:WAFL_WRITE: 3.000 aggrvm:L_NFS_VOL0177:file i/o:WAFL_WRITE: 2.245 aggrvm:L_NFS_VOL0183:file i/o:WAFL_WRITE: 2.220 aggrvm:L_NFS_VOL0176:file i/o:WAFL_WRITE: 2.201 aggrvm:L_NFS_VOL0179:file i/o:WAFL_WRITE: 2.136 aggrvm:L_NFS_VOL0181:file i/o:WAFL_WRITE: 2.050 aggrsata2:SV_L_LUN_VOL0199:file i/o:WAFL_GETATTR: 1.750 aggrsata2:L_LUN_VOL0199:file i/o:WAFL_LOOKUP: 1.500 aggrsata2:L_LUN_VOL0199:file i/o:WAFL_VDISK_SETTYPE: 1.444 aggrsata1:L_LUN_VOL0198:file i/o:WAFL_STATFS: 1.000 aggrsata1::file i/o:WAFL_LOOKUP: 1.000 aggrvm:L_NFS_VOL0178:file i/o:WAFL_STATFS: 1.000 I/O utilization ---------MB Read---------- ---------MB Write--------- --------IOs Read---------- --------IOs Write--------- Application MB Total Standard PAM Hybrid Standard PAM Hybrid Standard PAM Hybrid Standard PAM Hybrid ----------- -------- -------- -------- -------- -------- -------- -------- -------- -------- -------- -------- -------- -------- aggrsata1:L_LUN_VOL0198:iscsi:WAFL_READ: 17124 15503 1621 0 0 0 0 412113 88557 0 0 0 0 other:other:other:FREE_CACHE_REFILL: 13732 0 0 0 0 13732 0 0 0 0 0 54917 0 aggrvm:L_NFS_VOL0179:nfsv3:WAFL_READ: 10348 9956 392 0 0 0 0 483841 58184 0 0 0 0 aggrvm:L_NFS_VOL0176:nfsv3:WAFL_READ: 7954 6989 965 0 0 0 0 407363 124931 0 0 0 0 aggrsata1:L_LUN_VOL0198:snapmirror:WAFL_SNAP_DIFF: 7523 6052 1471 0 0 0 0 249428 54191 0 0 0 0 other:other:other:WAFFINITY_RA_STRIPE_: 7432 7339 93 0 0 0 0 159291 4544 0 0 0 0 aggrvm:L_NFS_VOL0176:nfsv3:WAFL_WRITE: 7288 384 152 0 6752 0 0 98462 38971 0 0 0 0 aggrsata2:SV_L_LUN_VOL0198:file i/o:WAFL_WRITE: 6759 148 40 0 6571 0 0 37781 10251 0 0 0 0 aggrsata1:L_LUN_VOL0198:iscsi:WAFL_WRITE: 6726 65 112 0 6549 0 0 16507 28706 0 0 0 0 aggrvm:L_NFS_VOL0177:nfsv3:WAFL_WRITE: 5538 426 102 0 5010 0 0 109134 26076 0 0 0 0 aggrvm:L_NFS_VOL0178:nfsv3:WAFL_WRITE: 5444 442 171 0 4831 0 0 113018 43797 0 0 0 0 aggrvm:L_NFS_VOL0183:nfsv3:WAFL_WRITE: 5298 419 125 0 4754 0 0 107294 32047 0 0 0 0 aggrvm:L_NFS_VOL0179:nfsv3:WAFL_WRITE: 4153 381 92 0 3680 0 0 97639 23545 0 0 0 0 aggrvm:L_NFS_VOL0174:nfsv3:WAFL_WRITE: 3748 84 32 0 3632 0 0 21436 8233 0 0 0 0 aggrsata2:L_LUN_VOL0199:iscsi:WAFL_READ: 3692 3482 210 0 0 0 0 90262 10488 0 0 0 0 aggrvm:L_NFS_VOL0180:nfsv3:WAFL_WRITE: 3367 205 85 0 3077 0 0 52391 21642 0 0 0 0 other:other:other:WAFL_WRITE_DONE: 3325 0 0 0 0 3325 0 0 0 0 0 13309 0 aggrsata2:L_LUN_VOL0199:iscsi:WAFL_WRITE: 2738 25 15 0 2698 0 0 6364 3849 0 0 0 0 aggrsata1:L_LUN_VOL0198:snapmirror:WAFL_SNAP_READ: 2340 1838 502 0 0 0 0 356929 96469 0 0 0 0 aggrsata2:SV_L_LUN_VOL0199:other:_WAFL_BACKDOOR: 2265 12 2241 0 12 0 0 3029 536488 0 0 0 0 NVLog Utilization Application NVLog in KB/s ----------- ------------------ aggrsata2:SV_L_LUN_VOL0198:file i/o:WAFL_WRITE: 10036 aggrsata1:L_LUN_VOL0198:iscsi:WAFL_WRITE: 9692 aggrvm:L_NFS_VOL0176:nfsv3:WAFL_WRITE: 9452 aggrvm:L_NFS_VOL0177:nfsv3:WAFL_WRITE: 7462 aggrvm:L_NFS_VOL0183:nfsv3:WAFL_WRITE: 7159 aggrvm:L_NFS_VOL0178:nfsv3:WAFL_WRITE: 7140 aggrsata2:L_LUN_VOL0199:iscsi:WAFL_WRITE: 7083 aggrvm:L_NFS_VOL0174:nfsv3:WAFL_WRITE: 5422 aggrvm:L_NFS_VOL0179:nfsv3:WAFL_WRITE: 5358 aggrvm:L_NFS_VOL0180:nfsv3:WAFL_WRITE: 4222 aggrvm:L_NFS_VOL0182:nfsv3:WAFL_WRITE: 2698 aggrvm:L_NFS_VOL0161:nfsv3:WAFL_WRITE: 1944 aggrvm:L_NFS_VOL0181:nfsv3:WAFL_WRITE: 1647 aggrvm:P_NFS_WPF0160:nfsv3:WAFL_WRITE: 842 aggrvm:L_NFS_VOL0158:nfsv3:WAFL_WRITE: 351 aggrvm:L_NFS_VOL0176:file i/o:WAFL_WRITE: 70 aggrvm:L_NFS_VOL0177:file i/o:WAFL_WRITE: 53 aggrvm:L_NFS_VOL0183:file i/o:WAFL_WRITE: 50 aggrvm:L_NFS_VOL0179:file i/o:WAFL_WRITE: 42 aggrvm:L_NFS_VOL0180:file i/o:WAFL_WRITE: 31 Application NVLog_b2b in KB/s ----------- ---------------------- wafl scan status Volume vol0: Scan id Type of scan progress 11 active bitmap rearrangement fbn 3263 of 3971 w/ max_chain_len 3 Volume L_NFS_VOL0224: Scan id Type of scan progress 12 active bitmap rearrangement fbn 5565 of 6853 w/ max_chain_len 3 Volume L_LUN_VOL0152: Scan id Type of scan progress 13 active bitmap rearrangement fbn 1283 of 5577 w/ max_chain_len 3 35 container block reclamation block 147 of 5578 (fbn 147) Volume L_NFS_VOL0158: Scan id Type of scan progress 14 active bitmap rearrangement fbn 43778 of 45689 w/ max_chain_len 3 Volume P_NFS_VSW0159: Scan id Type of scan progress 15 active bitmap rearrangement fbn 23963 of 36551 w/ max_chain_len 3 Volume P_NFS_WPF0160: Scan id Type of scan progress 16 active bitmap rearrangement fbn 5242 of 36551 w/ max_chain_len 3 Volume L_NFS_VOL0161: Scan id Type of scan progress 17 active bitmap rearrangement fbn 44716 of 45689 w/ max_chain_len 3 3431 snap create summary update block 7992 of 45690 (fbn 29116) 3434 blocks used summary update block 4284 of 45690 (fbn 14381) Volume L_NFS_VOL0172: Scan id Type of scan progress 18 active bitmap rearrangement fbn 16466 of 27413 w/ max_chain_len 3 Volume L_NFS_VOL0174: Scan id Type of scan progress 19 active bitmap rearrangement fbn 22931 of 25129 w/ max_chain_len 3 Volume L_NFS_VOL0176: Scan id Type of scan progress 20 active bitmap rearrangement fbn 29215 of 54827 w/ max_chain_len 3 Volume L_NFS_VOL0177: Scan id Type of scan progress 21 active bitmap rearrangement fbn 32845 of 54827 w/ max_chain_len 3 Volume L_NFS_VOL0178: Scan id Type of scan progress 22 active bitmap rearrangement fbn 28871 of 54827 w/ max_chain_len 3 Volume L_NFS_VOL0179: Scan id Type of scan progress 23 active bitmap rearrangement fbn 12076 of 36551 w/ max_chain_len 3 Volume L_NFS_VOL0180: Scan id Type of scan progress 24 active bitmap rearrangement fbn 13106 of 36551 w/ max_chain_len 3 Volume L_NFS_VOL0181: Scan id Type of scan progress 25 active bitmap rearrangement fbn 12588 of 36551 w/ max_chain_len 3 Volume L_NFS_VOL0182: Scan id Type of scan progress 26 active bitmap rearrangement fbn 2419 of 4461 w/ max_chain_len 3 Volume L_NFS_VOL0183: Scan id Type of scan progress 27 active bitmap rearrangement fbn 63137 of 63965 w/ max_chain_len 3 Volume SV_L_NFS_VOL0178: Scan id Type of scan progress 28 active bitmap rearrangement fbn 39988 of 54827 w/ max_chain_len 3 Volume L_LUN_VOL0198: Scan id Type of scan progress 32 active bitmap rearrangement fbn 60526 of 68534 w/ max_chain_len 3 3443 snap create summary update block 4897 of 68535 (fbn 4437) Volume L_LUN_VOL0200: Scan id Type of scan progress 34 active bitmap rearrangement fbn 3607 of 54827 w/ max_chain_len 3 Volume L_LUN_VOL0201: Scan id Type of scan progress 52 active bitmap rearrangement fbn 12935 of 54827 w/ max_chain_len 3 Volume SV_L_NFS_VOL0161: Scan id Type of scan progress 53 active bitmap rearrangement fbn 44350 of 63965 w/ max_chain_len 3 Volume SV_L_NFS_VOL0177: Scan id Type of scan progress 56 active bitmap rearrangement fbn 7859 of 61680 w/ max_chain_len 3 Volume SV_L_NFS_VOL0181: Scan id Type of scan progress 57 active bitmap rearrangement fbn 1550 of 45689 w/ max_chain_len 3 Volume SV_L_NFS_VOL0202: Scan id Type of scan progress 60 active bitmap rearrangement fbn 13923 of 31982 w/ max_chain_len 3 Volume SV_L_NFS_VOL0180: Scan id Type of scan progress 62 active bitmap rearrangement fbn 35314 of 50258 w/ max_chain_len 3 Volume SV_L_NFS_VOL0172: Scan id Type of scan progress 63 active bitmap rearrangement fbn 763 of 2230 w/ max_chain_len 3 Volume L_NFS_VOL0202: Scan id Type of scan progress 65 active bitmap rearrangement fbn 9076 of 20560 w/ max_chain_len 3 Volume SV_L_NFS_VOL0158: Scan id Type of scan progress 66 active bitmap rearrangement fbn 33221 of 73103 w/ max_chain_len 3 Volume SV_L_LUN_VOL0198: Scan id Type of scan progress 68 active bitmap rearrangement fbn 200707 of 319142 w/ max_chain_len 3 3421 blocks used summary update block 120530 of 319143 (fbn 226694) 3422 snap create summary update block 126523 of 319143 (fbn 266270) Volume SV_L_LUN_VOL0199: Scan id Type of scan progress 70 active bitmap rearrangement fbn 244335 of 319142 w/ max_chain_len 3 3408 snap create summary update block 125303 of 319143 (fbn 220403) 3423 blocks used summary update block 120064 of 319143 (fbn 220612) Volume L_LUN_VOL0199: Scan id Type of scan progress 3325 active bitmap rearrangement fbn 32437 of 54827 w/ max_chain_len 3 3444 snap create summary update block 283 of 54828 (fbn 4437)

1 0

High CPU VM misalignment confusion
by Will.Burchell＠skanska.co.uk 16 Jun '14

16 Jun '14

Hello. I am hoping you can guide me in the right direction We have been experiencing very high CPU load on a 7-mode HA pair of 3270 controllers run 8.1.3P2 We have worked with netapp support on these issues and they note our workload is very high on one controller (where we run our VMware setup from) We also have so called "bad practice" where we are running our exchange ISCSI LUNs on SATA with logs and dbs on the same aggregate (currently separating this out as I type) I have been told by support we have VMDK misalignment, however I spent a long time a few months ago resolving this firstly by using the VSC tool to confirm the problem and then fixing it with a combination of MBRALIGN and VMware converter as a V2V process The support guy tells me he seems misalignment when he runs nfsstat -d but MBRSCAN shows these are aligned. What is going on here? Trying to reduce our CPU and IO burden but getting conflicting information. Finally I think we should look to upgrade to 8.1.4P2 to remove some bugs? We would consider 8.2.x but I don't think we can as we run Exchange 2010 (using SME 6.x etc) Thanks in advance William

5 16

Fabrica metro cluster with ds14mk4 and ds2246
by Milazzo Giacomo 16 Jun '14

16 Jun '14

Hi everybody Can fc path coming fm atto bridges share the same iinitiators on the fas used also by the fc disk loop? Following an head swap fm 3160 to 8040 with 8.2.1 I've zoned a store zone with the fc port used by atto and the 4 initiators on 8040. Exactly as done with port coming from fc loops The fas starts to message a lot of timeouts and errors related to the sas disks then panic Of course the fc loops are on fc ports forced at 4 Gbps while the at to negotiate at 8. Can be this the.issue? Should I.have to.use a separate hba just for sas and another one for fc disk loops? Reading docs this don't seem a requisite. Regards Inviato da Samsung Mobile

3 6

snapmirror, flexclone and inconsistent volumes
by David Byte 13 Jun '14

13 Jun '14

Well, this is a fun one. I do some work for a shop from time to time that has a filer that is no longer under a maintenance contract. The other day, one of the guys saw condensation on the light fixtures and turned off the A/C for the room and left for the day. Needless to say, bad juju and a triple disk RAID failure.. So here we are today, I've managed to get the RAID back online (disk unfail, WAFL_check/wafliron) and have purchased some extra drives to replace the now non-existent spares pool. Here's the challenge. The primary data volumes were replicated off site on a nightly basis with snapmirror. There is a flexclone of one of the volumes where important data had been updated (don't ask) that had not been replicated. I have all the volumes online, but get errors on the console about inconsistencies when reading from all of them (there were severe media errors.) What I want to know... Is there some way to use snapmirror to bring the backing volumes back to a consistent state (including the snapshot backing the flexclone) and hopefully save their flexclone volume as well? Thoughts?'

1 0

Need Help - 100% ANY CPU
by Kalra, Manish 11 Jun '14

11 Jun '14

Hey Guys, I had an issue with one of my 7-mode filers (ONTAP 8.1.2) where all of the CPUs were 100% and there was no indication of any volume doing more IOs. It took down everything on the filer and DBs crashed. During the issue the output of wafltop show -v cpu: aggr_sas02_64:prod_volume1:nfsv3:WAFL_READDIR: consuming 300% CPU When we checked on the hosts mounting this volume we found out that there was one volume "deploy01" which was migrated to new c-mode filer but the mount was not fixed on those 3 hosts. So the NFS stack on those 3 servers was hung. The question now we have is: 1. Why would NFS stale on 3 hosts took down the filer? 2. Is there a BUG around this situation which someone has experienced before? Any help/clues would be greatly appreciated. Manish

1 0

Oracle Volumes and Compression
by Peta Thames 11 Jun '14

11 Jun '14

Hi, I've read that compression works well on volumes hosting Oracle DB data, but I haven't seen it in use anywhere in the wild yet. Is anyone using compression, and if so, what have been your experiences? Cheers, Peta

2 1

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters