toasters

toasters@lists.teaparty.net

1 participants
13528 discussions

Very slow snapvault run on a CIFS share
by Rhodes, Richard L. 06 Aug '14

06 Aug '14

Hi Everyone, We have a system built around several IBM N-Series N3220 (FAS2240-2) filers. When I run snapvault of our biggest cifs share it is running 9-10hours. The users are running a pgm that is deleting lots documents out of this share. A week ago the share had +32m inodes. Today it has 23m inodes. Just yesterday they deleted 1m inodes. During the entire SV run the disks on the prod filer head are Running at 96-100% utilization. This is clearly hammering the disks and they are a big bottleneck. During normal activity on this share usually runs SV in a few min to an hour. My question: Does this sound reasonable? Does a 9-10hr SV run pounding disks at >96% util for a high delete rate in the share? Thanks Rick ============== = detail info ============== All heads are running Data ONTAP Release 8.1.2P1 7-Mode. The main Prod filer is a dual head (HA) with one head dedicated to FCP/luns, while the other head is dedicated to CIFS shares. Prod-Head-A 16x3tb drives, raidDP All CIFS shares Prod-Head-B 22x600gb drives, raidDP Oracle DB FCP/Luns The SV secondary is a single head that is dedicated as a Snapvault secondary. SV-Head-A 18x3tb drives, raidDP SV Secondary for both Prod heads above Df and df -i for the share in question. A week ago it had 32m inodes. df Filesystem kbytes used avail capacity Mounted on /vol/v_fnce22p_cifs/ 3208544256 3143864380 64679876 98% /vol/v_fnce22p_cifs/ /vol/v_fnce22p_cifs/.snapshot 0 264078944 0 ---% /vol/v_fnce22p_cifs/.snapshot Df -i Filesystem iused ifree %iused Mounted on /vol/v_fnce22p_cifs/ 23009838 19147066 55% /vol/v_fnce22p_cifs/ The application folks are running pgms that are deleting documents out of this share. The result of this activity is that snapvault runs on this share is taking 9-10hr. The transfer duration is 7hr, but the entire cmd ran over 9hr. Here is the snapvault status from a backup run. The SV had a transfer duration of 7hr, but the actual cmd took over 9hr to run. ==> cmd = ssh -q xxxxxxxxa -n snapvault status -l /vol/v_fnce22p_cifs/q_fnce22p_cifs Snapvault is ON. Source: yyyyyyyya:/vol/v_fnce22p_cifs/q_fnce22p_cifs Destination: xxxxxxxxa:/vol/v_fnce22p_cifs/q_fnce22p_cifs Status: Idle Progress: - State: Snapvaulted Lag: 10:40:15 Mirror Timestamp: Tue Aug 5 06:42:03 EDT 2014 Base Snapshot: xxxxxxxxa(1896301030)_v_fnce22p_cifs-base.0 Current Transfer Type: - Current Transfer Error: - Contents: Replica Last Transfer Type: Update Last Transfer Size: 542620 KB Last Transfer Duration: 07:11:58 Last Transfer From: yyyyyyyya:/vol/v_fnce22p_cifs/q_fnce22p_cifs During this SV run, the disks on the prod head are >95% busy for the duration of the cmd. Here are a few sysstat lines from during the SV run. CPU NFS CIFS HTTP Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk OTHER FCP iSCSI FCP kB/s iSCSI kB/s in out read write read write age hit time ty util in out in out 23% 0 1113 0 1131 482 1600 25612 1674 0 0 1 90% 64% Ts 98% 8 10 0 0 1 0 0 24% 0 1167 0 1185 1052 4197 16627 2151 0 0 58s 92% 61% 12s 100% 8 10 0 0 1 0 0 28% 0 1177 0 1197 1012 2645 28593 2186 0 0 53s 90% 70% Ts 96% 10 10 0 0 1 0 0 28% 0 1109 0 1127 890 1478 33394 2336 0 0 5s 90% 89% 14 97% 8 10 0 0 1 0 0 ----------------------------------------- The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.

2 1

Data OnTap 8.1 7-mode and Windows 8.1?
by Rue, Randy 05 Aug '14

05 Aug '14

Hello All, Is anyone familiar with any issues between DOT 8.1 7-mode CIFS/SMB and Windows 8.1? Users are reporting error pop-ups when they try to access but so far all I have to go on are pretty generic Windows squawk boxes. Randy

4 5

SnapRestore very slow
by Markus.Schlegel＠roto-frank.com 04 Aug '14

04 Aug '14

Hello, i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage. It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself. I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster... Best Regards, Markus Schlegel Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier

5 7

ndmpcopy from netapp to oracle zs3?
by Jordan Slingerland 31 Jul '14

31 Jul '14

<removed image> I am trying to do an ndmpcopy from a 7m 8.1.4P1 to an Oracle ZS3. I am not even sure if this is possible, but It authenticates successfully then dies with a network communication error. Looking at a pkkt capture, there is 2 way protocol communication for about 15 seconds then the netapp sends a reset. --Jordan toaster*> ndmpcopy -d -da user:pass /vol/vm_store101 zs31:/export/test123/ Ndmpcopy: Starting copy [ 24 ] ... Ndmpcopy: toaster: Notify: Connection established Ndmpcopy: zs31: Notify: Connection established Ndmpcopy: toaster: Connect: Authentication successful Ndmpcopy: zs31: Connect: Authentication successful Ndmpcopy: zs31: Log: Running Restore without Direct Access RestoreNdmpcopy: zs31: Log: Restoring to "/export/test123/". Ndmpcopy: zs31: Log: Tape server: remote at 10.41.1.205:33866. Ndmpcopy: toaster: Log: DUMP: creating "/vol/vm_store101/../snapshot_for_backup.3267" snapshot. Ndmpcopy: toaster: Log: DUMP: Using Full Volume Dump Ndmpcopy: toaster: Log: DUMP: Date of this level 0 dump: Thu Jul 31 11:07:51 2014. Ndmpcopy: toaster: Log: DUMP: Date of last level 0 dump: the epoch. Ndmpcopy: toaster: Log: DUMP: Dumping /vol/vm_store101 to NDMP connection Ndmpcopy: toaster: Log: DUMP: mapping (Pass I)[regular files] Ndmpcopy: toaster: Log: DUMP: mapping (Pass II)[directories] Ndmpcopy: toaster: Log: DUMP: estimated 2616811716 KB. Ndmpcopy: toaster: Log: DUMP: dumping (Pass III) [directories] Ndmpcopy: toaster: Log: DUMP: dumping (Pass IV) [regular files] Ndmpcopy: zs31: Notify: restore successful Ndmpcopy: toaster: Log: DUMP: Network communication error Ndmpcopy: toaster: Log: DUMP: DUMP IS ABORTED Ndmpcopy: toaster: Log: DUMP: Deleting "/vol/vm_store101/../snapshot_for_backup.3267" snapshot. Ndmpcopy: toaster: Log: DATA: Backup terminated: EVENT: I/O ERROR (for /vol/vm_store101) Ndmpcopy: toaster: Connection halted: HALT: Internal error! Ndmpcopy: Notify: Transfer failed For the seventh consecutive year, Independent Health was named one of the best companies to work for in New York State. The Buffalo News also named Independent Health one of the Top Workplaces in Western New York for 2014. Go to www.independenthealth.com to view careers and available positions. We are an Equal Opportunity Employer. CONFIDENTIALITY NOTICE: This e-mail and its attachments (collectively referred to as "e-mail") may contain confidential information that is privileged and protected from disclosure by Federal and State confidentiality laws, rules or regulations. This e-mail is intended for the designated addressee only. If you are not the designated addressee, you are notified that any disclosure, copying or distribution of this e-mail may be unlawful and may subject you to legal consequences. If you have received this e-mail in error, please contact me immediately by telephone at (716) 631 - 3001 and delete the e-mail from your computer immediately. Thank you for your attention.

4 3

Issues controller takeover/givebacks
by Andrew Laurence 29 Jul '14

29 Jul '14

Greetings all. Do you ever find issues with takeover/giveback events? We've had two relatively recently which resulted in service outages. Some months ago we had a service outage during an upgrade to 8.1.4p1 on our 3240 pair. During one of the givebacks, the controller came back without any networking. NetApp speculates the 10GE driver didn't initialize on when the controller rebooted. Either way, our storage service was AWOL as a result. And then Friday we had a real controller crash. This one occurred on an offsite HA pair of 2040s. Lately we have been chasing down a PCI error on one controller; NetApp eventually came out to replace that controller. After moving operations via 'cf takeover', it turned out that the new controller had very old SP firmware, older than is supported for the running 8.1.4.P1. The tech called an engineer for guidance, but just as the engineer came on WebEx the running controller panicked; all services were offline. (NetApp is still investigating this; we're uploading different files and working through the process.) While we can look at each of these and consider them anomalies for different reasons, it's still very worrisome that the core availability technology has twice resulted in service outages. Any thoughts? Thanks, Andrew -- Andrew Laurence Office of Information Technology atlauren(a)uci.edu University of California, Irvine

3 3

cDOT - Move Volume from vserver to another?
by Alexander Griesser 29 Jul '14

29 Jul '14

Hey there, is it possible to move a volume from one vserver to another one on the same node and by using the same aggregate? I can find plenty of possibilities to move a volume to a different physical node or aggregate, but not for what I want to do. node01 -> aggr01 -> vFiler01 -> Volume01 -> LUN01 node01 -> aggr01 -> vFiler02 -> Volume01 -> LUN01 so basically, I want to "dismount" Volume01 from "vFiler01" and mount it on "vFiler02" - is that possible at all? Best, Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at<http://www.anexia.at/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

4 7

Disk Shelf Firmware 173?
by Alexander Griesser 16 Jul '14

16 Jul '14

Good morning, latest Config Advisor 3.5 suggests that I need to update my disk shelf firmware on DS2246 and DS4246 shelves from 162 to 173 - but I'm unable to find this firmware on the support site. Is this an error in CA or can someone point me to the download location of this new shelf firmware? Best, Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at<http://www.anexia.at/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

2 1

PANIC: raid: there are no data or parity disks in SK process rc on release 8.2.1
by Sri Chan 16 Jul '14

16 Jul '14

I've cleared the config info and trying to boot into 7-mode. (Flash has 8.2.1 OS) After disk initialization (option 4), NetApp Controller will not boot and the process gets hung. If I try to power cycle and reboot, it says no data disk or parity disk. How do I fix it? Thanks

1 0

ndmpcopy error
by Jordan Slingerland 15 Jul '14

15 Jul '14

Any idea? ToasterA> ndmpcopy -l 1 /vol/share/.snapshot/hourly.0/folder vol/share/folder_restore Ndmpcopy: Starting copy [ 13 ] ... Ndmpcopy: ntap2: Notify: Connection established Ndmpcopy: ntap2: Notify: Connection established Ndmpcopy: No Level 0 entry found for this dump, forcing a level 0 dump Ndmpcopy: ntap2: Connect: Authentication successful Ndmpcopy: ntap2: Connect: Authentication successful Ndmpcopy: ntap2: Log: DATA: Backup terminated: backup configuration failure (2) on RPC error: ERROR: BAD ENV OP (for /vol/share/.snapshot/hourly.0/Folder) Ndmpcopy: ntap2: Connection halted: HALT: Internal error! Ndmpcopy: ntap2: Log: RESTORE: Read Socket received EOF. Ndmpcopy: Notify: Transfer failed Ndmpcopy: Done For the seventh consecutive year, Independent Health was named one of the best companies to work for in New York State. The Buffalo News also named Independent Health one of the Top Workplaces in Western New York for 2014. Go to www.independenthealth.com to view careers and available positions. We are an Equal Opportunity Employer. CONFIDENTIALITY NOTICE: This e-mail and its attachments (collectively referred to as "e-mail") may contain confidential information that is privileged and protected from disclosure by Federal and State confidentiality laws, rules or regulations. This e-mail is intended for the designated addressee only. If you are not the designated addressee, you are notified that any disclosure, copying or distribution of this e-mail may be unlawful and may subject you to legal consequences. If you have received this e-mail in error, please contact me immediately by telephone at (716) 631 - 3001 and delete the e-mail from your computer immediately. Thank you for your attention.

1 1

SSH Public Key Authentication in Clustered Data OnTap
by Alexander Griesser 15 Jul '14

15 Jul '14

Hey there, I've tried to set up SSH public key authentication on a new cluster pair (8.2.1P1) today and failed miserably - has anyone configured that as of yet? What I've done (and what seems to be the correct procedure) is: security login create -username admin -application ssh -authmethod publickey -role admin -vserver CLUSTERNAME security login publickey create -vserver CLUSTERNAME -username admin -index 0 -publickey "ssh-rsa AAAAB3....C8=" -comment ANEXIA The resulting configuration looks like that: ::> security login show -application ssh Vserver: CLUSTERNAME Authentication Acct UserName Application Method Role Name Locked ---------------- ----------- -------------- ---------------- ------ admin ssh password admin no admin ssh publickey admin - 2 entries were displayed. ::> security login publickey show Vserver: CLUSTERNAME UserName: admin Index: 0 Public Key: ssh-rsa AAAAB3....C8= Fingerprint: a7:08:e1:0d:22:ea:59:97:f9:3e:5c:1d:2a:84:ec:40 Bubblebabble fingerprint: xokel-...-soxex Comment: ANEXIA But when I try to login using username "admin" and my private key (which works on hundreds of other boxes and also on all of my 7-mode filers), the filer just seems to refuse my key and prompts me for the password. Also (maybe unrelated), when logging in via SSH, I do always get this warning message: Could not chdir to home directory /var/home/admin: No such file or directory Getting this on two Clustered Data Ontap systems so far, both running 8.2.1. Thanks, Alexander Griesser System-Administrator ANEXIA Internetdienstleistungs GmbH E-Mail: ag(a)anexia.at<mailto:ag@anexia.at> Web: http://www.anexia.at<http://www.anexia.at/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

4 7

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters