toasters

toasters@lists.teaparty.net

13531 discussions

I've created a slack chat for Netapp users
by Basil 29 Jul '15

29 Jul '15

This mailing list is awesome, and in the tradition of Netapp users helping each other out, I've created us a slack room, which is basically a chat room that you need an invite to view. https://netappusers.slack.com Please reply to this email if you want an invite.

3 2

Deleted Performance Manager
by Carl Howell 28 Jul '15

28 Jul '15

How can I remove a cluster from a deleted installation of Performance Manager so that I can add it to a new instance of Performance Manager? When I attempt to add the cluster to the new Performance Manager, it tells me that it has to be removed from the deleted installation first. Thanks, --Carl

8 9

unable to find master : Cdot : 8.3RC1
by Uddhav Regmi 26 Jul '15

26 Jul '15

Hello all, It just died all of a sudden. Automatic Recovery was off. Pls advise. Cannot access the cluster level , node level is fine. Sim::> event log show -severity emerGENCY Time Node Severity Event ------------------- ---------------- ------------- --------------------------- 7/26/2015 09:57:50 Sim-01 EMERGENCY callhome.root.vol.recovery.reqd: Call home for ROOT VOLUME NOT WORKING PROPERLY: RECOVERY REQUIRED. 7/26/2015 09:56:36 Sim-01 EMERGENCY rdb.recovery.failed: Error: Unable to find a master.. Unable to recover the local database of Data Replication Module: Management. 2 entries were displayed. Sim::> event log show -severity erroR Time Node Severity Event ------------------- ---------------- ------------- --------------------------- 7/26/2015 10:00:51 Sim-01 ERROR mgmtgwd.ntp.job.failure: The ntp_resolve_job could not be started. 7/26/2015 09:56:39 Sim-01 ERROR spm.mgwd.process.exit: Management Gateway (mgwd) subsystem with ID 12774 exited as a result of signal signal 6. The subsystem will attempt to restart. 7/26/2015 09:56:36 Sim-01 ERROR ucore.panicString: 'mgwd: assertion (false) at corrupt_rdb.cc:587 failed, raising SIGABRT(6) at RIP 0x82e1ed7bc (pid 12774, uid 0, timestamp 1437918996)' 7/26/2015 09:53:50 Sim-01 ERROR spm.mgwd.process.exit: Management Gateway (mgwd) subsystem with ID 12403 exited as a result of signal normal exit (1). The subsystem will attempt to restart. 7/26/2015 09:52:15 Sim-01 ERROR spm.vldb.process.exit: Volume Location Database(VLDB) subsystem with ID 4568 exited as a result of signal normal exit (1). The subsystem will attempt to restart. 7/26/2015 09:52:15 Sim-01 ERROR rdb.env.IOFailure: Error encountered in root volume I/O: Could not force changes to /mroot/etc/cluster_config/rdb/VLDB/_unit.config.bak. . 7/25/2015 19:29:45 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 7/25/2015 19:29:45 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/25/2015 19:29:45 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/25/2015 19:27:45 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 7/22/2015 18:34:29 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/22/2015 18:34:29 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/22/2015 18:32:11 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 7/21/2015 10:20:13 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/21/2015 09:16:17 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/21/2015 09:16:17 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/21/2015 09:14:53 Sim-01 ERROR mgmtgwd.configbr.backupFailed: The node configuration backup Sim-01.daily.2015-07-21.09_03_46.7z cannot be created. Error: 'Failed to create tarball for backup Sim-01.daily.2015-07-21.09_03_46.7z. Error: Failed to create package with name /mroot/etc/backups/config/Sim-01.daily.2015-07-21.09_03_46.7z'. 7/21/2015 09:14:51 Sim-01 ERROR mgmtgwd.configbr.backupFailed: The node configuration backup Sim-01.8hour.2015-07-21.09_03_46.7z cannot be created. Error: 'Failed to create tarball for backup Sim-01.8hour.2015-07-21.09_03_46.7z. Error: Failed to create package with name /mroot/etc/backups/config/Sim-01.8hour.2015-07-21.09_03_46.7z'. 7/21/2015 09:14:50 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 7/21/2015 09:14:37 Sim-01 ERROR mgmtgwd.mroot.full: The root volume of node 'Sim-01' is full. This prevents the node from operating properly. 7/21/2015 09:07:23 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 21 entries were displayed. Sim::>

3 4

Hot Shelf Removal - check for mailbox disks first before remove ownership
by Gelb, Scott 24 Jul '15

24 Jul '15

The hot shelf removal feature is great, but the documentation at https://library.netapp.com/ecmdocs/ECMP1367947/html/GUID-2B80FBD2-007D-4D19… is missing a check. An edge case if you had mroot on those disks prior, and then moved mroot to other disks/shelves for the hot removal. If the disks on the shelf or shelves have mailbox disks, right after you remove ownership from the disks (even though all zeroed spares), the node will crash. The ha-partner will not be able to takeover. Then the ha partner will also crash with an inconsistent mailbox. We had both nodes drop after removing ownership from a shelf that was being removed. It is an easy fix to get to maintenance mode and mailbox destroy local, but add that to your run book for hot shelf removal. We didn't have any data on the ha-pair for the maintenance (the great thing about cDOT which averted any outage even during this maintenance). We recovered after reassigning the disks and deleting the mailbox (had to do that twice) then both nodes came back up after coredump and mailbox was recreated and storage failover was able to enable again. ::> set adv ::*> stor failover mailbox-disk show One other note on the move mroot procedure https://kb.netapp.com/support/index?page=content&id=3013873&locale=en_US The article now lists to turn on nvfail (submitted that update a while ago), but some systems also had create_ucode enabled on vol0, so I check "vol options vol0" prior to move, then match the settings after the move in addition to nvfail. Also, if you have cdpd.enable on and ip.fastpath.enable off, both of those need to be reset since mroot move sets them back to cdpd off and fastpath on defaults (8.3P1).

3 2

Cluster evolution
by Milazzo Giacomo 22 Jul '15

22 Jul '15

Hi everybody, suppose that for technical (i.e. a 3240HA controller pair that does not fit with a 8060HA one in the same cluster) reason I've to start with two different 2 nodes cluster, each of the two managing its respective aggregates and node. So I can have now: CLUSTER1-01 and CLUSTER1-02 (3240HA) and CLUSTER2-01 and CLUSTER2-02 (8060HA) In the future customer could have budget to do a tech refresh on the first cluster changing the heads to an 8000 pairs. Well, what's about the merge of the CLUSTER1 nodes to the CLUSTER2 preserving all data in CLUSTER1 aggregates? So I mean that I would have in the end a 4 nodes cluster and not two separate 2 nodes ones. Is there some procedure? Regards.

6 15

FAS-2554 cDOT sanity check requested
by Roy McMorran 22 Jul '15

22 Jul '15

Hi all, We recently purchased a NetApp FAS-2554 and I'm getting what I feel is less than stellar performance. I have a case open with support. But I'm trying to 'calibrate my expectations' a bit, so I thought I'd send this out to the list. Any feedback would be appreciated. Here's a some info about the configuration cDOT, 8.3.1RC1 2-node switchless cluster 22 SATA drives (3TB) in two RAID-DP aggregates + 2 spares 22 10K SAS drives (900GB) in two RAID-DP aggregates + 2 spares No flash (yet?) 10Gb cluster interconnect 10Gb to server(s) with jumbo frames 2 vFilers - the one under test has a volume on the sas_data_1 aggregate which is serving NFS v3 (TCP) I'm currently testing with a Cisco UCS C220 M4S running CentOS 6.6 as the NFS client. We noticed that performance (on a database load) seemed poor, so I started some benchmark testing with "iozone". The test I'm looking at in particular is sequential writes with an 8K record size. The write throughput was 2MB/S! There are no other workloads on the filer or the server. NetApp suggested a workaround for the bug described here: http://mysupport.netapp.com/NOW/cgi-bin/bol?Type=Detail&Display=876563 and that actually improved things - my sequential write throughput test can now do 15MB/S. Definitely better, but that still seems slow to me. So with all that background here is my question - does anyone have a similar configuration out there, and what sort of write speeds are you seeing? I'm just looking for a sanity check. Is 15MB/S reasonable? Thanks! Roy McMorran

9 18

FEAR report
by Brad Thompson 22 Jul '15

22 Jul '15

Has anyone ever heard of a NetApp FEAR report? I've had several people ask me about running it, but I can't figure out what they are talking about. -Brad

4 8

Latency Counters - Perfmon versus Resource Monitor
by Philbert Rupkins 21 Jul '15

21 Jul '15

Hello Toasters, I have a situation in which Resource Monitor shows 100 - 400 ms disk Response Time (latency) for various processes in the Disk-Disk Activity tab. Resource Monitor doesnt break Response Time down into read/write/other so I hopped over to perfmon. I enabled the following perfmon metrics for the block device showing 100 - 400ms response time in Resource Monitor: Physical Disk: Avg. Disk Bytes/Read Avg. Disk Bytes/Write Avg. Disk Bytes/Transfer Physical Disk: Avg. Disk sec/Read Avg. Disk sec/Write Avg. Disk Sec/Transfer Those permon counters were chosen to have a look at block size and latency. Perfmon reported very large values for Avg. Disk Bytes/Read (up to 500,000) which may explain some of the higher Response Time numbers in Resource Monitor. HOWEVER, perfmon showed very low numbers for Avg. Disk sec/Read whereas Resource Monitor showed 100 - 400 ms. Does anybody know what might account for the difference in Response Times between perfmon and Resource Monitor? Specifically, the difference between Avg. Disk sec/Transfer (perfmon) and the Response Time column in Resource Monitor? Windows Server 2008, Exchange 2010, NetApp v3250 running 8.1.4P3 7-Mode. All LUNS presented via iSCSI. -Phil

1 0

Nondisruptively change language of a volume containing LUNs?
by Basil 20 Jul '15

20 Jul '15

Hi folks, One of my colleagues made a typo on the language for volumes that are used exclusively for LUNs. I know that you can't change the language of a volume, but is there a way to move the LUNs to a new volume with the correct language set? Thanks!

4 6

RE: SVM DR in 8.3.1 - AGAIN
by Borzenkov, Andrei 20 Jul '15

20 Jul '15

Original question was - is it possible to start DR SVM with identity-preserve without stopping SnapMirror. It looks like it is possible. Regarding “future snap mirror updates” - I mentioned that if I switch back from identity-preserve=false to identity-preserve=true changes made in the past (during identiry-preserve=false relationship) are replicated. They are even applied to a running DR SVM, and e.g. LIF gets configured while DR SVM is running. I do not promote or endorse it - as I said “I am not sure if it works as intended”. But I can see use cases for it. From: Moore, Doug [mailto:Doug.Moore@netapp.com] Sent: Sunday, July 19, 2015 7:44 AM To: Borzenkov, Andrei Cc: NGC-g.milazzo-sinergy.it; Parisi, Justin; Toasters Subject: Re: SVM DR in 8.3.1 - AGAIN What are you trying to accomplish? The setup you have below is clearly not a use case that we advise. Anything that is sent in the initial ID preserve that is not then sent in the id discard will not be replicated in future snap mirror updates. So why would you do it that way? Doug Moore Technical Marketing Engineer Clustered Data ONTAP/Multi-Tenancy NetApp 303.349.4851<tel:303.349.4851> Direct / Mobile doug.moore(a)netapp.com<mailto:doug.moore@netapp.com> www.netapp.com<http://www.netapp.com/> On Jul 18, 2015, at 13:36, Borzenkov, Andrei <andrei.borzenkov(a)ts.fujitsu.com<mailto:andrei.borzenkov@ts.fujitsu.com>> wrote: Not sure if it works as intended, but - first create snapmirror with identity-preserve true; then delete (without breaking) and create again with identity-preserve false. Now you have SVM that contains original configuration but can be started without breaking SnapMirror. To continue just resync. OTOH it is logical. In case of identity-preserve is false, network configuration of DR SVM is not changed at all and where it came from originally does not matter. If you delete snapmirror and recreate with identity preserve again, changes made in between on source are propagated to DR. Of course, it does not have ability to select arbitrary snapshot as starting point (and as most part of SVM configuration is not kept in volume, it would not help anyway). I do not know if RDB even has anything similar to snapshots that could be employed here. From: toasters-bounces(a)teaparty.net<mailto:toasters-bounces@teaparty.net> [mailto:toasters-bounces@teaparty.net] On Behalf Of Milazzo Giacomo Sent: Wednesday, July 08, 2015 9:06 PM To: Parisi, Justin; Toasters Cc: Moore, Doug Subject: R: SVM DR in 8.3.1 - AGAIN We’re still experiencing a lot of issues with customer where first few days ago we’ve attempted to set up this SVM DR. As reported it seems that it does the work that someone could expect as…basic way. But at this customer the world is a little bit more complicated (does it is the only one using that DR way with 7Mode? I don’t think so!) We need to understand how to proceed to set up this DR. Or we (better NetApp!) must officially communicate to customers that they can wast their –perfectly working for test and troubles- DR approach for it’s not possible in cDOT! Let me resume the issue. This customer, since years, doesn’t use the vFiler DR direct approach but, at the snapmirrored destination flexclone volumes are created and on this run vfiler with –d option that start from the root volume of the vfiler. I.e. (the green stands for running, the red for stopped/offlined/mirrored) ✓ ✓ X ✓ ✓ Production ----sm---> DR ---flexclone---> DR_clone –vfilercreate --> vfiler in dr This permit to have a point in time instance with all the initial configurations (share/exports/MSAD domain join, users, security ecc). This also let have the choice to choose the snapshot used as starting point and, overall, this let to maintain the source-destination replicas active and updated. All of those is automated using WFA, so it’s enough a click and everything go! We’ve seen that SVM DR more ore less work as vfiler dr worked. ✓ ✓ X Production ----sm---> DR < break of mirror relationship – a MUST > X X ✓ Produzione ----sm---> DR We’ve also seen with some trick and maintaining the production and test network separated in different IP spaces (and ports, switches, vlan…) that we can have both running the source and the destination, but we must also break the sm relationship! ✓ X ✓ Production ----sm---> DR These releationships unfortunately are essential prerequisites for this customer. Let me say vols (in SVMs) must continue to replicate for the DR test SVM could be up also for 10 and more days! And customer cannot permit the risk to loose its replicated/updated copies… The questions are: is there something like vfiler create –d? (documentation does not report anything else than “normal” usage) Something that let us create an SVM with all configurations inside but starting from cloned vols at destination snapmirrored site? We’re really in trouble for customer is starting to suspect that this cDot could be a boomerang and, except for VSAN and VVOL support for VMware 6, the things they’ve loosed are more than the one they’ve gained! Any help will be appreciated! Da: toasters-bounces(a)teaparty.net<mailto:toasters-bounces@teaparty.net> [mailto:toasters-bounces@teaparty.net] Per conto di Milazzo Giacomo Inviato: lunedì 6 luglio 2015 17:33 A: Parisi, Justin Cc: Toasters; Moore, Doug Oggetto: R: SVM DR in 8.3.1 We need identity true. a lot of cifs configuration are not brought if false. Think to vfiler Dr of 7mode... Bye - Sent by mobile - -------- Messaggio originale -------- Da: "Parisi, Justin" <Justin.Parisi(a)netapp.com<mailto:Justin.Parisi@netapp.com>> Data: 06/07/2015 17:24 (GMT+01:00) A: Milazzo Giacomo <G.Milazzo(a)sinergy.it<mailto:G.Milazzo@sinergy.it>> Cc: "Borzenkov, Andrei" <andrei.borzenkov(a)ts.fujitsu.com<mailto:andrei.borzenkov@ts.fujitsu.com>>, Toasters <toasters(a)teaparty.net<mailto:toasters@teaparty.net>>, "Moore, Doug" <Doug.Moore(a)netapp.com<mailto:Doug.Moore@netapp.com>> Oggetto: RE: SVM DR in 8.3.1 You can always run the destination in the “Identity discard” mode to avoid IP clashes. That should allow you to test. I’ve added the SVM DR TME to this thread so he can address your questions/be aware of the questions we have out there. From: Milazzo Giacomo [mailto:G.Milazzo@sinergy.it] Sent: Monday, July 06, 2015 11:10 AM To: Parisi, Justin Cc: Borzenkov, Andrei; Toasters Subject: R: SVM DR in 8.3.1 Again, interesting for it summarize the two official docs. We’ve just created a test and it seems to work: unfortunately up to now we don’t have yet the physical network correctly cabled to the right switch. We’re concerned about the statement “source SVM must be stopped” to run in DR…this because we’ve an isolated network environment and when we run DR test the source still continue to work…fortunately we’ve test the “force” option to the start SVM command… A doubt. We’ve noted that when the SVM DR has been created automatically has been created its LIF for data communication (our test contained a CIFS server with a shared vol). This LIF has been created using the VLAN that was assigned to the ipspace we’ve created to the test network, and the same IP of source has been assigned. That’s what we expect, and it’s good. But, what happen if I’ve a lot of source SVM, each with its subnet and broadcast domain that must converge in the same test ipspace? How the lifs and their IP addresses are choosen? Regards, Da: Parisi, Justin [mailto:Justin.Parisi@netapp.com] Inviato: lunedì 6 luglio 2015 16:08 A: Borzenkov, Andrei; Milazzo Giacomo; Toasters Oggetto: RE: SVM DR in 8.3.1 I wrote a blog on SVM DR, if you are interested: https://whyistheinternetbroken.wordpress.com/2015/06/25/techstorage-virtual… From: toasters-bounces(a)teaparty.net<mailto:toasters-bounces@teaparty.net> [mailto:toasters-bounces@teaparty.net] On Behalf Of Borzenkov, Andrei Sent: Wednesday, July 01, 2015 10:05 AM To: NGC-g.milazzo-sinergy.it<http://NGC-g.milazzo-sinergy.it>; Toasters Subject: RE: SVM DR in 8.3.1 You are right, you need to create destination SVM in advance with right attributes. According to documentation “For remote data access or data distribution, you can provide read-only access to the NFS clients and SAN hosts from the destination SVM, if you chose to set the identity-preserve option to false.”. Also “SVM Disaster Recovery Preparation Express Guide” gives examples that indicate that you can (actually, must) configure network on destination SVM and access it. From: toasters-bounces(a)teaparty.net<mailto:toasters-bounces@teaparty.net> [mailto:toasters-bounces@teaparty.net] On Behalf Of Milazzo Giacomo Sent: Wednesday, July 01, 2015 4:33 PM To: Toasters Subject: SVM DR in 8.3.1 Hi all, I know is still RC1 but prior to upgrade a running 8.3 I would try to have more info on a new 8.3.1 feature: the SVM DR. I’ve a customer that on 7Mode ran the DR of CIFS vfiler (joined to a domain) using snapmirror of the vfiler vols, including the root one, and at the DR test/run the source vfiler was stopped and a vfiler create –d command, with the mirrored root specified, let the destination vfiler start with all domain infos, shares on the vole and ip addresses on the DR site with minimal effort. I’ve read the docs that come with 8.3.1 but is not clear. I don’t think that there’s something in SVM DR that permit to recreate the SVM on the destinanation: this must exist in advance, in stopped mode, right? What’s about the maintenance of the IPs? Should I have two identical subnets in both clusters? What if I cannot have two different subnets? Do I have a way to let the replicated SVM being in standby with the data lif with preregistered IPs? Regards

2 2

R: SVM DR in 8.3.1 - AGAIN
by Milazzo Giacomo 18 Jul '15

18 Jul '15

We’re still experiencing a lot of issues with customer where first few days ago we’ve attempted to set up this SVM DR. As reported it seems that it does the work that someone could expect as…basic way. But at this customer the world is a little bit more complicated (does it is the only one using that DR way with 7Mode? I don’t think so!) We need to understand how to proceed to set up this DR. Or we (better NetApp!) must officially communicate to customers that they can wast their –perfectly working for test and troubles- DR approach for it’s not possible in cDOT! Let me resume the issue. This customer, since years, doesn’t use the vFiler DR direct approach but, at the snapmirrored destination flexclone volumes are created and on this run vfiler with –d option that start from the root volume of the vfiler. I.e. (the green stands for running, the red for stopped/offlined/mirrored) ✓ ✓ X ✓ ✓ Production ----sm---> DR ---flexclone---> DR_clone –vfilercreate --> vfiler in dr This permit to have a point in time instance with all the initial configurations (share/exports/MSAD domain join, users, security ecc). This also let have the choice to choose the snapshot used as starting point and, overall, this let to maintain the source-destination replicas active and updated. All of those is automated using WFA, so it’s enough a click and everything go! We’ve seen that SVM DR more ore less work as vfiler dr worked. ✓ ✓ X Production ----sm---> DR < break of mirror relationship – a MUST > X X ✓ Produzione ----sm---> DR We’ve also seen with some trick and maintaining the production and test network separated in different IP spaces (and ports, switches, vlan…) that we can have both running the source and the destination, but we must also break the sm relationship! ✓ X ✓ Production ----sm---> DR These releationships unfortunately are essential prerequisites for this customer. Let me say vols (in SVMs) must continue to replicate for the DR test SVM could be up also for 10 and more days! And customer cannot permit the risk to loose its replicated/updated copies… The questions are: is there something like vfiler create –d? (documentation does not report anything else than “normal” usage) Something that let us create an SVM with all configurations inside but starting from cloned vols at destination snapmirrored site? We’re really in trouble for customer is starting to suspect that this cDot could be a boomerang and, except for VSAN and VVOL support for VMware 6, the things they’ve loosed are more than the one they’ve gained! Any help will be appreciated! Da: toasters-bounces(a)teaparty.net [mailto:toasters-bounces@teaparty.net] Per conto di Milazzo Giacomo Inviato: lunedì 6 luglio 2015 17:33 A: Parisi, Justin Cc: Toasters; Moore, Doug Oggetto: R: SVM DR in 8.3.1 We need identity true. a lot of cifs configuration are not brought if false. Think to vfiler Dr of 7mode... Bye - Sent by mobile - -------- Messaggio originale -------- Da: "Parisi, Justin" <Justin.Parisi(a)netapp.com<mailto:Justin.Parisi@netapp.com>> Data: 06/07/2015 17:24 (GMT+01:00) A: Milazzo Giacomo <G.Milazzo(a)sinergy.it<mailto:G.Milazzo@sinergy.it>> Cc: "Borzenkov, Andrei" <andrei.borzenkov(a)ts.fujitsu.com<mailto:andrei.borzenkov@ts.fujitsu.com>>, Toasters <toasters(a)teaparty.net<mailto:toasters@teaparty.net>>, "Moore, Doug" <Doug.Moore(a)netapp.com<mailto:Doug.Moore@netapp.com>> Oggetto: RE: SVM DR in 8.3.1 You can always run the destination in the “Identity discard” mode to avoid IP clashes. That should allow you to test. I’ve added the SVM DR TME to this thread so he can address your questions/be aware of the questions we have out there. From: Milazzo Giacomo [mailto:G.Milazzo@sinergy.it] Sent: Monday, July 06, 2015 11:10 AM To: Parisi, Justin Cc: Borzenkov, Andrei; Toasters Subject: R: SVM DR in 8.3.1 Again, interesting for it summarize the two official docs. We’ve just created a test and it seems to work: unfortunately up to now we don’t have yet the physical network correctly cabled to the right switch. We’re concerned about the statement “source SVM must be stopped” to run in DR…this because we’ve an isolated network environment and when we run DR test the source still continue to work…fortunately we’ve test the “force” option to the start SVM command… A doubt. We’ve noted that when the SVM DR has been created automatically has been created its LIF for data communication (our test contained a CIFS server with a shared vol). This LIF has been created using the VLAN that was assigned to the ipspace we’ve created to the test network, and the same IP of source has been assigned. That’s what we expect, and it’s good. But, what happen if I’ve a lot of source SVM, each with its subnet and broadcast domain that must converge in the same test ipspace? How the lifs and their IP addresses are choosen? Regards, Da: Parisi, Justin [mailto:Justin.Parisi@netapp.com] Inviato: lunedì 6 luglio 2015 16:08 A: Borzenkov, Andrei; Milazzo Giacomo; Toasters Oggetto: RE: SVM DR in 8.3.1 I wrote a blog on SVM DR, if you are interested: https://whyistheinternetbroken.wordpress.com/2015/06/25/techstorage-virtual… From: toasters-bounces(a)teaparty.net<mailto:toasters-bounces@teaparty.net> [mailto:toasters-bounces@teaparty.net] On Behalf Of Borzenkov, Andrei Sent: Wednesday, July 01, 2015 10:05 AM To: NGC-g.milazzo-sinergy.it; Toasters Subject: RE: SVM DR in 8.3.1 You are right, you need to create destination SVM in advance with right attributes. According to documentation “For remote data access or data distribution, you can provide read-only access to the NFS clients and SAN hosts from the destination SVM, if you chose to set the identity-preserve option to false.”. Also “SVM Disaster Recovery Preparation Express Guide” gives examples that indicate that you can (actually, must) configure network on destination SVM and access it. From: toasters-bounces(a)teaparty.net<mailto:toasters-bounces@teaparty.net> [mailto:toasters-bounces@teaparty.net] On Behalf Of Milazzo Giacomo Sent: Wednesday, July 01, 2015 4:33 PM To: Toasters Subject: SVM DR in 8.3.1 Hi all, I know is still RC1 but prior to upgrade a running 8.3 I would try to have more info on a new 8.3.1 feature: the SVM DR. I’ve a customer that on 7Mode ran the DR of CIFS vfiler (joined to a domain) using snapmirror of the vfiler vols, including the root one, and at the DR test/run the source vfiler was stopped and a vfiler create –d command, with the mirrored root specified, let the destination vfiler start with all domain infos, shares on the vole and ip addresses on the DR site with minimal effort. I’ve read the docs that come with 8.3.1 but is not clear. I don’t think that there’s something in SVM DR that permit to recreate the SVM on the destinanation: this must exist in advance, in stopped mode, right? What’s about the maintenance of the IPs? Should I have two identical subnets in both clusters? What if I cannot have two different subnets? Do I have a way to let the replicated SVM being in standby with the data lif with preregistered IPs? Regards

2 1

cDOT and NFS Volumes for VMDK datastores
by John Stoffel 17 Jul '15

17 Jul '15

Guys, I'm starting to re-read TR-3749 again, but since I'm running cDOT 8.2p# on my main two node cluster (soon to be four nodes) I wanted your opinions on how to provision NFS datastores. Right now, when we add new DataStores, we have to goto all 16 ESX hosts in the cluster and manually mount them. Which is doable, but maybe not scalable over time as we'd like to isolate groups and apps into their own NFS volumes if possible. So, knowing that cDOT allows me to setup a volume and then use junction mounts to add more volumes to that name space, does it make sense to do: 1. Create base volume, let's call it '/datastore1' 2. Create sub-volumes of various sizes and performance levels and mount them to: /datastore1/bob /datastore1/jim /datastore1/sam .... 3. When we spin up VMs and asign the data stores, you only need to drill down into the correct area, bob, jim or sam and put the data there. 4. I want to add new FlashPool volume, so I create it and junction mount it to /datastore1/fp1 5. I don't have to add any mounts to the ESX hosts, they just see more growth in the /datastore1/ mount point and keep working. So is this a dumb idea? Or not a supported idea? I know it limits my through put to just a single IP address for traffic, unless I spread out the load by having multiple /datastore#/ volumes spread across the nodes of the cluster, and various volumes junction mounted to each of these master /datastore#/ volumes. Right now we just create new volumes and mount them, but I looking for a more scalable, manageable method. THanks, John

6 8

"Created Date" on CIFS shares
by Edward Rolison 15 Jul '15

15 Jul '15

I've got a scripting task that needs me to work off the creation time of a file. I've been caught out before by 'ctime' being change time, rather than 'create time'. So I thought I was just stuck - however, I've noticed that the Windows 'file creation time' attribute .... actually looks correct. Which has me confused, because I can't see this value from 'Unix side' seemingly at all. I can't tell how Windows knows what the right value is. Is anyone able to enlighten me? Where's creation time stored, and is there a way to access it from Unix?

3 2

rename a CIFS SVM in AD?
by Rue, Randy 14 Jul '15

14 Jul '15

Hello All, I want to migrate the contents of a small file server to an 8.3 SVM and end up with the SVM having the same name in DNS, NetBIOS and the AD. If this were a 7-mode vFiler I could re-run "cifs setup" and change the name to the existing name (after I'd powered down the old file server). Can I do this in 8.3? While I can see commands for renaming an SVM that only appears to rename the SVM itself, not to do anything to the AD. I can see how to add and remove netbios aliases (WINS entries) but again, nothing to do with the AD. Do I have to remove and re-add the CIFS server? And lose all the CIFS shares? Or is there a way to rename the puppy? Randy in Seattle

6 11

Migration question: 7-mode, volumes and qtrees ...
by Waflherder 14 Jul '15

14 Jul '15

Hi All, I have what seems like a pretty basic migration question ... I'm working with a customer who is planning a migration, they are doing a hardware refresh of a pair of FAS2040 systems with ONTAP 8.0.x to a new FAS2552 HA pair with ONTAP 8.2.3P2 (still 7-mode). Amongst other things they have a single large volume / CIFS Share with user home directories. In the past they have had issues with getting the access permissions and quotas for the individual users on this share to work they way would like. It sounds to me like an idea situation to use qtrees, per user, on the new systems. However, what then is the best way to migrate the user data/content? If the target location on the new Filer should consist of numerous per user qtrees, it seems I cannot use "simply" bulk copy with SnapMirror, since the qtrees do not exist on the source. I don't know of a way to convert a directory to be a qtree after it is created ... So perhaps it is necessary to manually (well, with a script) create the individual qtrees and then copy the user data to each new qtree. However then it seems to me that the data will have to be copied from the client side, per user directory i.e. using something like robocopy on Windows or whatever the best UNIX equivalent would be. This all seems a bit more complicated that I had hoped :) Maybe I am missing something - any suggestions? After creating and populating a user qtree, is there some mechanism they could use to redirect access for that specific dataset from the old location to the new qtree? Thanks in advance! Yours, Robb.

1 0

fcp paths in multi-node cluster
by Kevin Richards 14 Jul '15

14 Jul '15

Hi, I have read that an initiator should not be zoned to more than 4 target ports. We have a 8.2 cdot cluster with 12 nodes each having two fcp lifs. So there are potentially 12 paths to storage per fabric. Just curious what strategy has been used to limit the paths? Zoning, port sets, etc.? And any recommendations. Thank you. Kevin

4 4

8.3, NDMP and CommVault
by Rue, Randy 08 Jul '15

08 Jul '15

Hello All, Forgive me asking what are essentially newbie questions but as we're setting up our first 8.3 clusters I pretty much am new. We have a primary cluster, will replicate to a secondary DR cluster in another data center, and want monthly tape backups from the secondary cluster. We have a pretty beefy CommVault setup for our 7-mode NetApp gear and will use the existing infrastructure. First question: we're clear that we do not want "node scoped" backups, but instead want "SVM scoped" backups. But it's not clear from the documents I've found whether we can back up SVM volumes from the cluster level (like we did in 7-mode) or if we need to configure NDMP services, users, and backups for every SVM. >From the NetApp NDMP Express Guide: "If the DMA supports the Cluster Aware Backup (CAB) extension, you can back up all the volumes hosted across different nodes in a cluster by enabling SVM-scoped NDMP, configuring a backup user account, and configuring LIFs for data and control connection." Am I just wanting to believe this supports my wish for cluster-wide backup configuration? Can we configure the cluster and reach all SVM volumes, or do we need to configure for every SVM? Is anyone out there using CommVault and NDMP to back up 8.3 at a cluster level? Or at all? Randy

2 3

NVRAM6 Card Installed in the Wrong Slot
by Stephen Stocke 08 Jul '15

08 Jul '15

Hello Toasters We have an old 3040 running as a single controller in a lab. The head had previously been part of an HA pair and the NVRAM6 card was therefore installed in slot 3 (correct for HA systems). For a single controller the card is supposed to be in slot 1. I'm curious to know what the controller is doing with the NVRAM card? Is it using it at all or just writing everything through straight to disk? Could this cause slower than expected performance? Thanks, Steve __ Background Info __ A colleague recently asked advice on some poor performance with this system in his VMware lab and the first thing that jumps out is the log messages complaining about the card being in the wrong slot. This misconfiguration will be corrected shortly. The system is running 8.1.4 7-mode if that make a difference. The controller has 2 loops of DS14MK4 shelves (168 15K FC drives) and is serving handful iSCSI LUNs to a small vSphere cluster (2 ESXi servers). While looking at stats in OCSM 3.2, I observed >100ms iSCSI write latency with a load of ~300 IOPS and very low CPU utilisation (<20%). -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal -------------------------------------------------------------------------------- disclaimer This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any). Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes. The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF

5 8

Another SSD question
by Basil 07 Jul '15

07 Jul '15

So I'm looking at upgrading a few 8020s and trying to choose between flashpool and flashcache. Flashpool is more expensive, even with just 12x200 SSD drives, and we'd need to find space in a very tight rack for it. The workload is 80% exchange and 20% VMWare, and we would like to use deduplication without snapshots. Is it possible to use PCS to compare flashcache and flashpool benefits? How can I translate the data I see from a stats show -p flexscale-access into real numbers, like reduction of latency?

5 6

formatting output from 8.3 CLI statistics commands?
by Rue, Randy 07 Jul '15

07 Jul '15

I'm trying to call the "statistics volume show" command and parse it for the latency numbers for each volume. The CDOT command is trying to do some clever line wrapping so that lines with long fields break to the next line. I could just take the last field of each line but once in a while even that won't work, in some cases the bytes read is the last field of the line and the latency is the first (and last) field of the line following. Gah. Doesn't appear to be any sort of "-csv" flag for the command, or any real formatting options at all. Even tried noodling with the terminal settings used by the SSH call , thinking the line wrap might have to do with that. Can't reliably make the output behave. Anybody else faced this? Any guidance? Randy in Seattle

3 3

RE: FAS2xxx Upgrade - Flash Cache Performance Estimation?
by Stephen Stocke 07 Jul '15

07 Jul '15

Hi Toasters Sorry it's taken so long to get reply back... I've been distracted with other "fires" for the last week. A big thank you to Michael, Andrei and Tony for your responses. Toasters is a great resource because people like you are willing to share your experience and expertise. Cheers. To close this out and for the benefit of others, here's where I've landed based on your feedback: __ FlashCache vs FlashPool __ I've had some pricing back from Netapp and, as Michael said, there's no cost savings in choosing FlashCache over FlashPool for the configuration we are interested in. On that basis we'll stick with FlashPool as it's tried and tested on our busiest aggregate. It sounds like FlashPool is the future anyway so this is an easy decision. __ Flash[XXXX] Sizing __ Our oldest system, the FAS2020, doesn't support anything beyond DOT 7.3.7 so AWA is out (need 8.2 or higher) and PCS isn't supported on the platform. We just don't have any good tools available to measure the expected benefits of flash acceleration for this small system's workload. Given that the current SATA-only aggregates are performing adequately, we know the new SAS+SSD aggregates will blow our hair back. We'll buy as many of the largest SSDs our budget will support knowing that we'll get a big benefit, if not the optimum one. We also know we'll have the tool we need for sizing at the next hardware refresh (AWA). Thanks again, Steve ________________________________________ From: Michael Bergman Sent: 30 June 2015 18:21 To: Stephen Stocke Subject: Re: FAS2xxx Upgrade - Flash Cache Performance Estimation? Stephen Stocke wrote: > When planning an upgrade for a FAS2000 series filer, how do you size the > required FlashCache or FlashPool storage for the workload without having PCS > or AWA available? I read up on AWA just now. I cannot find anything in the FlashPool Tech FAQ (May 2014) that points to 'wafl awa' not being available in FAS2000 boxes. From 8.2.1 and up, in both 7-mode and c-mode. It doesn't consume much resources from the system at all: AWA uses 2% or less CPU, regardless of the number of aggregates that are simultaneously under analysis, and it uses less than 0.2% of system memory per aggregate. Even in a smaller FAS2000 model, this should be ok IMO. As I mentioned before, you really want 8.3.1 with HyA (FlashPool) on your new 8020 :-) Among other things, this limitation is changed, perhaps even removed: "Only random writes, or more precisely overwrites, that are 16KB or smaller are candidates to be cached by Flash Pool." As far as I'm aware there's also some new tuning (policy) which is the equiv of this for FlashPool: flexscale.lopri_blocks on (same value in local+partner recommended) It caches large(r) sequential reads. As it is with HyA in 8.3 it cannot be made to do that, so all seq READ comes from spinning disk. This can clearly be seen e.g. when baselining a backup with lots of SnapVault jobs running in parallel. /M -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal -------------------------------------------------------------------------------- disclaimer This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any). Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes. The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF

2 1

alerting for faulty disks
by Caroline Yates 06 Jul '15

06 Jul '15

Hi, Last week I happened to notice a disk which was "disabled due to excessive phy changes". I contacted Netapp support and they promptly sent a replacement. Of course I asked why this didn't show up in the failed disk count and they replied that it was "faulty not failed" (although the message in the logs say "Call home for DISK_FAIL - Disabled by IOM"). Anyway, my concern of course is to catch these faulty disks. My preference for monitoring is Nagios and snmp but having snmpwalk-ed through the current mib (ontap 8.1.1) I don't see an oid that would capture this faulty disk status - unless this is considered "prefailed"? But I am more concerned with catching this problem than I am wedded to Nagios, so any advice would be appreciated. Thanks! Caroline ______________________________________________________________________ Caroline Yates, Unix Systems Contractor, CYates(a)slb.com<mailto:CYates@slb.com> Schlumberger, High Cross, Madingley Road, Cambridge, CB3 0EL Tel: +44 (0)1223 325276 Mob: +44 (0)7753 353889 ______________________________________________________________________ Registered Name: Schlumberger Cambridge Research Limited Registered Office: Schlumberger House, Buckingham Gate, Gatwick Airport, West Sussex. RH6 0NZ, United Kingdom Registered in England and Wales No. 00606177 Note: The Gatwick airport address is NOT the street address of the Cambridge site., this is postcode CB3 0EL

1 0

SVM DR in 8.3.1
by Milazzo Giacomo 06 Jul '15

06 Jul '15

Hi all, I know is still RC1 but prior to upgrade a running 8.3 I would try to have more info on a new 8.3.1 feature: the SVM DR. I've a customer that on 7Mode ran the DR of CIFS vfiler (joined to a domain) using snapmirror of the vfiler vols, including the root one, and at the DR test/run the source vfiler was stopped and a vfiler create -d command, with the mirrored root specified, let the destination vfiler start with all domain infos, shares on the vole and ip addresses on the DR site with minimal effort. I've read the docs that come with 8.3.1 but is not clear. I don't think that there's something in SVM DR that permit to recreate the SVM on the destinanation: this must exist in advance, in stopped mode, right? What's about the maintenance of the IPs? Should I have two identical subnets in both clusters? What if I cannot have two different subnets? Do I have a way to let the replicated SVM being in standby with the data lif with preregistered IPs? Regards

4 7

cDOT and Oracle
by Milazzo Giacomo 06 Jul '15

06 Jul '15

Hi everybody, one million dollar questions ;-) aka transition to cDot could be really a nightmare! The questions come not only from best practice and TR I've read (or I could read...) but your ideas about best ways to bring in cDot what now is deeply optimized in 7Mode. AS is - 7 Mode A lot of NFS volumes where to separate data/log/temp of each Oracle instance. Each volume is exported for access only to the hosts that manage binaries and db. In the production environment all instances are RAC while in development test most of them are RAC but some are also composed just by one server. 90% of hosts are VMware VM, some are phyical for RAC instances composed by a phys-virtual pair of hosts. Volumes are hosted on aggregates composed by SAS or FC discs depending on type and importance of workload. In test/dev there are mostly SATA vols but non only. Of course, all the instances are managed and replicated with the concurrent usage of Snapcreator and its integration with DFM Protection Manager that it's then integrated with Snapmirror To be - cDOT (8.3.1) <- we hope to be able to use SVM DR features somewhere... Each instance in a its own SVM? This could be a nightmare to manage ipspaces, dedicated lifs, flexvol that once assigned are locked to that SVM and so on.... Just one SVM for all NFS RAC? Maybe creating differente FlexVols with qtree for data/log/temp? Or on different aggregates? One or more SVM, few, just to balance the workloads between controllers? Is there an advantage offered by the juction paths that should be created? Every idea is accepted also is recently has been demonstrated that brainstorming is useless :) Regards, Dott. Giacomo Milazzo Senior Consultant & Technical Account Manager mobile: +39 340.6001045 @-mail: g.milazzo(a)sinergy.it<mailto:g.milazzo@sinergy.it> Web: http://www.sinergy.it<http://www.sinergy.it/> [cid:4DB1B876-8A76-4829-9B40-9B136E344F73@fastwebnet.it] SINERGY SpA Viale dei Santi Pietro e Paolo 50 00144 - Roma RM Tel. +39 06 44243674 Fax +39 06 44245272

2 2

NFS & TR4067
by Mark Flint 06 Jul '15

06 Jul '15

Think this may be a version specific issue, but I’m trying to get client stats out of an 8.2P6 CDOT system, preferably sorted so that I can see the top few clients. I’ve found the above TR by Justin (thanks :) ) but one of the useful commands seems not to work. I’m using “statistics settings modify -client-stats enabled” and it returns a not found, only reference is that the statistics setting modify command can only change the counter display rate :( Must be a way to do this, or do I have to try and write something? Got a bit of help from Douglas’ comments here yesterday, but still struggling…. ~Mark mark.flint(a)sanger.ac.uk

3 5

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters