toasters

toasters@lists.teaparty.net

1 participants
13532 discussions

I've created a slack chat for Netapp users
by Woods, Bill 29 Jul '15

29 Jul '15

I would like access as well. Regards, Bill -----Original Message----- From: toasters-bounces(a)teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of toasters-request(a)teaparty.net Sent: Wednesday, July 29, 2015 5:49 AM To: toasters(a)teaparty.net Subject: Toasters Digest, Vol 48, Issue 70 Send Toasters mailing list submissions to toasters(a)teaparty.net To subscribe or unsubscribe via the World Wide Web, visit http://www.teaparty.net/mailman/listinfo/toasters or, via email, send a message with subject or body 'help' to toasters-request(a)teaparty.net You can reach the person managing the list at toasters-owner(a)teaparty.net When replying, please edit your Subject line so it is more specific than "Re: Contents of Toasters digest..." Today's Topics: 1. Re: Deleted Performance Manager (Bachman, Philip) 2. Re: Deleted Performance Manager (John Stoffel) 3. Re: Deleted Performance Manager (John Stoffel) 4. fsecurity job monitoring. (Jeff Cleverley) 5. I've created a slack chat for Netapp users (Basil) 6. Re: I've created a slack chat for Netapp users (Tony Bar) 7. Re: I've created a slack chat for Netapp users (Ed Morgan) ---------------------------------------------------------------------- Message: 1 Date: Mon, 27 Jul 2015 14:39:41 +0000 From: "Bachman, Philip" <Philip.Bachman(a)netapp.com> To: John Stoffel <john(a)stoffel.org> Cc: "toasters(a)teaparty.net" <toasters(a)teaparty.net> Subject: Re: Deleted Performance Manager Message-ID: <C90B474F-1E25-4677-91E9-07F4C2665692(a)netapp.com> Content-Type: text/plain; charset="us-ascii" John, Sounds like you are still running 1.1 or 1.0. Upgrade to 2.0RC1, currently posted on the NetApp support site and you will find the drill up/drill down you are looking for. -Phil Philip Bachman Consulting Systems Engineer Storage Management Solutions NetApp (908) 420-7800 philip.bachman(a)netapp.com Sent from my iPhone > On Jul 27, 2015, at 8:15 AM, John Stoffel <john(a)stoffel.org> wrote: > > > So has anyone actually found a good use for performance manager? I'm > running the latest version against a fairly busy but unbalanced two > node cluster and I keep getting frustrated that I can't drill down or > move up to get a better overview of things. > > I *know* I've got some performance and space issues, but I'd like to > be able to see the overall system state and then drill down into > things so I understand them better before I make changes or try to fix > stuff. > > Maybe I'm just not using it right, wouldn't be the first time... > > John > _______________________________________________ > Toasters mailing list > Toasters(a)teaparty.net > http://www.teaparty.net/mailman/listinfo/toasters ------------------------------ Message: 2 Date: Mon, 27 Jul 2015 14:14:17 -0400 From: "John Stoffel" <john(a)stoffel.org> To: Matthew Kleifgen <matthew.kleifgen(a)rackspace.com> Cc: "toasters(a)teaparty.net" <toasters(a)teaparty.net> Subject: Re: Deleted Performance Manager Message-ID: <21942.29945.566566.676308(a)quad.stoffel.home> Content-Type: text/plain; charset=utf-8 Matthew> If you missed it, there was a release on Friday of 2.0RC1. I Matthew> upgraded the 1.1 vsphere version I was using, and I?m very Matthew> impressed with the new version. Instead of having to search Matthew> for only a few object types, the new version has drill down Matthew> from the cluster level and data on lifs, ports, nodes, etc. Matthew> The upgrade was basically painless, also. Totally missed it... now I'll be doing an upgrade on this as well to see how it is improved. It can't get much worse in my book... John ------------------------------ Message: 3 Date: Mon, 27 Jul 2015 22:12:53 -0400 From: "John Stoffel" <john(a)stoffel.org> To: "Waltham\, Christopher" <Christopher.Waltham(a)netapp.com> Cc: "toasters(a)teaparty.net" <toasters(a)teaparty.net> Subject: Re: Deleted Performance Manager Message-ID: <21942.58661.533816.429159(a)quad.stoffel.home> Content-Type: text/plain; charset=utf-8 I've done the upgrade to v2.0RC1 and it's *much* more useful. The upgrade was easy, esp since I only had a week or so's worth of data to convert and upgrade. Still not ideal... I semi wish there was more of a 'top' command. I have used 'qos statistics workload performance show' but it has a bug where you can't see the volume names because they're truncated, which makes it difficult to use. And it doesn't pay attention to the width of the terminal... And you can refresh the display nicely too. But I can't figure out how to widen some of the columns without doing something like: set -showseperator " : " but that still doesn't work properly, the various fields are truncated in 8.2.3P2, though it's also useful to look at statistics show-periodic but it's still not quite there in my mind. Christopher> If you're still on OPM 1.0, upgrading to 1.1 and then to Christopher> 2.0 RC is a little easier than going to 2.0 directly. Christopher> From: <toasters-bounces(a)teaparty.net> on behalf of Matthew Christopher> Kleifgen < matthew.kleifgen(a)rackspace.com> Christopher> Date: Monday, July 27, 2015 at 8:54 AM Christopher> To: Basil <basilberntsen(a)gmail.com>, John Stoffel Christopher> <john(a)stoffel.org> Christopher> Cc: "toasters(a)teaparty.net" <toasters(a)teaparty.net> Christopher> Subject: Re: Deleted Performance Manager Christopher> If you missed it, there was a release on Friday of 2.0RC1. I upgraded the 1.1 vsphere version Christopher> I was using, and I?m very impressed with the new version. Instead of having to search for Christopher> only a few object types, the new version has drill down from the cluster level and data on Christopher> lifs, ports, nodes, etc. The upgrade was basically painless, also. Christopher> -- Christopher> Matt Kleifgen Christopher> From: <toasters-bounces(a)teaparty.net> on behalf of Basil <basilberntsen(a)gmail.com> Christopher> Date: Monday, July 27, 2015 at 7:35 AM Christopher> To: John Stoffel <john(a)stoffel.org> Christopher> Cc: "toasters(a)teaparty.net" <toasters(a)teaparty.net> Christopher> Subject: Re: Deleted Performance Manager Christopher> No, it's barely functional. It's got a lot of promise, but lacks some very basic features I'd Christopher> have expected in 1.0. Storage performance management is the achilles heel of most storage Christopher> vendors, and this is no exception. I hope Netapp will put together some sort of focus group to Christopher> guide the next few iterations. It really does have promise- of all the useless performance Christopher> applications I've used, this one does the coolest useless tricks... like their algorithm for Christopher> determining bully volumes and telling you which layer the problem is at. Christopher> On Mon, Jul 27, 2015 at 8:14 AM, John Stoffel <john(a)stoffel.org> wrote: Christopher> So has anyone actually found a good use for performance manager? I'm Christopher> running the latest version against a fairly busy but unbalanced two Christopher> node cluster and I keep getting frustrated that I can't drill down or Christopher> move up to get a better overview of things. Christopher> I *know* I've got some performance and space issues, but I'd like to Christopher> be able to see the overall system state and then drill down into Christopher> things so I understand them better before I make changes or try to fix Christopher> stuff. Christopher> Maybe I'm just not using it right, wouldn't be the first time... Christopher> John Christopher> _______________________________________________ Christopher> Toasters mailing list Christopher> Toasters(a)teaparty.net Christopher> http://www.teaparty.net/mailman/listinfo/toasters ------------------------------ Message: 4 Date: Tue, 28 Jul 2015 17:00:47 -0600 From: Jeff Cleverley <jeff.cleverley(a)avagotech.com> To: "<Toasters(a)teaparty.net>" <Toasters(a)teaparty.net> Subject: fsecurity job monitoring. Message-ID: <CAANBop2m_QLh=pTHZ+Ctgrg8OJWgmgFLFw_q_7rfFwAQEB0-Xw(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" Greetings, We have a filer running 7.3.7P1 and we had to run fsecurity to correct permissions/ownership of a tree. Is there any way to see anything to check the progress, see what path it is updating, etc? We have no idea how long this job will take and it would be nice if there was something showing what it was doing. Thanks, Jeff -- Jeff Cleverley IT Engineer 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611

1 0

I've created a slack chat for Netapp users
by Basil 29 Jul '15

29 Jul '15

This mailing list is awesome, and in the tradition of Netapp users helping each other out, I've created us a slack room, which is basically a chat room that you need an invite to view. https://netappusers.slack.com Please reply to this email if you want an invite.

3 2

Deleted Performance Manager
by Carl Howell 28 Jul '15

28 Jul '15

How can I remove a cluster from a deleted installation of Performance Manager so that I can add it to a new instance of Performance Manager? When I attempt to add the cluster to the new Performance Manager, it tells me that it has to be removed from the deleted installation first. Thanks, --Carl

8 9

unable to find master : Cdot : 8.3RC1
by Uddhav Regmi 26 Jul '15

26 Jul '15

Hello all, It just died all of a sudden. Automatic Recovery was off. Pls advise. Cannot access the cluster level , node level is fine. Sim::> event log show -severity emerGENCY Time Node Severity Event ------------------- ---------------- ------------- --------------------------- 7/26/2015 09:57:50 Sim-01 EMERGENCY callhome.root.vol.recovery.reqd: Call home for ROOT VOLUME NOT WORKING PROPERLY: RECOVERY REQUIRED. 7/26/2015 09:56:36 Sim-01 EMERGENCY rdb.recovery.failed: Error: Unable to find a master.. Unable to recover the local database of Data Replication Module: Management. 2 entries were displayed. Sim::> event log show -severity erroR Time Node Severity Event ------------------- ---------------- ------------- --------------------------- 7/26/2015 10:00:51 Sim-01 ERROR mgmtgwd.ntp.job.failure: The ntp_resolve_job could not be started. 7/26/2015 09:56:39 Sim-01 ERROR spm.mgwd.process.exit: Management Gateway (mgwd) subsystem with ID 12774 exited as a result of signal signal 6. The subsystem will attempt to restart. 7/26/2015 09:56:36 Sim-01 ERROR ucore.panicString: 'mgwd: assertion (false) at corrupt_rdb.cc:587 failed, raising SIGABRT(6) at RIP 0x82e1ed7bc (pid 12774, uid 0, timestamp 1437918996)' 7/26/2015 09:53:50 Sim-01 ERROR spm.mgwd.process.exit: Management Gateway (mgwd) subsystem with ID 12403 exited as a result of signal normal exit (1). The subsystem will attempt to restart. 7/26/2015 09:52:15 Sim-01 ERROR spm.vldb.process.exit: Volume Location Database(VLDB) subsystem with ID 4568 exited as a result of signal normal exit (1). The subsystem will attempt to restart. 7/26/2015 09:52:15 Sim-01 ERROR rdb.env.IOFailure: Error encountered in root volume I/O: Could not force changes to /mroot/etc/cluster_config/rdb/VLDB/_unit.config.bak. . 7/25/2015 19:29:45 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 7/25/2015 19:29:45 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/25/2015 19:29:45 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/25/2015 19:27:45 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 7/22/2015 18:34:29 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/22/2015 18:34:29 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/22/2015 18:32:11 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 7/21/2015 10:20:13 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/21/2015 09:16:17 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/21/2015 09:16:17 Sim-01 ERROR mgmtgwd.configbr.noSNCBackup: This cluster is effectively a single node and there is no configuration backup configured. 7/21/2015 09:14:53 Sim-01 ERROR mgmtgwd.configbr.backupFailed: The node configuration backup Sim-01.daily.2015-07-21.09_03_46.7z cannot be created. Error: 'Failed to create tarball for backup Sim-01.daily.2015-07-21.09_03_46.7z. Error: Failed to create package with name /mroot/etc/backups/config/Sim-01.daily.2015-07-21.09_03_46.7z'. 7/21/2015 09:14:51 Sim-01 ERROR mgmtgwd.configbr.backupFailed: The node configuration backup Sim-01.8hour.2015-07-21.09_03_46.7z cannot be created. Error: 'Failed to create tarball for backup Sim-01.8hour.2015-07-21.09_03_46.7z. Error: Failed to create package with name /mroot/etc/backups/config/Sim-01.8hour.2015-07-21.09_03_46.7z'. 7/21/2015 09:14:50 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 7/21/2015 09:14:37 Sim-01 ERROR mgmtgwd.mroot.full: The root volume of node 'Sim-01' is full. This prevents the node from operating properly. 7/21/2015 09:07:23 Sim-01 ERROR mgmtgwd.mroot.nearlyfull: The root volume of node 'Sim-01' is nearly full. When it is full the node cannot operate properly. 21 entries were displayed. Sim::>

3 4

Hot Shelf Removal - check for mailbox disks first before remove ownership
by Gelb, Scott 24 Jul '15

24 Jul '15

The hot shelf removal feature is great, but the documentation at https://library.netapp.com/ecmdocs/ECMP1367947/html/GUID-2B80FBD2-007D-4D19… is missing a check. An edge case if you had mroot on those disks prior, and then moved mroot to other disks/shelves for the hot removal. If the disks on the shelf or shelves have mailbox disks, right after you remove ownership from the disks (even though all zeroed spares), the node will crash. The ha-partner will not be able to takeover. Then the ha partner will also crash with an inconsistent mailbox. We had both nodes drop after removing ownership from a shelf that was being removed. It is an easy fix to get to maintenance mode and mailbox destroy local, but add that to your run book for hot shelf removal. We didn't have any data on the ha-pair for the maintenance (the great thing about cDOT which averted any outage even during this maintenance). We recovered after reassigning the disks and deleting the mailbox (had to do that twice) then both nodes came back up after coredump and mailbox was recreated and storage failover was able to enable again. ::> set adv ::*> stor failover mailbox-disk show One other note on the move mroot procedure https://kb.netapp.com/support/index?page=content&id=3013873&locale=en_US The article now lists to turn on nvfail (submitted that update a while ago), but some systems also had create_ucode enabled on vol0, so I check "vol options vol0" prior to move, then match the settings after the move in addition to nvfail. Also, if you have cdpd.enable on and ip.fastpath.enable off, both of those need to be reset since mroot move sets them back to cdpd off and fastpath on defaults (8.3P1).

3 2

Cluster evolution
by Milazzo Giacomo 22 Jul '15

22 Jul '15

Hi everybody, suppose that for technical (i.e. a 3240HA controller pair that does not fit with a 8060HA one in the same cluster) reason I've to start with two different 2 nodes cluster, each of the two managing its respective aggregates and node. So I can have now: CLUSTER1-01 and CLUSTER1-02 (3240HA) and CLUSTER2-01 and CLUSTER2-02 (8060HA) In the future customer could have budget to do a tech refresh on the first cluster changing the heads to an 8000 pairs. Well, what's about the merge of the CLUSTER1 nodes to the CLUSTER2 preserving all data in CLUSTER1 aggregates? So I mean that I would have in the end a 4 nodes cluster and not two separate 2 nodes ones. Is there some procedure? Regards.

6 15

FAS-2554 cDOT sanity check requested
by Roy McMorran 22 Jul '15

22 Jul '15

Hi all, We recently purchased a NetApp FAS-2554 and I'm getting what I feel is less than stellar performance. I have a case open with support. But I'm trying to 'calibrate my expectations' a bit, so I thought I'd send this out to the list. Any feedback would be appreciated. Here's a some info about the configuration cDOT, 8.3.1RC1 2-node switchless cluster 22 SATA drives (3TB) in two RAID-DP aggregates + 2 spares 22 10K SAS drives (900GB) in two RAID-DP aggregates + 2 spares No flash (yet?) 10Gb cluster interconnect 10Gb to server(s) with jumbo frames 2 vFilers - the one under test has a volume on the sas_data_1 aggregate which is serving NFS v3 (TCP) I'm currently testing with a Cisco UCS C220 M4S running CentOS 6.6 as the NFS client. We noticed that performance (on a database load) seemed poor, so I started some benchmark testing with "iozone". The test I'm looking at in particular is sequential writes with an 8K record size. The write throughput was 2MB/S! There are no other workloads on the filer or the server. NetApp suggested a workaround for the bug described here: http://mysupport.netapp.com/NOW/cgi-bin/bol?Type=Detail&Display=876563 and that actually improved things - my sequential write throughput test can now do 15MB/S. Definitely better, but that still seems slow to me. So with all that background here is my question - does anyone have a similar configuration out there, and what sort of write speeds are you seeing? I'm just looking for a sanity check. Is 15MB/S reasonable? Thanks! Roy McMorran

9 18

FEAR report
by Brad Thompson 22 Jul '15

22 Jul '15

Has anyone ever heard of a NetApp FEAR report? I've had several people ask me about running it, but I can't figure out what they are talking about. -Brad

4 8

Latency Counters - Perfmon versus Resource Monitor
by Philbert Rupkins 21 Jul '15

21 Jul '15

Hello Toasters, I have a situation in which Resource Monitor shows 100 - 400 ms disk Response Time (latency) for various processes in the Disk-Disk Activity tab. Resource Monitor doesnt break Response Time down into read/write/other so I hopped over to perfmon. I enabled the following perfmon metrics for the block device showing 100 - 400ms response time in Resource Monitor: Physical Disk: Avg. Disk Bytes/Read Avg. Disk Bytes/Write Avg. Disk Bytes/Transfer Physical Disk: Avg. Disk sec/Read Avg. Disk sec/Write Avg. Disk Sec/Transfer Those permon counters were chosen to have a look at block size and latency. Perfmon reported very large values for Avg. Disk Bytes/Read (up to 500,000) which may explain some of the higher Response Time numbers in Resource Monitor. HOWEVER, perfmon showed very low numbers for Avg. Disk sec/Read whereas Resource Monitor showed 100 - 400 ms. Does anybody know what might account for the difference in Response Times between perfmon and Resource Monitor? Specifically, the difference between Avg. Disk sec/Transfer (perfmon) and the Response Time column in Resource Monitor? Windows Server 2008, Exchange 2010, NetApp v3250 running 8.1.4P3 7-Mode. All LUNS presented via iSCSI. -Phil

1 0

Nondisruptively change language of a volume containing LUNs?
by Basil 20 Jul '15

20 Jul '15

Hi folks, One of my colleagues made a typo on the language for volumes that are used exclusively for LUNs. I know that you can't change the language of a volume, but is there a way to move the LUNs to a new volume with the correct language set? Thanks!

4 6

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters