toasters October 2020

toasters@lists.teaparty.net

17 participants
9 discussions

Netapp Insight Virtual
by John Stoffel 09 Nov '20

09 Nov '20

Wow, I just watched Jeffrey Steiner's presentation "BRK-1151-2 Data Performance: What do you really need?" While attending the Virtual Insight conference. What an amazingly useful talk, I wish it *was* a two hour course, I'd take it again in a hearbeat. My Netapp setup isn't nearly as upto date as I'd like, and my Oracle DBA does a pretty good job of keeping things humming, but this talk was just really excellent. If you have a chance, go attend this conference and watch this presentation. John

5 5

IOPs limit?
by Heino Walther 29 Oct '20

29 Oct '20

Hi there We have an A300 connected to two FC fabrics with 2 x 8G FC per controller node. We are doing tests on an “older” HP C7000 with VirtualConnect modules and with blades that have 2 x 8G FC mezzanine. The VCs are connected into the fabric with two 8G FC per fabric. So the throughput to a given LUN would be 16Gbps. As the other two links are standby. The blade is running ESXi 7.0 and on top of this we are running a virtual Windows 2016 server from where the tests are done. There are no one else on the A300. We hav created a standard LUN in a volume, presented it to ESXi from where we created a VMFS and the VM is then presented with a VMDK-based disk. It seems that no matter what we adjust we have a limit at about 70.000 IOPs on the disks. We are able to run other workloads while we are testing with 70.000 IOPs, and we are able to load the system even more, so the NetApp does not seem to be the limiting factor… we can also not see that much load on the system from the NetApp Harvest/Grafana we have running… We of cause make sure that the tests we do is not done in cache on the host… The specific test is with 64k block size. Questions: * Can there be a limit of IOPs in the C7000 setup? PCI-bridge stuff? * Does it make sense to add more paths, in either the NetApp and/or the C7000? (each blade can only have two ports) * Would it make sense to upgrade the FC links to 16G? * We have adjusted the queue depth as per NetApp’s recommendations, as far as I know there is no way to adjust QD on the ONTAP node itself, is this correct? * The shelf attached is IOM6 based, would it make sense to upgrade this to IOM12? * Would it make sense to cable the IOM12 in a Quad-Path setup? Any suggestions are welcome… also if you have any insights of how many IOPs one should expect from an A300 with 24 x 3.7T SSDs. /Heino --

3 5

AW: Wrong disk bay reported
by Alexander Griesser 29 Oct '20

29 Oct '20

Hi Robin, thanks, that’s exactly the case. I asked the customer to pull the disks again and wait a minute before reinserting and the disks are now displayed correctly. Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601 Von: Robin Mesotten <robin(a)mesotten.eu> Gesendet: Donnerstag, 29. Oktober 2020 02:59 An: Alexander Griesser <AGriesser(a)anexia-it.com> Betreff: Re: Wrong disk bay reported Hi Alexander, I have seen this a few time in the lab when moving disks from one slot to another. Is it possible your customer first inserted the disks in to slot 22 and 23 then afterwards realised they started on the wrong side and moved them? I also found this bug 1246444. Moving disks within a system without following the appropriate procedure can cause the same disk name to be reported for multiple physical disk locations. This might cause the management gateway process to crash or generate other unpredictable system behavior. When moving storage disks, you must wait at least 20 seconds after removal before inserting the disk in the new location. To recover from this issue, choose one of the following options: 1. Perform a takeover and giveback of the affected systems. 2. Remove the disk for at least 20 seconds, and then reinsert it. Note: If the disk is part of an aggregate, this option will result in a degraded RAID group and disk reconstruction will be initiated. Regards, Robin On 28/10/2020 22:45, Alexander Griesser wrote: Hey, did anyone ever encounter such a mismatch? Customer reported that they installed new disks in slots 0 and 1, but this is what I can see here: CLUSTER::*> disk show -container-type unassigned Usable Disk Container Container Disk Size Shelf Bay Type Type Name Owner ---------------- ---------- ----- --- ------- ----------- --------- -------- 1.11.22 - 11 22 SAS unassigned - - 1.11.23 - 11 23 SAS unassigned - - 2 entries were displayed. Whereas: CLUSTER::*> node run -node node1 disk show -n DISK OWNER POOL SERIAL NUMBER HOME DR HOME ------------ ------------- ----- ------------- ------------- ------------- 0b.11.1 Not Owned NONE 50M0A02MF4XR 0b.11.0 Not Owned NONE 50M0A01XF4XR And also: CLUSTER::*> node run -node node1 sasadmin shelf Expanders on channel 0a: +-----------------------------------------------------------------------+ 0 | 0| 1| 2| 3| 4| 5| 6| 7| 8| 9|10|11|12|13|14|15|16|17|18|19|20|21|22|23| +-----------------------------------------------------------------------+ +-----------------------------------------------------------------------+ 11 | 0| 1|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD| +-----------------------------------------------------------------------+ The system is running on an older Ontap release (9.2P2). Is there any command to „rescan“ the disk locations? Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

1 0

Anyone using Cohesity or Rubrik for Netapp CIFS NAS backup?
by Sami Kapanen 28 Oct '20

28 Oct '20

Anyone using Cohesity or Rubrik for Netapp CIFS NAS backup? Considering these, looking for experiences, br, sk

6 9

Wrong disk bay reported
by Alexander Griesser 28 Oct '20

28 Oct '20

Hey, did anyone ever encounter such a mismatch? Customer reported that they installed new disks in slots 0 and 1, but this is what I can see here: CLUSTER::*> disk show -container-type unassigned Usable Disk Container Container Disk Size Shelf Bay Type Type Name Owner ---------------- ---------- ----- --- ------- ----------- --------- -------- 1.11.22 - 11 22 SAS unassigned - - 1.11.23 - 11 23 SAS unassigned - - 2 entries were displayed. Whereas: CLUSTER::*> node run -node node1 disk show -n DISK OWNER POOL SERIAL NUMBER HOME DR HOME ------------ ------------- ----- ------------- ------------- ------------- 0b.11.1 Not Owned NONE 50M0A02MF4XR 0b.11.0 Not Owned NONE 50M0A01XF4XR And also: CLUSTER::*> node run -node node1 sasadmin shelf Expanders on channel 0a: +-----------------------------------------------------------------------+ 0 | 0| 1| 2| 3| 4| 5| 6| 7| 8| 9|10|11|12|13|14|15|16|17|18|19|20|21|22|23| +-----------------------------------------------------------------------+ +-----------------------------------------------------------------------+ 11 | 0| 1|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD|DD| +-----------------------------------------------------------------------+ The system is running on an older Ontap release (9.2P2). Is there any command to "rescan" the disk locations? Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

1 0

Migration to new cluster nodes...
by Heino Walther 13 Oct '20

13 Oct '20

Hi there We have to migrate our existing AFF8080 which has NFSv3, ISCSI and CIFS data on it to a new location. The plan is to add a temp A300 in the new location, and add it to the AFF8080’s cluster with two cluster switches (they are sub 200M apart) ISCSI and CIFS should be fairly simple to migrate, but NFSv3 is IP-centric, so as we start the migration volume by volume, the data path for some of our vmware host will be extended somewhat… It will go via the AFF8080’s configured IP address over the cluster network to the A300 controller that holds the volume, and back again. Has anyone tried this with success? Of cause another way would be to migrate the VMs from the VMWare side, which I would like to avoid if possible, but I am a bit worried about the added latency over the cluster network… Should I be worried? /Heino

7 9

Re:
by Douglas Siggins 05 Oct '20

05 Oct '20

Yes, thanks folks. It appears there's not much v4 out there as suspected. On Wed, Sep 30, 2020, 20:12 Jeff Cleverley via Toasters < toasters(a)teaparty.net> wrote: > > > > ---------- Forwarded message ---------- > From: Jeff Cleverley <jeff.cleverley(a)broadcom.com> > To: Wayne McCormick <Wayne.McCormick(a)sjrb.ca> > Cc: Toasters <toasters(a)teaparty.net> > Bcc: > Date: Wed, 30 Sep 2020 18:03:42 -0600 > Subject: Re: Any Openstack/Netapp FAS deployments w cinder NFS, v3 or v4 > Wayne, > > Just so you know your posts are working, I'll reply. I have no experience > with that at this point in time. Personally I don't see an issue posting > to ensure the NetApp configurations are correct or compatible with the > configurations. > > Jeff > > On Fri, Sep 25, 2020 at 9:09 AM Wayne McCormick <Wayne.McCormick(a)sjrb.ca> > wrote: > >> I hope I’m doing this right… (posting to the list I mean). >> >> >> >> I have four MySQL servers using NFSv4, but not with krb5. The rest of >> the environment is v3. >> >> >> >> We did do a pilot with OpenStack Container Platform and we used v3 (v4 >> was enabled, so it may have used it) provisioning via Trident with >> success. We also used Trident to provision iSCSI volumes. Worked quite >> well. >> >> >> >> Hope that helps a little. >> >> >> Wayne >> >> >> >> *From:* Toasters <toasters-bounces(a)teaparty.net> *On Behalf Of *Douglas >> Siggins >> *Sent:* Friday, September 25, 2020 9:01 AM >> *To:* Toasters <toasters(a)teaparty.net> >> *Subject:* Re: Any Openstack/Netapp FAS deployments w cinder NFS, v3 or >> v4 >> >> >> >> * CAUTION:* This email is from an external source. Do not click links >> or open attachments unless you recognize the sender and know the content is >> safe. >> >> Crickets ? :) >> >> >> >> Alright let us remove openstack qualifier. Does anyone use v4 or know >> anyone that does with Netapp FAS? >> >> >> >> On Tue, Sep 22, 2020 at 6:53 PM Douglas Siggins <siggins(a)gmail.com> >> wrote: >> >> Greetings, >> >> Just reaching out for experiences on Openstack deployments with Netapp >> NFS. Are you using the default v4 or have switched the mount options to >> v3? We have a pretty good base of ISCSI, but based on performance and >> manageability are considering making the jump. >> >> >> >> Speaking of NFSv4, outside of openstack has anyone made any large >> deployments? Is it as solid as v3? using uid/gid, is anyone using sec=krb5? >> >> >> >> >> >> >> >> Regards, >> >> Douglas >> >> _______________________________________________ >> Toasters mailing list >> Toasters(a)teaparty.net >> https://www.teaparty.net/mailman/listinfo/toasters > > > > -- > ** Please note my email address has changed to jeff.cleverley(a)broadcom.com > > Jeff Cleverley > Factory Systems Engineer > 4380 Ziegler Road > Building 1, Dock 1 > Fort Collins, Colorado 80525 > 970-288-4611 > > > > ---------- Forwarded message ---------- > From: Jeff Cleverley via Toasters <toasters(a)teaparty.net> > To: Wayne McCormick <Wayne.McCormick(a)sjrb.ca> > Cc: Toasters <toasters(a)teaparty.net> > Bcc: > Date: Thu, 1 Oct 2020 01:04:02 +0100 > Subject: > _______________________________________________ > Toasters mailing list > Toasters(a)teaparty.net > https://www.teaparty.net/mailman/listinfo/toasters

4 6

SVM Admin Access
by Philbert Rupkins 02 Oct '20

02 Oct '20

Toasters, I work with a team of Windows Server admins who are open to provisioning their own storage but strongly prefer a GUI. I'd like to provide this ability by granting System Manager access to the specific SVM's that host their resources. Much to my chagrin, it doesn't appear RBAC allows for System Manager access to particular SVMs. Instead, privileges must be granted at the cluster level which of course means those privs are effective for all data SVMs (this is a non-starter). Per NetApp docs, my only option appears to be SVM level RBAC privs via SSH. Not quite the GUI option they are looking for but, organizationally, we're making a push for more automation and use of Ansible so it's not completely out of the question. Is there an angle Im not considering that would allow for SVM level access via System Manager? Has anybody else come up with creative ways to address this problem? I'd love to hear from you. Thanks, Phil

8 13

Any Openstack/Netapp FAS deployments w cinder NFS, v3 or v4
by Douglas Siggins 01 Oct '20

01 Oct '20

Greetings, Just reaching out for experiences on Openstack deployments with Netapp NFS. Are you using the default v4 or have switched the mount options to v3? We have a pretty good base of ISCSI, but based on performance and manageability are considering making the jump. Speaking of NFSv4, outside of openstack has anyone made any large deployments? Is it as solid as v3? using uid/gid, is anyone using sec=krb5? Regards, Douglas

3 3

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters October 2020