toasters January 2017

toasters@lists.teaparty.net

35 participants
20 discussions

AW: X1144A - No link
by Alexander Griesser 03 Apr '17

03 Apr '17

Hi Mike, Thanks, I had a similar issue with 1G copper SFPs in the past – but that doesn’t seem to apply here since the 40G ports are on an expansion slot and do not seem to be CNA capable: *> cna_flash update all NOTE: The flash update will take up to 30 minutes per update. (Current 2 chip(s) in the system) Do not interrupt power during the update, or you risk flash image corruption. Version (5.0.2) is the same in flash and file No update of flash is needed for port 0e. Version (5.0.2) is the same in flash and file No update of flash is needed for port 0g. -> While the expansion ports are in slot 2. Also, the upgrade to Ontap 9.1 did not solve the issue – will check the cables now when I’m in the datacenter. Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601 Von: Mike Gossett [mailto:cmgossett@gmail.com] Gesendet: Samstag, 28. Januar 2017 00:58 An: Alexander Griesser <AGriesser(a)anexia-it.com> Cc: tmac <tmacmd(a)gmail.com>; toasters(a)teaparty.net Betreff: Re: X1144A - No link Just a thought- I noticed that on a FAS2554, when trying to use 1G SFPs (copper) in the UTA ports, I had similar issues. I ended up having to apply a firmware update to the UTA2 system, IIRC, from maintenance mode. I have nothing that leads me to believe that is the case here, but it sounds somewhat close. The updated firmware was actually on the system with the code it shipped with, but needed to be manually applied. If all else fails, there's always a support ticket :) HTH Mike On Fri, Jan 27, 2017 at 7:39 AM, Alexander Griesser <AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com>> wrote: Those are optical cables, that got shipped with the card and the transceivers. According to HWU, those are the transceivers: << pic removed >> They look exactly like these and HWU calls them X65402. The connector looks exactly like the MPO connector which can also be seen in HWU and hast he cable number X66200-2 – so this is what I got: X1144A Adapter X65402 Transceivers X66200-2 Cables Should all play well with 9.1RC2 on the AFF-A300. Since 9.1 has already been released, I’ll upgrade this system to 9.1 and see if that changes anything – maybe there’s a reason why they call it RC ☺ Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601 Von: tmac [mailto:tmacmd@gmail.com<mailto:tmacmd@gmail.com>] Gesendet: Freitag, 27. Januar 2017 14:34 An: Alexander Griesser <AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com>> Cc: toasters(a)teaparty.net<mailto:toasters@teaparty.net> Betreff: Re: X1144A - No link OK, a little confused now. Are you trying to use copper or optical? According to HWU, the X1144A as QSFP+ slots and the cable ends look identical to the SAS cables. The NetApp end should be any supported copper cable with a QSFP+ end or an optical transciever (X65402A, mfg 332-00389). The optical transciver will have the QSFP+ going into the filer and exposing the MPO end for your optical cable Since it looks like you are trying to use Optical, are you *sure* the optical transcivers are the right ones for that card? --tmac Tim McCarthy, Principal Consultant Proud Member of the #NetAppATeam<https://twitter.com/NetAppATeam> I Blog at TMACsRack<https://tmacsrack.wordpress.com/> On Fri, Jan 27, 2017 at 8:14 AM, Alexander Griesser <AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com>> wrote: That’s the 2-port 40G card with QSFPs and those funny new cables, no breakout cables. http://cdn3.bigcommerce.com/s-uiigcj2/product_images/uploaded_images/mtp-ca… Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601 Von: tmac [mailto:tmacmd@gmail.com<mailto:tmacmd@gmail.com>] Gesendet: Freitag, 27. Januar 2017 13:40 An: Alexander Griesser <AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com>> Cc: toasters(a)teaparty.net<mailto:toasters@teaparty.net> Betreff: Re: X1144A - No link Curious...are you using it as a two-port 40Gb card or using the breakout cable? --tmac Tim McCarthy, Principal Consultant Proud Member of the #NetAppATeam<https://twitter.com/NetAppATeam> I Blog at TMACsRack<https://tmacsrack.wordpress.com/> On Fri, Jan 27, 2017 at 7:13 AM, Alexander Griesser <AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com>> wrote: Good question – I’m using the QSFPs and the cables that came with the cards, so I’m positive that those should be supported. But I’m trying to find out. Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601 Von: tmac [mailto:tmacmd@gmail.com<mailto:tmacmd@gmail.com>] Gesendet: Freitag, 27. Januar 2017 13:04 An: Alexander Griesser <AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com>> Cc: toasters(a)teaparty.net<mailto:toasters@teaparty.net> Betreff: Re: X1144A - No link what is the cable that you are using? Anything supported? [Inline image 1][Inline image 2] --tmac Tim McCarthy, Principal Consultant Proud Member of the #NetAppATeam<https://twitter.com/NetAppATeam> I Blog at TMACsRack<https://tmacsrack.wordpress.com/> On Fri, Jan 27, 2017 at 5:16 AM, Alexander Griesser <AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com>> wrote: Hi, I’ve just installed those fancy X1144A cards in one of our AFF300 systems and it seems they’re getting recognized properly, but I’m not able to get a link on them. sysconfig says: slot 2: 40 Gigabit Ethernet Controller XL710 QSFP+ e2a MAC Address: 3c:fd:fe:a2:90:c8 (auto-unknown-down) e2e MAC Address: 3c:fd:fe:a2:90:c9 (auto-unknown-down) SAN01::> net port show -port e2* (network port show) Node: SAN01-01 Speed(Mbps) Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status --------- ------------ ---------------- ---- ---- ----------- -------- e2a Default - down 1500 auto/10 - e2e Default - down 1500 auto/10 - Node: SAN01-02 Speed(Mbps) Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status --------- ------------ ---------------- ---- ---- ----------- -------- e2a Default - down 1500 auto/10 - e2e Default - down 1500 auto/10 - 4 entries were displayed. For testing purposes, I did connect e2a on node1 to e2a on node 2 and I already tried exchanging the QSFPs and cables, but still no dice. Any idea what could be wrong here? According to HWU, the minimum required OS version is 9.1RC2, which is exactly what is installed currently: SAN01::> version NetApp Release 9.1RC2: Thu Nov 24 08:59:46 UTC 2016 Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601 _______________________________________________ Toasters mailing list Toasters(a)teaparty.net<mailto:Toasters@teaparty.net> http://www.teaparty.net/mailman/listinfo/toasters _______________________________________________ Toasters mailing list Toasters(a)teaparty.net<mailto:Toasters@teaparty.net> http://www.teaparty.net/mailman/listinfo/toasters

4 4

super secret flags
by Peter D. Gray 03 Feb '17

03 Feb '17

Hi people Just out of idle curiosity, am I the only netapp admin who does not know about the super secret flags to allow snapmirror to actually work at reasonable speed? We were running 8.3.2 cluster mode, and spent weeks looking into why our snapmirrors to our remote site ran so slowly. We were often 2 days behind over 40G networks. Obviously, we focussed on network issues. And we wasted a lot of time. We could make no sense of the problem at all since sometimes it appears to work ok, the later the transfers slowed to a crawl. We eventually opened a case and it did not take to long for a reply which basically said "why don't you just disable the global snapmirror throttle." I had already looked into such a beast, but found nothing. As you may or may not know, it turns out to be a per node setting. The name of the flag is repl_throttle_enable. Of course, you can only see such flags or change them on the node, in privileged mode. Setting the flag to 0 immediately (and I do mean immediately) allowed our snapmirrors to run at the speed you might expect over 40G. Instead of taking 2 days, snapmirror updates now took 2 hours. We have since upgraded to 9.1. The flags reverted to on, but again can be set to off. I think there is a documented global snapmirror throttle option in 9.1, but I have not looked into that yet. Are we the only site in the world to have seen this issue? We use snapmirror DR for all our mirrors which may be a factor. As I said, just idle curiousity and maybe helping someone avoid the time wasting we had. Regards, pdg Peter Gray Ph (direct): +61 2 4221 3770 Information Management & Technology Services Ph (switch): +61 2 4221 3555 University of Wollongong Fax: +61 2 4229 1958 Wollongong NSW 2522 Email: pdg(a)uow.edu.au Australia URL: http://pdg.uow.edu.au

7 21

System attention LED
by Alexander Griesser 01 Feb '17

01 Feb '17

Hi there, I have two filers (1x FAS2240 and 1x FAS2650) and both have the system attention LED lit and I have no idea why. `System health status show` as well as config advisor are both A-OK and there are no visible indicators why this LED is still lit. Any idea how to find out the root cause of this LED on the front bezel or how I can check or maybe reset the status of the LED through CLI? Thanks, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

6 22

X1144A - No link
by Alexander Griesser 30 Jan '17

30 Jan '17

Hi, I've just installed those fancy X1144A cards in one of our AFF300 systems and it seems they're getting recognized properly, but I'm not able to get a link on them. sysconfig says: slot 2: 40 Gigabit Ethernet Controller XL710 QSFP+ e2a MAC Address: 3c:fd:fe:a2:90:c8 (auto-unknown-down) e2e MAC Address: 3c:fd:fe:a2:90:c9 (auto-unknown-down) SAN01::> net port show -port e2* (network port show) Node: SAN01-01 Speed(Mbps) Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status --------- ------------ ---------------- ---- ---- ----------- -------- e2a Default - down 1500 auto/10 - e2e Default - down 1500 auto/10 - Node: SAN01-02 Speed(Mbps) Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status --------- ------------ ---------------- ---- ---- ----------- -------- e2a Default - down 1500 auto/10 - e2e Default - down 1500 auto/10 - 4 entries were displayed. For testing purposes, I did connect e2a on node1 to e2a on node 2 and I already tried exchanging the QSFPs and cables, but still no dice. Any idea what could be wrong here? According to HWU, the minimum required OS version is 9.1RC2, which is exactly what is installed currently: SAN01::> version NetApp Release 9.1RC2: Thu Nov 24 08:59:46 UTC 2016 Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

3 7

AW: X1144A - No link
by Alexander Griesser 27 Jan '17

27 Jan '17

Yes, already tried that. Here’s the –instance output of those ports: SAN01::*> net port show -port e2* -instance (network port show) Node: SAN01-01 Port: e2a Link: down MTU: 1500 Auto-Negotiation Administrative: true Auto-Negotiation Operational: true Duplex Mode Administrative: auto Duplex Mode Operational: half Speed Administrative: auto Speed Operational: 10 Flow Control Administrative: full Flow Control Operational: none MAC Address: 3c:fd:fe:a2:90:c8 Up Administrative: true Autorevert Delay: - Port Type: physical Interface Group Parent Node: - Interface Group Parent Port: - Distribution Function: - Create Policy: - Parent VLAN Node: - Parent VLAN Port: - VLAN Tag: - Remote Device ID: - IPspace Name: Default DCB State: incapable Broadcast Domain: - MTU Administrative: 1500 Port Health Status: - Ignore Port Health Status: false Port Health Degraded Reasons: - […] Node: SAN01-02 Port: e2a Link: down MTU: 1500 Auto-Negotiation Administrative: true Auto-Negotiation Operational: true Duplex Mode Administrative: auto Duplex Mode Operational: half Speed Administrative: auto Speed Operational: 10 Flow Control Administrative: full Flow Control Operational: none MAC Address: 3c:fd:fe:a2:8f:a0 Up Administrative: true Autorevert Delay: - Port Type: physical Interface Group Parent Node: - Interface Group Parent Port: - Distribution Function: - Create Policy: - Parent VLAN Node: - Parent VLAN Port: - VLAN Tag: - Remote Device ID: - IPspace Name: Default DCB State: incapable Broadcast Domain: - MTU Administrative: 1500 Port Health Status: - Ignore Port Health Status: false Port Health Degraded Reasons: - Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601 Von: CPO [mailto:cavinoquin@gmail.com] Gesendet: Freitag, 27. Januar 2017 14:18 An: Alexander Griesser <AGriesser(a)anexia-it.com> Betreff: Re: X1144A - No link Did you try to status-admin-up the interface? On Jan 27, 2017 4:20 AM, "Alexander Griesser" <AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com>> wrote: Hi, I’ve just installed those fancy X1144A cards in one of our AFF300 systems and it seems they’re getting recognized properly, but I’m not able to get a link on them. sysconfig says: slot 2: 40 Gigabit Ethernet Controller XL710 QSFP+ e2a MAC Address: 3c:fd:fe:a2:90:c8 (auto-unknown-down) e2e MAC Address: 3c:fd:fe:a2:90:c9 (auto-unknown-down) SAN01::> net port show -port e2* (network port show) Node: SAN01-01 Speed(Mbps) Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status --------- ------------ ---------------- ---- ---- ----------- -------- e2a Default - down 1500 auto/10 - e2e Default - down 1500 auto/10 - Node: SAN01-02 Speed(Mbps) Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status --------- ------------ ---------------- ---- ---- ----------- -------- e2a Default - down 1500 auto/10 - e2e Default - down 1500 auto/10 - 4 entries were displayed. For testing purposes, I did connect e2a on node1 to e2a on node 2 and I already tried exchanging the QSFPs and cables, but still no dice. Any idea what could be wrong here? According to HWU, the minimum required OS version is 9.1RC2, which is exactly what is installed currently: SAN01::> version NetApp Release 9.1RC2: Thu Nov 24 08:59:46 UTC 2016 Best, Alexander Griesser Head of Systems Operations ANEXIA Internetdienstleistungs GmbH E-Mail: AGriesser(a)anexia-it.com<mailto:AGriesser@anexia-it.com> Web: http://www.anexia-it.com<http://www.anexia-it.com/> Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601 _______________________________________________ Toasters mailing list Toasters(a)teaparty.net<mailto:Toasters@teaparty.net> http://www.teaparty.net/mailman/listinfo/toasters

1 0

Dell compellent
by Camillo Gornati 27 Jan '17

27 Jan '17

Good morning all! Does the dell compellent scv2020 has any similarities with netapp storage? Thanks. Sent from my iPhone

3 2

MIgration from Isilon with XCP
by Jeffrey Mohler 26 Jan '17

26 Jan '17

Has anyone here used XCP for Isilon migration, any experiences you can share? Thanks! _________________________________Jeff MohlerTech Yahoo, Storage Architect, Principal

2 1

Volume Encryption Hardware
by Stephen Stocke 26 Jan '17

26 Jan '17

Hello I'm trying to find an official list of which hardware supports the new 9.1 Netapp Volume Encryption (NVE) feature. I've checked HWU and can't see anything that shows NVE compatibility. I've also tried IMT but I've never been able to get along with that tool. Specifically, I'm trying to find out if the FAS2500 series or new FAS2650 platforms support this feature. I've listened to TechOnTap podcast #59 in which the speakers discuss NVE but I'm now looking for the "official" documentation on hardware support. Any pointers to the right docs would be greatly appreciated! Kind regards Steve

6 6

cDOT 9.0: inodes not growing with respective volume growth
by Momonth 26 Jan '17

26 Jan '17

Hi All, I've noticed the following on cDOT 9.0 production cluster: na201::> df -h vol_imgstore03 Filesystem total used avail capacity Mounted on Vserver /vol/vol_imgstore03/ 90TB 60TB 29TB 67% /vol_imgstore03 na201svm-nfs10g-02 /vol/vol_imgstore03/.snapshot 0B 0B 0B 0% /vol_imgstore03/.snapshot na201svm-nfs10g-02 2 entries were displayed. na201::> vol show vol_imgstore03 -fields files vserver volume files ------------------ -------------- -------- na201svm-nfs10g-02 vol_imgstore03 59999998 So, volume's size is 90TB and its current max inodes possible is ~ 60M na201::> vol size vol_imgstore03 +10g -vserver na201svm-nfs10g-02 vol size: Volume "na201svm-nfs10g-02:vol_imgstore03" size set to 90.01t. Now, I just added 10G to the volume, expecting it's going to increase the "files" value respectively: na201::> vol show vol_imgstore03 -fields files vserver volume files ------------------ -------------- -------- na201svm-nfs10g-02 vol_imgstore03 59999998 However it's not the case. Anyone knows what I'm missing here? Cheers, Vladimir

1 1

VSERIES LUN MISSED CAUSES GENERAL PANIC AFTER TAKEOVER
by Milazzo Giacomo 25 Jan '17

25 Jan '17

Hi, o a V6000 with Ontap 8.2 7Mode a series of LUNs have been configured from an EMC CX4 system. It happened that randomly a couple of LUN fail on the same raid group of the CX4. The controller loose its aggregate that goes in degraded mode and a takeover start to the other node. The other node after takeover attempt to put this aggregate online but if fails because one of its lun is still missed. This panic all the systems and this should be avoided. There are other third party arrays virtualized that should continue to work. Is it possible to exclude from takeover actions only one aggregate (I think no), why the remaining node panic? regards

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters January 2017