Hi Mike,

 

yes, I got it solved and wanted to reply back earlier but somehow always forgot about it :-/

I’m not really sure what finally was the fix, since I was having the filer in my lab when I encountered the issues and time ran out on the project to further debug this, so we shipped it to its final destination, powered it back on and everything was working.

So I’m not sure i fit was the full halt of both filers to finally accept the NICs or i fit was a stronger guy than me who pushed in the QSFP+ modules (since the datacenter guy said that compared to the other modules in the servers f.ex., those had to be pushed in harder, whatever that means) and from then on, I was having full connectivity on all four modules in my gear.

 

I think I’ll never find out if it was me being to weak, or if the full powercycle helped it.

 

Best,

 

Alexander Griesser

Head of Systems Operations

 

ANEXIA Internetdienstleistungs GmbH

 

E-Mail: AGriesser@anexia-it.com

Web: http://www.anexia-it.com

 

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt

Geschäftsführer: Alexander Windbichler

Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

 

Von: Mike Thompson [mailto:mike.thompson@gmail.com]
Gesendet: Sonntag, 2. April 2017 10:28
An: Alexander Griesser <AGriesser@anexia-it.com>
Cc: toasters@teaparty.net
Betreff: Re: X1144A - No link

 

Hey Alexander,

Curious if you solved this issue. 

I'm running into the same thing, but using copper QSFP NetApp cables.

I have several FAS9000s with X91440A-C dual-port 40GbE cards, connecting to X190001 (Cisco 3132Q-V cluster net switches) via 3 meter copper X66100-3 40GbE QSFP cables.

No link on either the filers, or the switches.  

The switches see the cables are inserted, but have status 'notconnec'.  The ISL trunk connections between switches (ports 31/32 listed here) are working though:

Ports 7 and 8 listed here are going back to the filers, and that's where I'm hoping to get link, but no luck.

pd-cluster-switch-2# show interface status

--------------------------------------------------------------------------------
Port          Name               Status    Vlan      Duplex  Speed   Type
--------------------------------------------------------------------------------
mgmt0         --                 connected routed    full    1000    --
Eth1/1/1      10GbE Node Port    xcvrAbsen 1         auto    auto    --
Eth1/1/2      10GbE Node Port    xcvrAbsen 1         auto    auto    --
...
Eth1/7        40GbE Node Port    notconnec 1         auto    auto    QSFP-40G-CR4
Eth1/8        40GbE Node Port    notconnec 1         auto    auto    QSFP-40G-CR4
Eth1/9        40GbE Node Port    xcvrAbsen 1         auto    auto    --
Eth1/10       40GbE Node Port    xcvrAbsen 1         auto    auto    --
...
Eth1/29       40GbE Node Port    xcvrAbsen 1         auto    auto    --
Eth1/30       40GbE Node Port    xcvrAbsen 1         auto    auto    --
Eth1/31       Inter-Cluster Swit connected trunk     full    40G     QSFP-40G-CR4
Eth1/32       Inter-Cluster Swit connected trunk     full    40G     QSFP-40G-CR4
Po1           --                 connected trunk     full    40G     --

Sysconfig for the card in question:

        slot 4: 40 Gigabit Ethernet Controller XL710 QSFP+
                e4a MAC Address:    00:a0:98:c5:e3:3c (auto-unknown-down)
                e4e MAC Address:    00:a0:98:c5:e3:40 (auto-unknown-down)
                Device Type:        XL710 B1
                Firmware Version:   nvm 5.04 etid 8000250c
                Part Number:        111-02590
                Hardware Revision:  A2
                Serial Number:      031648001359

Just upgraded from 9.1 to 9.1p2 in hopes that might have some effect, but no change.

I'm stumped.