AW: FCP Ports operational down

You can’t. This is what NetApp support forces me to use and what the shiny and new ConfigAdvisor 3.5 tells you you have to do.

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: tmac [mailto:tmacmd@gmail.com] Gesendet: Dienstag, 17. Juni 2014 00:09 An: Alexander Griesser Cc: Duncan Cummings; Borzenkov, Andrei; Toasters Betreff: Re: FCP Ports operational down

You should re-cable again ;)

It is not advisable to have the same components on the same bridge:

e0a/e0b are on the same bridge (you have them both as cluster ports) e0c/e0d are on the same bridge (you have them as FC ports) e1a/e1b may be on the same bridge if this is a 4-port card (you have them as data).

You really should split them up across bridges/adapters for better failover scenarios.

--tmac

Tim McCarthy Principal Consultant

[Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.]

Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE6 110-107-141https://www.redhat.com/wapps/training/certification/verify.html?certNumber=110-107-141&isSearch=False&verify=Verify NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Current until Aug 02, 2016 Expires: 08 November 2014

On Mon, Jun 16, 2014 at 5:50 PM, Alexander Griesser <ag@anexia.atmailto:ag@anexia.at> wrote: OK guys, here’s the update. The TLDR version: It’s working now, we switched ports.

The more detailed version, this was my old port layout (C = Cluster, D = Data, F = FibreChannel):

e0a (C) e0c (C) e1a (F) e0b (D) e0d (D) e1b (F)

Now after recabling, I have this configuration:

e0a (C) e0c (F) e1a (D) e0b (C) e0d (F) e1b (D)

And this one was working immediately, FLOGI on the FC switch, I can see all devices (vservers and physical nodes), everything up/up as it should be. The funny (or not really funny) thing is, that I used ConfigAdvisor 3.4 to set up this system and it felt perfectly OK with the above configuration. Now after recabling I wanted to run ConfigAdvisor again and got the hint, that the new version 3.5 is out – so I did update my version just to see that it now says that my cabling is invalid, because 3.5 correctly tells us, that e0a and e0b (although on the same ASIC) need to be the cluster ports on a FAS8020.

Also ConfigAdvisor 3.4 told me that my SAS cabling was OK, and 3.5 now tells me that my SAS cabling is wrong – joy.

Gotta find out what the problem with the SAS cables is now, but the FC topic has been solved by just switching ports. The problem was an incompatibility with the FC SFPs I got and the UTA extension card, they do not work together and have to be deployed in the onboard UTA ports.

Thanks again for all your help, best,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net] Im Auftrag von Alexander Griesser Gesendet: Donnerstag, 12. Juni 2014 12:55 An: Duncan Cummings; Borzenkov, Andrei Cc: Toasters Betreff: AW: FCP Ports operational down

Duncan,

thanks – I’ve already evaluated this BURT and we verified that I am not affected by that. I did, nevertheless, follow the instructions in the BURT to regenerate my WWNs, but to no avail. Right now it looks like we got supplied the wrong FC SFPs…

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Duncan Cummings [mailto:dcummings@interactive.com.au] Gesendet: Donnerstag, 12. Juni 2014 12:53 An: Alexander Griesser; Borzenkov, Andrei Cc: Toasters Betreff: RE: FCP Ports operational down

Alexander,

You may have run into Burt 818251 where both nodes of a cDOT HA pair are returning the same WWNN.

You can check this with

cluster::> network fcp adapter show -fields fc-wwpn

Duncan Cummings NetApp Specialist Interactive Pty Ltd Telephone 07 3323 0800 Facsimile 07 3323 0899 Mobile 0403 383 050 www.interactive.com.auhttp://www.interactive.com.au

-------Confidentiality & Legal Privilege------------- "This email is intended for the named recipient only. The information contained in this message may be confidential, or commercially sensitive. If you are not the intended recipient you must not reproduce or distribute any part of the email, disclose its contents to any other party, or take any action in reliance on it. If you have received this email in error, please contact the sender immediately. Please delete this message from your computer. Confidentiality and legal privilege are not waived or lost by reason of mistaken delivery to you." From: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Alexander Griesser Sent: Wednesday, 11 June 2014 3:51 AM To: Borzenkov, Andrei Cc: Toasters Subject: AW: FCP Ports operational down

Thanks for all your input so far – will keep you posted on the outcome, but for now it seems as if I got wrong SFP transceivers due to an error in the quoting tool… New transceivers should be there by tomorrow hopefully.

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Borzenkov, Andrei [mailto:andrei.borzenkov@ts.fujitsu.com] Gesendet: Dienstag, 10. Juni 2014 08:22 An: Alexander Griesser Cc: Toasters Betreff: Re: FCP Ports operational down

Brocade shows "no light" and NetApp shows "not connected" which suggests some issues on physical level. Did you verify that brocade port is using multi-mode transceiver and also you do not accidentally use single mode cable?

Отправлено с iPhone

09 июня 2014 г., в 15:43, "Alexander Griesser" <ag@anexia.atmailto:ag@anexia.at> написал(а): Hi there,

I’m having a hard time currently connecting my new FAS8020 to our existing fabric – the FCP ports just won‘t get online and I’m not sure where exactly the problem is and how to debug that since I’m more the NAS guy not having much practical experience with FCP configurations, so here’s the deal for all of you who are wanting to help.

FAS8020 Clustered Data Ontap 8.2.1 Brocade DS4900B

Brocade Switchport:

portcfgshow 0

Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

portshow 0

portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1 PRESENT U_PORT LocalSwcFlags: 0x0 portType: 10.0 POD Port: Port is licensed portState: 2 Offline Protocol: FC portPhys: 4 No_Light portScn: 0 port generation number: 0 state transition count: 0

portId: 010000 portIfId: 4302100d portWwn: 20:00:00:05:1e:5b:f9:a3 portWwn of device(s) connected:

Distance: normal portSpeed: N4Gbps

LE domain: 0 FC Fastwrite: OFF Interrupts: 2 Link_failure: 0 Frjt: 0 Unknown: 0 Loss_of_sync: 0 Fbsy: 0 Lli: 2 Loss_of_sig: 2 Proc_rqrd: 5 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 0 Suspended: 0 Lr_out: 0 Parity_err: 0 Ols_in: 0 2_parity_err: 0 Ols_out: 0 CMI_bus_err: 0

Port part of other ADs: No

FCP Adater on NetApp:

Node: jetfire Adapter: 1b Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G) Physical Protocol: fibre-channel Maximum Speed: 16 Status: link not connected Substatus: ADAPTER UP Host Port Address: 0 Firmware Revision: 6.10.0 Data Link Rate (Gbit): 0 Fabric Established: false Connection Established: loop Mediatype: ptp Configured Speed: 4 Configured State: up Switch Port: :

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

So, I have no idea what information I should provide upfront for someone who’s wanting to help me through get through that, but I’m more than happy to send more info when requested.

Thanks,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters