OK guys, here’s the update.
The TLDR version: It’s working now, we switched ports.
The more detailed version, this was my old port layout (C = Cluster, D = Data, F = FibreChannel):
e0a (C) e0c (C) e1a (F)
e0b (D) e0d (D) e1b (F)
Now after recabling, I have this configuration:
e0a (C) e0c (F) e1a (D)
e0b (C) e0d (F) e1b (D)
And this one was working immediately, FLOGI on the FC switch, I can see all devices (vservers and physical nodes), everything up/up as it should be.
The funny (or not really funny) thing is, that I used ConfigAdvisor 3.4 to set up this system and it felt perfectly OK with the above configuration.
Now after recabling I wanted to run ConfigAdvisor again and got the hint, that the new version 3.5 is out – so I did update my version just to see that it now says that my cabling is invalid, because 3.5 correctly
tells us, that e0a and e0b (although on the same ASIC) need to be the cluster ports on a FAS8020.
Also ConfigAdvisor 3.4 told me that my SAS cabling was OK, and 3.5 now tells me that my SAS cabling is wrong – joy.
Gotta find out what the problem with the SAS cables is now, but the FC topic has been solved by just switching ports.
The problem was an incompatibility with the FC SFPs I got and the UTA extension card, they do not work together and have to be deployed in the onboard UTA ports.
Thanks again for all your help,
best,
Alexander Griesser
System-Administrator
ANEXIA Internetdienstleistungs GmbH
Telefon: +43-5-0556-320
Telefax: +43-5-0556-500
E-Mail:
ag@anexia.at
Web:
http://www.anexia.at
Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt
Geschäftsführer: Alexander Windbichler
Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601
Von: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net]
Im Auftrag von Alexander Griesser
Gesendet: Donnerstag, 12. Juni 2014 12:55
An: Duncan Cummings; Borzenkov, Andrei
Cc: Toasters
Betreff: AW: FCP Ports operational down
Duncan,
thanks – I’ve already evaluated this BURT and we verified that I am not affected by that.
I did, nevertheless, follow the instructions in the BURT to regenerate my WWNs, but to no avail.
Right now it looks like we got supplied the wrong FC SFPs…
Alexander Griesser
System-Administrator
ANEXIA Internetdienstleistungs GmbH
Telefon: +43-5-0556-320
Telefax: +43-5-0556-500
E-Mail:
ag@anexia.at
Web:
http://www.anexia.at
Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt
Geschäftsführer: Alexander Windbichler
Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601
Von: Duncan Cummings [mailto:dcummings@interactive.com.au]
Gesendet: Donnerstag, 12. Juni 2014 12:53
An: Alexander Griesser; Borzenkov, Andrei
Cc: Toasters
Betreff: RE: FCP Ports operational down
Alexander,
You may have run into Burt 818251 where both nodes of a cDOT HA pair are returning the same WWNN.
You can check this with
cluster::> network fcp adapter show -fields fc-wwpn
Duncan Cummings
NetApp Specialist
Interactive Pty Ltd
Telephone 07 3323 0800
Facsimile 07 3323 0899
Mobile 0403 383 050
www.interactive.com.au
-------Confidentiality & Legal Privilege-------------
"This email is intended for the named recipient only. The information contained in this message may be confidential, or commercially sensitive. If you are not the intended recipient you must not reproduce or distribute any part of the email, disclose its contents
to any other party, or take any action in reliance on it. If you have received this email in error, please contact the sender immediately. Please delete this message from your computer. Confidentiality and legal privilege are not waived or lost by reason of
mistaken delivery to you."
From:
toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net]
On Behalf Of Alexander Griesser
Sent: Wednesday, 11 June 2014 3:51 AM
To: Borzenkov, Andrei
Cc: Toasters
Subject: AW: FCP Ports operational down
Thanks for all your input so far – will keep you posted on the outcome, but for now it seems as if I got wrong SFP transceivers due to an error in the quoting tool…
New transceivers should be there by tomorrow hopefully.
Alexander Griesser
System-Administrator
ANEXIA Internetdienstleistungs GmbH
Telefon: +43-5-0556-320
Telefax: +43-5-0556-500
E-Mail:
ag@anexia.at
Web:
http://www.anexia.at
Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt
Geschäftsführer: Alexander Windbichler
Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601
Von: Borzenkov, Andrei [mailto:andrei.borzenkov@ts.fujitsu.com]
Gesendet: Dienstag, 10. Juni 2014 08:22
An: Alexander Griesser
Cc: Toasters
Betreff: Re: FCP Ports operational down
Brocade shows "no light" and NetApp shows "not connected" which suggests some issues on physical level. Did you verify that brocade port is using multi-mode transceiver and also you do not accidentally use single mode cable?
Отправлено с iPhone
09 июня 2014 г., в 15:43, "Alexander Griesser" <ag@anexia.at> написал(а):
Hi there,
I’m having a hard time currently connecting my new FAS8020 to our existing fabric – the FCP ports just won‘t get online and I’m not sure where exactly the problem is and how to debug that since I’m more the NAS guy not having much practical experience with FCP configurations, so here’s the deal for all of you who are wanting to help.
FAS8020 Clustered Data Ontap 8.2.1
Brocade DS4900B
Brocade Switchport:
> portcfgshow 0
Area Number: 0
Speed Level: AUTO(HW)
Fill Word: 0(Idle-Idle)
AL_PA Offset 13: OFF
Trunk Port ON
Long Distance OFF
VC Link Init OFF
Locked L_Port OFF
Locked G_Port OFF
Disabled E_Port OFF
Locked E_Port OFF
ISL R_RDY Mode OFF
RSCN Suppressed OFF
Persistent Disable OFF
LOS TOV enable OFF
NPIV capability ON
QOS E_Port OFF
Port Auto Disable: OFF
Mirror Port OFF
F_Port Buffers OFF
Fault Delay: 0(R_A_TOV)
NPIV PP Limit: 126
> portshow 0
portIndex: 0
portName:
portHealth: OFFLINE
Authentication: None
portDisableReason: None
portCFlags: 0x1
portFlags: 0x1 PRESENT U_PORT
LocalSwcFlags: 0x0
portType: 10.0
POD Port: Port is licensed
portState: 2 Offline
Protocol: FC
portPhys: 4 No_Light portScn: 0
port generation number: 0
state transition count: 0
portId: 010000
portIfId: 4302100d
portWwn: 20:00:00:05:1e:5b:f9:a3
portWwn of device(s) connected:
Distance: normal
portSpeed: N4Gbps
LE domain: 0
FC Fastwrite: OFF
Interrupts: 2 Link_failure: 0 Frjt: 0
Unknown: 0 Loss_of_sync: 0 Fbsy: 0
Lli: 2 Loss_of_sig: 2
Proc_rqrd: 5 Protocol_err: 0
Timed_out: 0 Invalid_word: 0
Rx_flushed: 0 Invalid_crc: 0
Tx_unavail: 0 Delim_err: 0
Free_buffer: 0 Address_err: 0
Overrun: 0 Lr_in: 0
Suspended: 0 Lr_out: 0
Parity_err: 0 Ols_in: 0
2_parity_err: 0 Ols_out: 0
CMI_bus_err: 0
Port part of other ADs: No
FCP Adater on NetApp:
Node: jetfire
Adapter: 1b
Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G)
Physical Protocol: fibre-channel
Maximum Speed: 16
Status: link not connected
Substatus: ADAPTER UP
Host Port Address: 0
Firmware Revision: 6.10.0
Data Link Rate (Gbit): 0
Fabric Established: false
Connection Established: loop
Mediatype: ptp
Configured Speed: 4
Configured State: up
Switch Port: :
AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.
So, I have no idea what information I should provide upfront for someone who’s wanting to help me through get through that, but I’m more than happy to send more info when requested.
Thanks,
Alexander Griesser
System-Administrator
ANEXIA Internetdienstleistungs GmbH
Telefon: +43-5-0556-320
Telefax: +43-5-0556-500
E-Mail: ag@anexia.at
Web: http://www.anexia.at
Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt
Geschäftsführer: Alexander Windbichler
Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601
_______________________________________________
Toasters mailing list
Toasters@teaparty.net
http://www.teaparty.net/mailman/listinfo/toasters