Thanks,

how can I check besides looking at the portcfgshow output?

portcCNX011:admin> portcfgshow 0 Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: tmac [mailto:tmacmd@gmail.com] Gesendet: Montag, 09. Juni 2014 15:43 An: Alexander Griesser Cc: Toasters Betreff: Re: FCP Ports operational down

Make sure NPIV is enabled on your FC switch!!!!

--tmac

Tim McCarthy Principal Consultant

[Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.]

Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE6 110-107-141https://www.redhat.com/wapps/training/certification/verify.html?certNumber=110-107-141&isSearch=False&verify=Verify NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Current until Aug 02, 2016 Expires: 08 November 2014

On Mon, Jun 9, 2014 at 9:35 AM, Alexander Griesser <ag@anexia.atmailto:ag@anexia.at> wrote: Hi there,

I'm having a hard time currently connecting my new FAS8020 to our existing fabric - the FCP ports just won't get online and I'm not sure where exactly the problem is and how to debug that since I'm more the NAS guy not having much practical experience with FCP configurations, so here's the deal for all of you who are wanting to help.

FAS8020 Clustered Data Ontap 8.2.1 Brocade DS4900B

Brocade Switchport:

portcfgshow 0

Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

portshow 0

portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1 PRESENT U_PORT LocalSwcFlags: 0x0 portType: 10.0 POD Port: Port is licensed portState: 2 Offline Protocol: FC portPhys: 4 No_Light portScn: 0 port generation number: 0 state transition count: 0

portId: 010000 portIfId: 4302100d portWwn: 20:00:00:05:1e:5b:f9:a3 portWwn of device(s) connected:

Distance: normal portSpeed: N4Gbps

LE domain: 0 FC Fastwrite: OFF Interrupts: 2 Link_failure: 0 Frjt: 0 Unknown: 0 Loss_of_sync: 0 Fbsy: 0 Lli: 2 Loss_of_sig: 2 Proc_rqrd: 5 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 0 Suspended: 0 Lr_out: 0 Parity_err: 0 Ols_in: 0 2_parity_err: 0 Ols_out: 0 CMI_bus_err: 0

Port part of other ADs: No

FCP Adater on NetApp:

Node: jetfire Adapter: 1b Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G) Physical Protocol: fibre-channel Maximum Speed: 16 Status: link not connected Substatus: ADAPTER UP Host Port Address: 0 Firmware Revision: 6.10.0 Data Link Rate (Gbit): 0 Fabric Established: false Connection Established: loop Mediatype: ptp Configured Speed: 4 Configured State: up Switch Port: :

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

So, I have no idea what information I should provide upfront for someone who's wanting to help me through get through that, but I'm more than happy to send more info when requested.

Thanks,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

A vserver has already been created and lifs have also been assigned to it:

ANX04-AUTOBOTS::> net int show -vserver vFCP_jetfire01 (network interface show) Logical Status Network Current Current Is Vserver Interface Admin/Oper Address/Mask Node Port Home ----------- ---------- ---------- ------------------ ------------- ------- ---- vFCP_jetfire01 vFCP_jetfire01_01 up/down 20:06:00:a0:98:58:75:bb jetfire 1b true vFCP_jetfire01_02 up/down 20:07:00:a0:98:58:75:bb smokescreen 1b true 2 entries were displayed.

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: tmac [mailto:tmacmd@gmail.com] Gesendet: Montag, 09. Juni 2014 15:45 An: Alexander Griesser Cc: Toasters Betreff: Re: FCP Ports operational down

Also, I think the ports won't come online until: you add them into a SVM Add appropriate zoning to the switch

(I see NPIV is on...)

Try sending the output of "net int show"

Scrub off the IP info if you need to.

--tmac

Tim McCarthy Principal Consultant 443-228-TMAC (Google Voice) 214-279-3926 (eFAX)

[Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.]

Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE6 110-107-141https://www.redhat.com/wapps/training/certification/verify.html?certNumber=110-107-141&isSearch=False&verify=Verify NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Current until Aug 02, 2016 Expires: 08 November 2014

On Mon, Jun 9, 2014 at 9:42 AM, tmac <tmacmd@gmail.commailto:tmacmd@gmail.com> wrote: Make sure NPIV is enabled on your FC switch!!!!

--tmac

Tim McCarthy Principal Consultant

[Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.]

Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE6 110-107-141https://www.redhat.com/wapps/training/certification/verify.html?certNumber=110-107-141&isSearch=False&verify=Verify NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Current until Aug 02, 2016 Expires: 08 November 2014

On Mon, Jun 9, 2014 at 9:35 AM, Alexander Griesser <ag@anexia.atmailto:ag@anexia.at> wrote: Hi there,

I'm having a hard time currently connecting my new FAS8020 to our existing fabric - the FCP ports just won't get online and I'm not sure where exactly the problem is and how to debug that since I'm more the NAS guy not having much practical experience with FCP configurations, so here's the deal for all of you who are wanting to help.

FAS8020 Clustered Data Ontap 8.2.1 Brocade DS4900B

Brocade Switchport:

portcfgshow 0

Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

portshow 0

portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1 PRESENT U_PORT LocalSwcFlags: 0x0 portType: 10.0 POD Port: Port is licensed portState: 2 Offline Protocol: FC portPhys: 4 No_Light portScn: 0 port generation number: 0 state transition count: 0

portId: 010000 portIfId: 4302100d portWwn: 20:00:00:05:1e:5b:f9:a3 portWwn of device(s) connected:

Distance: normal portSpeed: N4Gbps

LE domain: 0 FC Fastwrite: OFF Interrupts: 2 Link_failure: 0 Frjt: 0 Unknown: 0 Loss_of_sync: 0 Fbsy: 0 Lli: 2 Loss_of_sig: 2 Proc_rqrd: 5 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 0 Suspended: 0 Lr_out: 0 Parity_err: 0 Ols_in: 0 2_parity_err: 0 Ols_out: 0 CMI_bus_err: 0

Port part of other ADs: No

FCP Adater on NetApp:

Node: jetfire Adapter: 1b Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G) Physical Protocol: fibre-channel Maximum Speed: 16 Status: link not connected Substatus: ADAPTER UP Host Port Address: 0 Firmware Revision: 6.10.0 Data Link Rate (Gbit): 0 Fabric Established: false Connection Established: loop Mediatype: ptp Configured Speed: 4 Configured State: up Switch Port: :

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

So, I have no idea what information I should provide upfront for someone who's wanting to help me through get through that, but I'm more than happy to send more info when requested.

Thanks,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

Thanks, trunk has been disabled now on both ports going to my controllers – I also did disable and enable the port afterwards on the Brocade, still no change.

CNX011:admin> portcfgshow 0 Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port OFF Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

My port seems to be a U_PORT by default, according to portshow:

CNX011:admin> portshow 0 portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x41 PRESENT U_PORT

To configure an N_PORT, I would need to change the switchmode to access gateway mode which is probably not what I want I guess – cannot find config commands that would allow me to force this port into F_MODE.

I’ve connected a client host already to the same switch and this one came up immediately with the following config:

CNX011:admin> portshow 2 portIndex: 2 portName: portHealth: HEALTHY

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1000090b PRESENT ACTIVE E_PORT G_PORT LOGICAL_ONLINE LOGIN

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Adam Levin [mailto:levins0@gmail.com] Gesendet: Montag, 09. Juni 2014 15:50 An: Alexander Griesser Cc: Toasters Betreff: Re: FCP Ports operational down

I'm not too familiar with Brocades -- we have Cisco -- but the first thing that caught my eye was trunk port being enabled. I don't think you want that, especially also for NPIV. You need an F port or an N port, not an E port.

E ports are expansion ports, for ISL (inter-switch linking), and connect two switches together. F ports are fabric ports, and are used for point-to-point connections (hosts, storage systems, etc). N ports are node ports, similar to F ports, used for point-to-point or switched fabrics.

For you, Fx or G port types should also work, and I think Brocades have U ports too, but I'm not too familiar.

-Adam

On Mon, Jun 9, 2014 at 9:35 AM, Alexander Griesser <ag@anexia.atmailto:ag@anexia.at> wrote: Hi there,

I’m having a hard time currently connecting my new FAS8020 to our existing fabric – the FCP ports just won‘t get online and I’m not sure where exactly the problem is and how to debug that since I’m more the NAS guy not having much practical experience with FCP configurations, so here’s the deal for all of you who are wanting to help.

FAS8020 Clustered Data Ontap 8.2.1 Brocade DS4900B

Brocade Switchport:

portcfgshow 0

Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

portshow 0

portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1 PRESENT U_PORT LocalSwcFlags: 0x0 portType: 10.0 POD Port: Port is licensed portState: 2 Offline Protocol: FC portPhys: 4 No_Light portScn: 0 port generation number: 0 state transition count: 0

portId: 010000 portIfId: 4302100d portWwn: 20:00:00:05:1e:5b:f9:a3 portWwn of device(s) connected:

Distance: normal portSpeed: N4Gbps

LE domain: 0 FC Fastwrite: OFF Interrupts: 2 Link_failure: 0 Frjt: 0 Unknown: 0 Loss_of_sync: 0 Fbsy: 0 Lli: 2 Loss_of_sig: 2 Proc_rqrd: 5 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 0 Suspended: 0 Lr_out: 0 Parity_err: 0 Ols_in: 0 2_parity_err: 0 Ols_out: 0 CMI_bus_err: 0

Port part of other ADs: No

FCP Adater on NetApp:

Node: jetfire Adapter: 1b Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G) Physical Protocol: fibre-channel Maximum Speed: 16 Status: link not connected Substatus: ADAPTER UP Host Port Address: 0 Firmware Revision: 6.10.0 Data Link Rate (Gbit): 0 Fabric Established: false Connection Established: loop Mediatype: ptp Configured Speed: 4 Configured State: up Switch Port: :

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

So, I have no idea what information I should provide upfront for someone who’s wanting to help me through get through that, but I’m more than happy to send more info when requested.

Thanks,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

I cannot see the FCP adapters on the nodeshell anymore - with "storage show adapter" I can only see the SAS ports on the node.

But I've resetted the FCP adapters on the cluster shell using these commands:

# Bring down the LIFs network interface modify -vserver vFCP_jetfire01 -lif * -status-admin down

# Shut down the physical adapters network fcp adapter modify -node * -adapter 1b -state down network fcp adapter modify -node * -adapter 1a -state down

# Bring up the physical adapters network fcp adapter modify -node * -adapter 1a -state up network fcp adapter modify -node * -adapter 1b -state up

# Bring up the LIFs network interface modify -vserver vFCP_jetfire01 -lif * -status-admin up

Status is still the same though :-/

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: tmac [mailto:tmacmd@gmail.com] Gesendet: Montag, 09. Juni 2014 15:59 An: Adam Levin Cc: Alexander Griesser; Toasters Betreff: Re: FCP Ports operational down

I agree.

After you make the change, you may need to disable/enable the ports. I suspect, it would be best to do that from the nodeshell

system node run -node xxx nodeshell> storage disable adapter 1b nodeshell> storage enable adapter 1b

I foget the commands offhand, but you may want to FORCE the speed to 4Gig also.

--tmac

Tim McCarthy Principal Consultant

[Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.]

Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE6 110-107-141https://www.redhat.com/wapps/training/certification/verify.html?certNumber=110-107-141&isSearch=False&verify=Verify NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Current until Aug 02, 2016 Expires: 08 November 2014

On Mon, Jun 9, 2014 at 9:50 AM, Adam Levin <levins0@gmail.commailto:levins0@gmail.com> wrote: I'm not too familiar with Brocades -- we have Cisco -- but the first thing that caught my eye was trunk port being enabled. I don't think you want that, especially also for NPIV. You need an F port or an N port, not an E port.

E ports are expansion ports, for ISL (inter-switch linking), and connect two switches together. F ports are fabric ports, and are used for point-to-point connections (hosts, storage systems, etc). N ports are node ports, similar to F ports, used for point-to-point or switched fabrics.

For you, Fx or G port types should also work, and I think Brocades have U ports too, but I'm not too familiar.

-Adam

On Mon, Jun 9, 2014 at 9:35 AM, Alexander Griesser <ag@anexia.atmailto:ag@anexia.at> wrote: Hi there,

I'm having a hard time currently connecting my new FAS8020 to our existing fabric - the FCP ports just won't get online and I'm not sure where exactly the problem is and how to debug that since I'm more the NAS guy not having much practical experience with FCP configurations, so here's the deal for all of you who are wanting to help.

FAS8020 Clustered Data Ontap 8.2.1 Brocade DS4900B

Brocade Switchport:

portcfgshow 0

Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

portshow 0

portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1 PRESENT U_PORT LocalSwcFlags: 0x0 portType: 10.0 POD Port: Port is licensed portState: 2 Offline Protocol: FC portPhys: 4 No_Light portScn: 0 port generation number: 0 state transition count: 0

portId: 010000 portIfId: 4302100d portWwn: 20:00:00:05:1e:5b:f9:a3 portWwn of device(s) connected:

Distance: normal portSpeed: N4Gbps

LE domain: 0 FC Fastwrite: OFF Interrupts: 2 Link_failure: 0 Frjt: 0 Unknown: 0 Loss_of_sync: 0 Fbsy: 0 Lli: 2 Loss_of_sig: 2 Proc_rqrd: 5 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 0 Suspended: 0 Lr_out: 0 Parity_err: 0 Ols_in: 0 2_parity_err: 0 Ols_out: 0 CMI_bus_err: 0

Port part of other ADs: No

FCP Adater on NetApp:

Node: jetfire Adapter: 1b Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G) Physical Protocol: fibre-channel Maximum Speed: 16 Status: link not connected Substatus: ADAPTER UP Host Port Address: 0 Firmware Revision: 6.10.0 Data Link Rate (Gbit): 0 Fabric Established: false Connection Established: loop Mediatype: ptp Configured Speed: 4 Configured State: up Switch Port: :

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

So, I have no idea what information I should provide upfront for someone who's wanting to help me through get through that, but I'm more than happy to send more info when requested.

Thanks,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

Alexander,

You may have run into Burt 818251 where both nodes of a cDOT HA pair are returning the same WWNN.

You can check this with

cluster::> network fcp adapter show -fields fc-wwpn

Duncan Cummings NetApp Specialist Interactive Pty Ltd Telephone 07 3323 0800 Facsimile 07 3323 0899 Mobile 0403 383 050 www.interactive.com.auhttp://www.interactive.com.au

-------Confidentiality & Legal Privilege------------- "This email is intended for the named recipient only. The information contained in this message may be confidential, or commercially sensitive. If you are not the intended recipient you must not reproduce or distribute any part of the email, disclose its contents to any other party, or take any action in reliance on it. If you have received this email in error, please contact the sender immediately. Please delete this message from your computer. Confidentiality and legal privilege are not waived or lost by reason of mistaken delivery to you." From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Alexander Griesser Sent: Wednesday, 11 June 2014 3:51 AM To: Borzenkov, Andrei Cc: Toasters Subject: AW: FCP Ports operational down

Thanks for all your input so far – will keep you posted on the outcome, but for now it seems as if I got wrong SFP transceivers due to an error in the quoting tool… New transceivers should be there by tomorrow hopefully.

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Borzenkov, Andrei [mailto:andrei.borzenkov@ts.fujitsu.com] Gesendet: Dienstag, 10. Juni 2014 08:22 An: Alexander Griesser Cc: Toasters Betreff: Re: FCP Ports operational down

Brocade shows "no light" and NetApp shows "not connected" which suggests some issues on physical level. Did you verify that brocade port is using multi-mode transceiver and also you do not accidentally use single mode cable?

Отправлено с iPhone

09 июня 2014 г., в 15:43, "Alexander Griesser" <ag@anexia.atmailto:ag@anexia.at> написал(а): Hi there,

I’m having a hard time currently connecting my new FAS8020 to our existing fabric – the FCP ports just won‘t get online and I’m not sure where exactly the problem is and how to debug that since I’m more the NAS guy not having much practical experience with FCP configurations, so here’s the deal for all of you who are wanting to help.

FAS8020 Clustered Data Ontap 8.2.1 Brocade DS4900B

Brocade Switchport:

portcfgshow 0

Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

portshow 0

portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1 PRESENT U_PORT LocalSwcFlags: 0x0 portType: 10.0 POD Port: Port is licensed portState: 2 Offline Protocol: FC portPhys: 4 No_Light portScn: 0 port generation number: 0 state transition count: 0

portId: 010000 portIfId: 4302100d portWwn: 20:00:00:05:1e:5b:f9:a3 portWwn of device(s) connected:

Distance: normal portSpeed: N4Gbps

LE domain: 0 FC Fastwrite: OFF Interrupts: 2 Link_failure: 0 Frjt: 0 Unknown: 0 Loss_of_sync: 0 Fbsy: 0 Lli: 2 Loss_of_sig: 2 Proc_rqrd: 5 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 0 Suspended: 0 Lr_out: 0 Parity_err: 0 Ols_in: 0 2_parity_err: 0 Ols_out: 0 CMI_bus_err: 0

Port part of other ADs: No

FCP Adater on NetApp:

Node: jetfire Adapter: 1b Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G) Physical Protocol: fibre-channel Maximum Speed: 16 Status: link not connected Substatus: ADAPTER UP Host Port Address: 0 Firmware Revision: 6.10.0 Data Link Rate (Gbit): 0 Fabric Established: false Connection Established: loop Mediatype: ptp Configured Speed: 4 Configured State: up Switch Port: :

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

So, I have no idea what information I should provide upfront for someone who’s wanting to help me through get through that, but I’m more than happy to send more info when requested.

Thanks,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

OK guys, here’s the update. The TLDR version: It’s working now, we switched ports.

The more detailed version, this was my old port layout (C = Cluster, D = Data, F = FibreChannel):

e0a (C) e0c (C) e1a (F) e0b (D) e0d (D) e1b (F)

Now after recabling, I have this configuration:

e0a (C) e0c (F) e1a (D) e0b (C) e0d (F) e1b (D)

And this one was working immediately, FLOGI on the FC switch, I can see all devices (vservers and physical nodes), everything up/up as it should be. The funny (or not really funny) thing is, that I used ConfigAdvisor 3.4 to set up this system and it felt perfectly OK with the above configuration. Now after recabling I wanted to run ConfigAdvisor again and got the hint, that the new version 3.5 is out – so I did update my version just to see that it now says that my cabling is invalid, because 3.5 correctly tells us, that e0a and e0b (although on the same ASIC) need to be the cluster ports on a FAS8020.

Also ConfigAdvisor 3.4 told me that my SAS cabling was OK, and 3.5 now tells me that my SAS cabling is wrong – joy.

Gotta find out what the problem with the SAS cables is now, but the FC topic has been solved by just switching ports. The problem was an incompatibility with the FC SFPs I got and the UTA extension card, they do not work together and have to be deployed in the onboard UTA ports.

Thanks again for all your help, best,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] Im Auftrag von Alexander Griesser Gesendet: Donnerstag, 12. Juni 2014 12:55 An: Duncan Cummings; Borzenkov, Andrei Cc: Toasters Betreff: AW: FCP Ports operational down

Duncan,

thanks – I’ve already evaluated this BURT and we verified that I am not affected by that. I did, nevertheless, follow the instructions in the BURT to regenerate my WWNs, but to no avail. Right now it looks like we got supplied the wrong FC SFPs…

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Duncan Cummings [mailto:dcummings@interactive.com.au] Gesendet: Donnerstag, 12. Juni 2014 12:53 An: Alexander Griesser; Borzenkov, Andrei Cc: Toasters Betreff: RE: FCP Ports operational down

Alexander,

You may have run into Burt 818251 where both nodes of a cDOT HA pair are returning the same WWNN.

You can check this with

cluster::> network fcp adapter show -fields fc-wwpn

Duncan Cummings NetApp Specialist Interactive Pty Ltd Telephone 07 3323 0800 Facsimile 07 3323 0899 Mobile 0403 383 050 www.interactive.com.auhttp://www.interactive.com.au

-------Confidentiality & Legal Privilege------------- "This email is intended for the named recipient only. The information contained in this message may be confidential, or commercially sensitive. If you are not the intended recipient you must not reproduce or distribute any part of the email, disclose its contents to any other party, or take any action in reliance on it. If you have received this email in error, please contact the sender immediately. Please delete this message from your computer. Confidentiality and legal privilege are not waived or lost by reason of mistaken delivery to you." From: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Alexander Griesser Sent: Wednesday, 11 June 2014 3:51 AM To: Borzenkov, Andrei Cc: Toasters Subject: AW: FCP Ports operational down

Thanks for all your input so far – will keep you posted on the outcome, but for now it seems as if I got wrong SFP transceivers due to an error in the quoting tool… New transceivers should be there by tomorrow hopefully.

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Borzenkov, Andrei [mailto:andrei.borzenkov@ts.fujitsu.com] Gesendet: Dienstag, 10. Juni 2014 08:22 An: Alexander Griesser Cc: Toasters Betreff: Re: FCP Ports operational down

Brocade shows "no light" and NetApp shows "not connected" which suggests some issues on physical level. Did you verify that brocade port is using multi-mode transceiver and also you do not accidentally use single mode cable?

Отправлено с iPhone

09 июня 2014 г., в 15:43, "Alexander Griesser" <ag@anexia.atmailto:ag@anexia.at> написал(а): Hi there,

I’m having a hard time currently connecting my new FAS8020 to our existing fabric – the FCP ports just won‘t get online and I’m not sure where exactly the problem is and how to debug that since I’m more the NAS guy not having much practical experience with FCP configurations, so here’s the deal for all of you who are wanting to help.

FAS8020 Clustered Data Ontap 8.2.1 Brocade DS4900B

Brocade Switchport:

portcfgshow 0

Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

portshow 0

portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1 PRESENT U_PORT LocalSwcFlags: 0x0 portType: 10.0 POD Port: Port is licensed portState: 2 Offline Protocol: FC portPhys: 4 No_Light portScn: 0 port generation number: 0 state transition count: 0

portId: 010000 portIfId: 4302100d portWwn: 20:00:00:05:1e:5b:f9:a3 portWwn of device(s) connected:

Distance: normal portSpeed: N4Gbps

LE domain: 0 FC Fastwrite: OFF Interrupts: 2 Link_failure: 0 Frjt: 0 Unknown: 0 Loss_of_sync: 0 Fbsy: 0 Lli: 2 Loss_of_sig: 2 Proc_rqrd: 5 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 0 Suspended: 0 Lr_out: 0 Parity_err: 0 Ols_in: 0 2_parity_err: 0 Ols_out: 0 CMI_bus_err: 0

Port part of other ADs: No

FCP Adater on NetApp:

Node: jetfire Adapter: 1b Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G) Physical Protocol: fibre-channel Maximum Speed: 16 Status: link not connected Substatus: ADAPTER UP Host Port Address: 0 Firmware Revision: 6.10.0 Data Link Rate (Gbit): 0 Fabric Established: false Connection Established: loop Mediatype: ptp Configured Speed: 4 Configured State: up Switch Port: :

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

So, I have no idea what information I should provide upfront for someone who’s wanting to help me through get through that, but I’m more than happy to send more info when requested.

Thanks,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

You can’t. This is what NetApp support forces me to use and what the shiny and new ConfigAdvisor 3.5 tells you you have to do.

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320 Telefax: +43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: tmac [mailto:tmacmd@gmail.com] Gesendet: Dienstag, 17. Juni 2014 00:09 An: Alexander Griesser Cc: Duncan Cummings; Borzenkov, Andrei; Toasters Betreff: Re: FCP Ports operational down

You should re-cable again ;)

It is not advisable to have the same components on the same bridge:

e0a/e0b are on the same bridge (you have them both as cluster ports) e0c/e0d are on the same bridge (you have them as FC ports) e1a/e1b may be on the same bridge if this is a 4-port card (you have them as data).

You really should split them up across bridges/adapters for better failover scenarios.

--tmac

Tim McCarthy Principal Consultant

[Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.] [Das Bild wurde vom Absender entfernt.]

Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE6 110-107-141https://www.redhat.com/wapps/training/certification/verify.html?certNumber=110-107-141&isSearch=False&verify=Verify NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Current until Aug 02, 2016 Expires: 08 November 2014

On Mon, Jun 16, 2014 at 5:50 PM, Alexander Griesser <ag@anexia.atmailto:ag@anexia.at> wrote: OK guys, here’s the update. The TLDR version: It’s working now, we switched ports.

The more detailed version, this was my old port layout (C = Cluster, D = Data, F = FibreChannel):

e0a (C) e0c (C) e1a (F) e0b (D) e0d (D) e1b (F)

Now after recabling, I have this configuration:

e0a (C) e0c (F) e1a (D) e0b (C) e0d (F) e1b (D)

And this one was working immediately, FLOGI on the FC switch, I can see all devices (vservers and physical nodes), everything up/up as it should be. The funny (or not really funny) thing is, that I used ConfigAdvisor 3.4 to set up this system and it felt perfectly OK with the above configuration. Now after recabling I wanted to run ConfigAdvisor again and got the hint, that the new version 3.5 is out – so I did update my version just to see that it now says that my cabling is invalid, because 3.5 correctly tells us, that e0a and e0b (although on the same ASIC) need to be the cluster ports on a FAS8020.

Also ConfigAdvisor 3.4 told me that my SAS cabling was OK, and 3.5 now tells me that my SAS cabling is wrong – joy.

Gotta find out what the problem with the SAS cables is now, but the FC topic has been solved by just switching ports. The problem was an incompatibility with the FC SFPs I got and the UTA extension card, they do not work together and have to be deployed in the onboard UTA ports.

Thanks again for all your help, best,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net] Im Auftrag von Alexander Griesser Gesendet: Donnerstag, 12. Juni 2014 12:55 An: Duncan Cummings; Borzenkov, Andrei Cc: Toasters Betreff: AW: FCP Ports operational down

Duncan,

thanks – I’ve already evaluated this BURT and we verified that I am not affected by that. I did, nevertheless, follow the instructions in the BURT to regenerate my WWNs, but to no avail. Right now it looks like we got supplied the wrong FC SFPs…

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Duncan Cummings [mailto:dcummings@interactive.com.au] Gesendet: Donnerstag, 12. Juni 2014 12:53 An: Alexander Griesser; Borzenkov, Andrei Cc: Toasters Betreff: RE: FCP Ports operational down

Alexander,

You may have run into Burt 818251 where both nodes of a cDOT HA pair are returning the same WWNN.

You can check this with

cluster::> network fcp adapter show -fields fc-wwpn

Duncan Cummings NetApp Specialist Interactive Pty Ltd Telephone 07 3323 0800 Facsimile 07 3323 0899 Mobile 0403 383 050 www.interactive.com.auhttp://www.interactive.com.au

-------Confidentiality & Legal Privilege------------- "This email is intended for the named recipient only. The information contained in this message may be confidential, or commercially sensitive. If you are not the intended recipient you must not reproduce or distribute any part of the email, disclose its contents to any other party, or take any action in reliance on it. If you have received this email in error, please contact the sender immediately. Please delete this message from your computer. Confidentiality and legal privilege are not waived or lost by reason of mistaken delivery to you." From: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Alexander Griesser Sent: Wednesday, 11 June 2014 3:51 AM To: Borzenkov, Andrei Cc: Toasters Subject: AW: FCP Ports operational down

Thanks for all your input so far – will keep you posted on the outcome, but for now it seems as if I got wrong SFP transceivers due to an error in the quoting tool… New transceivers should be there by tomorrow hopefully.

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

Von: Borzenkov, Andrei [mailto:andrei.borzenkov@ts.fujitsu.com] Gesendet: Dienstag, 10. Juni 2014 08:22 An: Alexander Griesser Cc: Toasters Betreff: Re: FCP Ports operational down

Brocade shows "no light" and NetApp shows "not connected" which suggests some issues on physical level. Did you verify that brocade port is using multi-mode transceiver and also you do not accidentally use single mode cable?

Отправлено с iPhone

09 июня 2014 г., в 15:43, "Alexander Griesser" <ag@anexia.atmailto:ag@anexia.at> написал(а): Hi there,

I’m having a hard time currently connecting my new FAS8020 to our existing fabric – the FCP ports just won‘t get online and I’m not sure where exactly the problem is and how to debug that since I’m more the NAS guy not having much practical experience with FCP configurations, so here’s the deal for all of you who are wanting to help.

FAS8020 Clustered Data Ontap 8.2.1 Brocade DS4900B

Brocade Switchport:

portcfgshow 0

Area Number: 0 Speed Level: AUTO(HW) Fill Word: 0(Idle-Idle) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port OFF Port Auto Disable: OFF Mirror Port OFF F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 126

portshow 0

portIndex: 0 portName: portHealth: OFFLINE

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x1 PRESENT U_PORT LocalSwcFlags: 0x0 portType: 10.0 POD Port: Port is licensed portState: 2 Offline Protocol: FC portPhys: 4 No_Light portScn: 0 port generation number: 0 state transition count: 0

portId: 010000 portIfId: 4302100d portWwn: 20:00:00:05:1e:5b:f9:a3 portWwn of device(s) connected:

Distance: normal portSpeed: N4Gbps

LE domain: 0 FC Fastwrite: OFF Interrupts: 2 Link_failure: 0 Frjt: 0 Unknown: 0 Loss_of_sync: 0 Fbsy: 0 Lli: 2 Loss_of_sig: 2 Proc_rqrd: 5 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 0 Suspended: 0 Lr_out: 0 Parity_err: 0 Ols_in: 0 2_parity_err: 0 Ols_out: 0 CMI_bus_err: 0

Port part of other ADs: No

FCP Adater on NetApp:

Node: jetfire Adapter: 1b Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G) Physical Protocol: fibre-channel Maximum Speed: 16 Status: link not connected Substatus: ADAPTER UP Host Port Address: 0 Firmware Revision: 6.10.0 Data Link Rate (Gbit): 0 Fabric Established: false Connection Established: loop Mediatype: ptp Configured Speed: 4 Configured State: up Switch Port: :

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

So, I have no idea what information I should provide upfront for someone who’s wanting to help me through get through that, but I’m more than happy to send more info when requested.

Thanks,

Alexander Griesser System-Administrator

ANEXIA Internetdienstleistungs GmbH

Telefon: +43-5-0556-320tel:%2B43-5-0556-320 Telefax: +43-5-0556-500tel:%2B43-5-0556-500

E-Mail: ag@anexia.atmailto:ag@anexia.at Web: http://www.anexia.athttp://www.anexia.at/

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt Geschäftsführer: Alexander Windbichler Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

Gotta find out what the problem with the SAS cables is now, but the FC topic has been solved by just switching ports. The problem was an incompatibility with the FC SFPs I got and the UTA extension card, they do not > work together and have to be deployed in the onboard UTA ports.

Yes, PCIe card and on-board ports use different SFP. I wish HWU also displayed original manufacturer model, because for all I can tell there are no NetApp part numbers on them (at least in the past, may have changed today).

Nice you have this sorted out.

I've got exactly the same issue with FAS8040 4 nodes cluster, running 8.2.1 and 8.2.2

However it's not HBA HW related as I've got similar cluster in 2nd DC and it works just fine with the same HBA on filers.

On-board ports (I don't have any SAN svm configured):

na101::*> network fcp adapter show -node na101node-* -fields switch-port,fc-wwpn -adapter 0e node adapter fc-wwpn switch-port ------------ ------- ----------------------- -------------- na101node-1a 0e 50:0a:09:87:80:71:20:df fca-core-101:0 na101node-1b 0e 50:0a:09:87:80:01:21:93 fca-core-101:1 na101node-2a 0e 50:0a:09:87:80:01:1f:7f fca-core-101:40 na101node-2b 0e 50:0a:09:87:80:01:20:9e fca-core-101:41 4 entries were displayed.

Slot 3 ports:

na101::*> network fcp adapter show -node na101node-* -fields switch-port,fc-wwpn -adapter 3a node adapter fc-wwpn switch-port ------------ ------- ----------------------- ----------- na101node-1a 3a 50:0a:09:81:80:71:20:df : na101node-1b 3a 50:0a:09:81:80:01:21:93 : na101node-2a 3a 50:0a:09:81:80:01:1f:7f : na101node-2b 3a 50:0a:09:81:80:01:20:9e : 4 entries were displayed.

I just upgraded to 8.2.2 and it didn't resolve the issue.

Some more details:

fcb-core-101:FID128:admin> portcfgshow 40 Area Number: 40 Octet Speed Combo: 1(16G|8G|4G|2G) Speed Level: AUTO(SW) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port AE Port Auto Disable: OFF Rate Limit OFF EX Port OFF Mirror Port OFF Credit Recovery ON F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 255 CSCTL mode: OFF D-Port mode: OFF Compression: OFF Encryption: OFF FEC: ON

fcb-core-101:FID128:admin> portshow 40 portIndex: 40 portName: na101node-2a_3a portHealth: No Fabric Watch License

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x24b03 PRESENT ACTIVE F_PORT G_PORT U_PORT LOGICAL_ONLINE LOGIN NOELP LED ACCEPT FLOGI LocalSwcFlags: 0x0 portType: 24.0 POD Port: Port is licensed portState: 1 Online Protocol: FC portPhys: 6 In_Sync portScn: 32 F_Port port generation number: 114 state transition count: 7

portId: c92800 portIfId: 4302001e portWwn: 20:28:00:27:f8:bd:ec:1c portWwn of device(s) connected: 21:00:00:24:ff:73:20:73 Distance: normal portSpeed: N8Gbps

FEC: Inactive LE domain: 0 FC Fastwrite: OFF Interrupts: 0 Link_failure: 3 Frjt: 0 Unknown: 0 Loss_of_sync: 4 Fbsy: 0 Lli: 31 Loss_of_sig: 7 Proc_rqrd: 32 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 4 Suspended: 0 Lr_out: 4 Parity_err: 0 Ols_in: 4 2_parity_err: 0 Ols_out: 4 CMI_bus_err: 0

na101::*> ucadmin show -node na101node-2a -adapter 3a -instance

Node: na101node-2a Adapter: 3a Current Mode: fc Current Type: target Pending Mode: - Pending Type: - Status: online Supported Modes: fc Supported FC Types: initiator, target Supported CNA Types: -

It feels like Im missing something obvious .. any help is appreciated.

Cheers, Vladimir

On Tue, Jun 17, 2014 at 7:40 AM, Alexander Griesser ag@anexia.at wrote:

No part numbers on them, I did also check. You can just see the SFP manufacturer + model in the sysconfig -a output, but that's about it - no indication of whether they're compatible with what card or something like this.

Support is working through the new CA output now and will update me if on the SAS cabling issue afterwards, all other warnings in CA 3.5 are just related to firmware (new one got released) and port mismatch which is to be expected at the moment since I'm running an asymmetric configuration right now.

Best,

Alexander Griesser System-Administrator

On Fri, Nov 28, 2014 at 1:16 PM, Basil basilberntsen@gmail.com wrote:

Just off the top of my head, are you sure that the offline ports are indeed attached to the port and switch you think they are? In the portshow 40 output, it says:

portWwn of device(s) connected: 21:00:00:24:ff:73:20:73

I asked my chaps in DC to double check it, and they confirmed the ports are cabled. Also respective switch ports (including the port 40) became "Online", prior to that they were in "No_Light" status.

Can you run the command nodefind 21:00:00:24:ff:73:20:73 for me, and tell me whether that's a WWN you've made an alias for, and what manufacturer it's from?

Thanks for this hint .. I helped me to find out the reason.

Here is why:

na101::*> ucadmin show -node na101node-2a Current Current Pending Pending Admin Node Adapter Mode Type Mode Type Status ------------ ------- ------- --------- ------- --------- ----------- .. na101node-2a 3a fc target - - online na101node-2a 3b fc target - - online na101node-2a 3c fc target - - online na101node-2a 3d fc initiator - - online

So I left 3d configured as "initiator" (just in case I'll need it later on), I asked my DC mates to patch 3a adapter to the fabric, but they actaully cabled 3d. They were confused as prots on X1132A-R6 are not labeled as a,b,c,d http://hwu.netapp.com/images/AdapterImages/X1132A-R6_3_lg.jpg?tag=%200

Running "sysconfig -h 3" helped me identifying the HBA's WWPN's.

Thanks for the help guys!

Cheers, Vladimir

According to misformatted output: NPIV capability ON

From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of tmac Sent: Friday, November 28, 2014 3:49 PM To: Vladimir Zhigulin Cc: toasters@teaparty.net Subject: Re: FCP Ports operational down

Are you absolutely sure you NPIV enabled at the switch? This is mandatory and mentioned in the admin guide and probably other places as being needed.

--tmac

On Fri, Nov 28, 2014 at 5:39 AM, Momonth <momonth@gmail.commailto:momonth@gmail.com> wrote: I've got exactly the same issue with FAS8040 4 nodes cluster, running 8.2.1 and 8.2.2

However it's not HBA HW related as I've got similar cluster in 2nd DC and it works just fine with the same HBA on filers.

On-board ports (I don't have any SAN svm configured):

na101::*> network fcp adapter show -node na101node-* -fields switch-port,fc-wwpn -adapter 0e node adapter fc-wwpn switch-port ------------ ------- ----------------------- -------------- na101node-1a 0e 50:0a:09:87:80:71:20:df fca-core-101:0 na101node-1b 0e 50:0a:09:87:80:01:21:93 fca-core-101:1 na101node-2a 0e 50:0a:09:87:80:01:1f:7f fca-core-101:40 na101node-2b 0e 50:0a:09:87:80:01:20:9e fca-core-101:41 4 entries were displayed.

Slot 3 ports:

na101::*> network fcp adapter show -node na101node-* -fields switch-port,fc-wwpn -adapter 3a node adapter fc-wwpn switch-port ------------ ------- ----------------------- ----------- na101node-1a 3a 50:0a:09:81:80:71:20:df : na101node-1b 3a 50:0a:09:81:80:01:21:93 : na101node-2a 3a 50:0a:09:81:80:01:1f:7f : na101node-2b 3a 50:0a:09:81:80:01:20:9e : 4 entries were displayed.

I just upgraded to 8.2.2 and it didn't resolve the issue.

Some more details:

fcb-core-101:FID128:admin> portcfgshow 40 Area Number: 40 Octet Speed Combo: 1(16G|8G|4G|2G) Speed Level: AUTO(SW) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port AE Port Auto Disable: OFF Rate Limit OFF EX Port OFF Mirror Port OFF Credit Recovery ON F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 255 CSCTL mode: OFF D-Port mode: OFF Compression: OFF Encryption: OFF FEC: ON

fcb-core-101:FID128:admin> portshow 40 portIndex: 40 portName: na101node-2a_3a portHealth: No Fabric Watch License

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x24b03 PRESENT ACTIVE F_PORT G_PORT U_PORT LOGICAL_ONLINE LOGIN NOELP LED ACCEPT FLOGI LocalSwcFlags: 0x0 portType: 24.0 POD Port: Port is licensed portState: 1 Online Protocol: FC portPhys: 6 In_Sync portScn: 32 F_Port port generation number: 114 state transition count: 7

portId: c92800 portIfId: 4302001e portWwn: 20:28:00:27:f8:bd:ec:1c portWwn of device(s) connected: 21:00:00:24:ff:73:20:73 Distance: normal portSpeed: N8Gbps

FEC: Inactive LE domain: 0 FC Fastwrite: OFF Interrupts: 0 Link_failure: 3 Frjt: 0 Unknown: 0 Loss_of_sync: 4 Fbsy: 0 Lli: 31 Loss_of_sig: 7 Proc_rqrd: 32 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 4 Suspended: 0 Lr_out: 4 Parity_err: 0 Ols_in: 4 2_parity_err: 0 Ols_out: 4 CMI_bus_err: 0

na101::*> ucadmin show -node na101node-2a -adapter 3a -instance

Node: na101node-2a Adapter: 3a Current Mode: fc Current Type: target Pending Mode: - Pending Type: - Status: online Supported Modes: fc Supported FC Types: initiator, target Supported CNA Types: -

It feels like Im missing something obvious .. any help is appreciated.

Cheers, Vladimir

On Tue, Jun 17, 2014 at 7:40 AM, Alexander Griesser <ag@anexia.atmailto:ag@anexia.at> wrote:

No part numbers on them, I did also check. You can just see the SFP manufacturer + model in the sysconfig -a output, but that's about it - no indication of whether they're compatible with what card or something like this.

Support is working through the new CA output now and will update me if on the SAS cabling issue afterwards, all other warnings in CA 3.5 are just related to firmware (new one got released) and port mismatch which is to be expected at the moment since I'm running an asymmetric configuration right now.

Best,

Alexander Griesser System-Administrator

_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

Ok, what about: vserver fc show ? is fc actually on at the svm?

and: system node run -node na101node-* fcadmin config network fcp adapter modify -node na101node-* -adapter port -state up

What is the output from these command?

--tmac

On Fri, Nov 28, 2014 at 8:09 AM, basilberntsen@gmail.com wrote:

The portcfgreport says that NPIV is enabled on that port.

Sent from my BlackBerry 10 smartphone on the Bell network. *From: *tmac *Sent: *Friday, November 28, 2014 7:53 AM *To: *Vladimir Zhigulin *Cc: *toasters@teaparty.net *Subject: *Re: FCP Ports operational down

Are you absolutely sure you NPIV enabled at the switch? This is mandatory and mentioned in the admin guide and probably other places as being needed.

--tmac

On Fri, Nov 28, 2014 at 5:39 AM, Momonth momonth@gmail.com wrote:

...

I've got exactly the same issue with FAS8040 4 nodes cluster, running 8.2.1 and 8.2.2

However it's not HBA HW related as I've got similar cluster in 2nd DC and it works just fine with the same HBA on filers.

On-board ports (I don't have any SAN svm configured):

na101::*> network fcp adapter show -node na101node-* -fields switch-port,fc-wwpn -adapter 0e node adapter fc-wwpn switch-port

---

na101node-1a 0e 50:0a:09:87:80:71:20:df fca-core-101:0 na101node-1b 0e 50:0a:09:87:80:01:21:93 fca-core-101:1 na101node-2a 0e 50:0a:09:87:80:01:1f:7f fca-core-101:40 na101node-2b 0e 50:0a:09:87:80:01:20:9e fca-core-101:41 4 entries were displayed.

Slot 3 ports:

na101::*> network fcp adapter show -node na101node-* -fields switch-port,fc-wwpn -adapter 3a node adapter fc-wwpn switch-port

---

na101node-1a 3a 50:0a:09:81:80:71:20:df : na101node-1b 3a 50:0a:09:81:80:01:21:93 : na101node-2a 3a 50:0a:09:81:80:01:1f:7f : na101node-2b 3a 50:0a:09:81:80:01:20:9e : 4 entries were displayed.

I just upgraded to 8.2.2 and it didn't resolve the issue.

Some more details:

fcb-core-101:FID128:admin> portcfgshow 40 Area Number: 40 Octet Speed Combo: 1(16G|8G|4G|2G) Speed Level: AUTO(SW) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port AE Port Auto Disable: OFF Rate Limit OFF EX Port OFF Mirror Port OFF Credit Recovery ON F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 255 CSCTL mode: OFF D-Port mode: OFF Compression: OFF Encryption: OFF FEC: ON

fcb-core-101:FID128:admin> portshow 40 portIndex: 40 portName: na101node-2a_3a portHealth: No Fabric Watch License

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x24b03 PRESENT ACTIVE F_PORT G_PORT U_PORT LOGICAL_ONLINE LOGIN NOELP LED ACCEPT FLOGI LocalSwcFlags: 0x0 portType: 24.0 POD Port: Port is licensed portState: 1 Online Protocol: FC portPhys: 6 In_Sync portScn: 32 F_Port port generation number: 114 state transition count: 7

portId: c92800 portIfId: 4302001e portWwn: 20:28:00:27:f8:bd:ec:1c portWwn of device(s) connected: 21:00:00:24:ff:73:20:73 Distance: normal portSpeed: N8Gbps

FEC: Inactive LE domain: 0 FC Fastwrite: OFF Interrupts: 0 Link_failure: 3 Frjt: 0 Unknown: 0 Loss_of_sync: 4 Fbsy: 0 Lli: 31 Loss_of_sig: 7 Proc_rqrd: 32 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 4 Suspended: 0 Lr_out: 4 Parity_err: 0 Ols_in: 4 2_parity_err: 0 Ols_out: 4 CMI_bus_err: 0

na101::*> ucadmin show -node na101node-2a -adapter 3a -instance

           Node: na101node-2a
        Adapter: 3a
   Current Mode: fc
   Current Type: target
   Pending Mode: -
   Pending Type: -
         Status: online
Supported Modes: fc

Supported FC Types: initiator, target Supported CNA Types: -

It feels like Im missing something obvious .. any help is appreciated.

Cheers, Vladimir

On Tue, Jun 17, 2014 at 7:40 AM, Alexander Griesser ag@anexia.at wrote:

...

No part numbers on them, I did also check. You can just see the SFP manufacturer + model in the sysconfig -a

output, but that's about it - no indication of whether they're compatible with what card or something like this.

...

Support is working through the new CA output now and will update me if

on the SAS cabling issue afterwards, all other warnings in CA 3.5 are just related to firmware (new one got released) and port mismatch which is to be expected at the moment since I'm running an asymmetric configuration right now.

...

Best,

Alexander Griesser System-Administrator

---

Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

---

Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

I'm sorry, could you explain what issue you have in some more details? Hijacking 5 months old thread telling "I have the same issue" is not the most efficient way to resolve it.

-----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Momonth Sent: Friday, November 28, 2014 1:39 PM To: toasters@teaparty.net Subject: Re: FCP Ports operational down

I've got exactly the same issue with FAS8040 4 nodes cluster, running 8.2.1 and 8.2.2

However it's not HBA HW related as I've got similar cluster in 2nd DC and it works just fine with the same HBA on filers.

On-board ports (I don't have any SAN svm configured):

na101::*> network fcp adapter show -node na101node-* -fields switch-port,fc-wwpn -adapter 0e node adapter fc-wwpn switch-port ------------ ------- ----------------------- -------------- na101node-1a 0e 50:0a:09:87:80:71:20:df fca-core-101:0 na101node-1b 0e 50:0a:09:87:80:01:21:93 fca-core-101:1 na101node-2a 0e 50:0a:09:87:80:01:1f:7f fca-core-101:40 na101node-2b 0e 50:0a:09:87:80:01:20:9e fca-core-101:41 4 entries were displayed.

Slot 3 ports:

na101::*> network fcp adapter show -node na101node-* -fields switch-port,fc-wwpn -adapter 3a node adapter fc-wwpn switch-port ------------ ------- ----------------------- ----------- na101node-1a 3a 50:0a:09:81:80:71:20:df : na101node-1b 3a 50:0a:09:81:80:01:21:93 : na101node-2a 3a 50:0a:09:81:80:01:1f:7f : na101node-2b 3a 50:0a:09:81:80:01:20:9e : 4 entries were displayed.

I just upgraded to 8.2.2 and it didn't resolve the issue.

Some more details:

fcb-core-101:FID128:admin> portcfgshow 40 Area Number: 40 Octet Speed Combo: 1(16G|8G|4G|2G) Speed Level: AUTO(SW) AL_PA Offset 13: OFF Trunk Port ON Long Distance OFF VC Link Init OFF Locked L_Port OFF Locked G_Port OFF Disabled E_Port OFF Locked E_Port OFF ISL R_RDY Mode OFF RSCN Suppressed OFF Persistent Disable OFF LOS TOV enable OFF NPIV capability ON QOS E_Port AE Port Auto Disable: OFF Rate Limit OFF EX Port OFF Mirror Port OFF Credit Recovery ON F_Port Buffers OFF Fault Delay: 0(R_A_TOV) NPIV PP Limit: 255 CSCTL mode: OFF D-Port mode: OFF Compression: OFF Encryption: OFF FEC: ON

fcb-core-101:FID128:admin> portshow 40 portIndex: 40 portName: na101node-2a_3a portHealth: No Fabric Watch License

Authentication: None portDisableReason: None portCFlags: 0x1 portFlags: 0x24b03 PRESENT ACTIVE F_PORT G_PORT U_PORT LOGICAL_ONLINE LOGIN NOELP LED ACCEPT FLOGI LocalSwcFlags: 0x0 portType: 24.0 POD Port: Port is licensed portState: 1 Online Protocol: FC portPhys: 6 In_Sync portScn: 32 F_Port port generation number: 114 state transition count: 7

portId: c92800 portIfId: 4302001e portWwn: 20:28:00:27:f8:bd:ec:1c portWwn of device(s) connected: 21:00:00:24:ff:73:20:73 Distance: normal portSpeed: N8Gbps

FEC: Inactive LE domain: 0 FC Fastwrite: OFF Interrupts: 0 Link_failure: 3 Frjt: 0 Unknown: 0 Loss_of_sync: 4 Fbsy: 0 Lli: 31 Loss_of_sig: 7 Proc_rqrd: 32 Protocol_err: 0 Timed_out: 0 Invalid_word: 0 Rx_flushed: 0 Invalid_crc: 0 Tx_unavail: 0 Delim_err: 0 Free_buffer: 0 Address_err: 0 Overrun: 0 Lr_in: 4 Suspended: 0 Lr_out: 4 Parity_err: 0 Ols_in: 4 2_parity_err: 0 Ols_out: 4 CMI_bus_err: 0

na101::*> ucadmin show -node na101node-2a -adapter 3a -instance

Node: na101node-2a Adapter: 3a Current Mode: fc Current Type: target Pending Mode: - Pending Type: - Status: online Supported Modes: fc Supported FC Types: initiator, target Supported CNA Types: -

It feels like Im missing something obvious .. any help is appreciated.

Cheers, Vladimir

On Tue, Jun 17, 2014 at 7:40 AM, Alexander Griesser ag@anexia.at wrote:

No part numbers on them, I did also check. You can just see the SFP manufacturer + model in the sysconfig -a output, but that's about it - no indication of whether they're compatible with what card or something like this.

Support is working through the new CA output now and will update me if on the SAS cabling issue afterwards, all other warnings in CA 3.5 are just related to firmware (new one got released) and port mismatch which is to be expected at the moment since I'm running an asymmetric configuration right now.

Best,

Alexander Griesser System-Administrator

_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters