You can’t.

This is what NetApp support forces me to use and what the shiny and new ConfigAdvisor 3.5 tells you you have to do.

 

Alexander Griesser

System-Administrator

 

ANEXIA Internetdienstleistungs GmbH

 

Telefon: +43-5-0556-320

Telefax: +43-5-0556-500

 

E-Mail: ag@anexia.at

Web: http://www.anexia.at

 

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt

Geschäftsführer: Alexander Windbichler

Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

 

Von: tmac [mailto:tmacmd@gmail.com]
Gesendet: Dienstag, 17. Juni 2014 00:09
An: Alexander Griesser
Cc: Duncan Cummings; Borzenkov, Andrei; Toasters
Betreff: Re: FCP Ports operational down

 

You should re-cable again ;)

 

It is not advisable to have the same  components on the same bridge:

 

e0a/e0b are on the same bridge (you have them both as cluster ports)

e0c/e0d are on the same bridge (you have them as FC ports)

e1a/e1b may be on the same bridge if this is a 4-port card (you have them as data).

 

You really should split them up across bridges/adapters for better failover scenarios.


--tmac

 

Tim McCarthy

Principal Consultant

 

Das Bild wurde vom Absender entfernt.     Das Bild wurde vom Absender entfernt.     Das Bild wurde vom Absender entfernt.

 

        Clustered ONTAP                                                        Clustered ONTAP

 NCDA ID: XK7R3GEKC1QQ2LVD           RHCE6 110-107-141           NCSIE ID: C14QPHE21FR4YWD4

     Expires: 08 November 2014              Current until Aug 02, 2016         Expires: 08 November 2014

 

On Mon, Jun 16, 2014 at 5:50 PM, Alexander Griesser <ag@anexia.at> wrote:

OK guys, here’s the update.

The TLDR version: It’s working now, we switched ports.

 

The more detailed version, this was my old port layout (C = Cluster, D = Data, F = FibreChannel):

 

e0a (C)               e0c (C)               e1a (F)

e0b (D)              e0d (D)              e1b (F)

 

Now after recabling, I have this configuration:

 

e0a (C)               e0c (F)                e1a (D)

e0b (C)               e0d (F)               e1b (D)

 

And this one was working immediately, FLOGI on the FC switch, I can see all devices (vservers and physical nodes), everything up/up as it should be.

The funny (or not really funny) thing is, that I used ConfigAdvisor 3.4 to set up this system and it felt perfectly OK with the above configuration.

Now after recabling I wanted to run ConfigAdvisor again and got the hint, that the new version 3.5 is out – so I did update my version just to see that it now says that my cabling is invalid, because 3.5 correctly tells us, that e0a and e0b (although on the same ASIC) need to be the cluster ports on a FAS8020.

 

Also ConfigAdvisor 3.4 told me that my SAS cabling was OK, and 3.5 now tells me that my SAS cabling is wrong – joy.

 

Gotta find out what the problem with the SAS cables is now, but the FC topic has been solved by just switching ports.

The problem was an incompatibility with the FC SFPs I got and the UTA extension card, they do not work together and have to be deployed in the onboard UTA ports.

 

Thanks again for all your help,

best,

 

Alexander Griesser

System-Administrator

 

ANEXIA Internetdienstleistungs GmbH

 

Telefon: +43-5-0556-320

Telefax: +43-5-0556-500

 

E-Mail: ag@anexia.at

Web: http://www.anexia.at

 

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt

Geschäftsführer: Alexander Windbichler

Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

 

Von: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] Im Auftrag von Alexander Griesser
Gesendet: Donnerstag, 12. Juni 2014 12:55
An: Duncan Cummings; Borzenkov, Andrei
Cc: Toasters
Betreff: AW: FCP Ports operational down

 

Duncan,

 

thanks – I’ve already evaluated this BURT and we verified that I am not affected by that.

I did, nevertheless, follow the instructions in the BURT to regenerate my WWNs, but to no avail.

Right now it looks like we got supplied the wrong FC SFPs…

 

Alexander Griesser

System-Administrator

 

ANEXIA Internetdienstleistungs GmbH

 

Telefon: +43-5-0556-320

Telefax: +43-5-0556-500

 

E-Mail: ag@anexia.at

Web: http://www.anexia.at

 

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt

Geschäftsführer: Alexander Windbichler

Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

 

Von: Duncan Cummings [mailto:dcummings@interactive.com.au]
Gesendet: Donnerstag, 12. Juni 2014 12:53
An: Alexander Griesser; Borzenkov, Andrei
Cc: Toasters
Betreff: RE: FCP Ports operational down

 

Alexander,

 

You may have run into Burt 818251 where both nodes of a cDOT HA pair are returning the same WWNN.

 

You can check this with

 

cluster::> network fcp adapter show -fields fc-wwpn

 

 

 


Duncan Cummings
NetApp Specialist
Interactive Pty Ltd
Telephone 07 3323 0800
Facsimile 07 3323 0899
Mobile 0403 383 050
www.interactive.com.au

-------Confidentiality & Legal Privilege-------------
"This email is intended for the named recipient only. The information contained in this message may be confidential, or commercially sensitive. If you are not the intended recipient you must not reproduce or distribute any part of the email, disclose its contents to any other party, or take any action in reliance on it. If you have received this email in error, please contact the sender immediately. Please delete this message from your computer. Confidentiality and legal privilege are not waived or lost by reason of mistaken delivery to you."

From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Alexander Griesser
Sent: Wednesday, 11 June 2014 3:51 AM
To: Borzenkov, Andrei
Cc: Toasters
Subject: AW: FCP Ports operational down

 

Thanks for all your input so far – will keep you posted on the outcome, but for now it seems as if I got wrong SFP transceivers due to an error in the quoting tool…

New transceivers should be there by tomorrow hopefully.

 

Alexander Griesser

System-Administrator

 

ANEXIA Internetdienstleistungs GmbH

 

Telefon: +43-5-0556-320

Telefax: +43-5-0556-500

 

E-Mail: ag@anexia.at

Web: http://www.anexia.at

 

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt

Geschäftsführer: Alexander Windbichler

Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

 

Von: Borzenkov, Andrei [mailto:andrei.borzenkov@ts.fujitsu.com]
Gesendet: Dienstag, 10. Juni 2014 08:22
An: Alexander Griesser
Cc: Toasters
Betreff: Re: FCP Ports operational down

 

Brocade shows "no light" and NetApp shows "not connected" which suggests some issues on physical level. Did you verify that brocade port is using multi-mode transceiver and also you do not accidentally use single mode cable?

Отправлено с iPhone


09 июня 2014 г., в 15:43, "Alexander Griesser" <ag@anexia.at> написал(а):

Hi there,

 

I’m having a hard time currently connecting my new FAS8020 to our existing fabric – the FCP ports just won‘t get online and I’m not sure where exactly the problem is and how to debug that since I’m more the NAS guy not having much practical experience with FCP configurations, so here’s the deal for all of you who are wanting to help.

 

FAS8020 Clustered Data Ontap 8.2.1

Brocade DS4900B

 

Brocade Switchport:

> portcfgshow 0

Area Number:              0

Speed Level:              AUTO(HW)

Fill Word:                0(Idle-Idle)

AL_PA Offset 13:          OFF

Trunk Port                ON

Long Distance             OFF

VC Link Init              OFF

Locked L_Port             OFF

Locked G_Port             OFF

Disabled E_Port           OFF

Locked E_Port             OFF

ISL R_RDY Mode            OFF

RSCN Suppressed           OFF

Persistent Disable        OFF

LOS TOV enable            OFF

NPIV capability           ON

QOS E_Port                OFF

Port Auto Disable:        OFF

Mirror Port               OFF

F_Port Buffers            OFF

Fault Delay:              0(R_A_TOV)

NPIV PP Limit:            126

 

> portshow 0

portIndex:   0

portName:

portHealth: OFFLINE

 

Authentication: None

portDisableReason: None

portCFlags: 0x1

portFlags: 0x1   PRESENT U_PORT

LocalSwcFlags: 0x0

portType:  10.0

POD Port: Port is licensed

portState: 2    Offline

Protocol: FC

portPhys:  4    No_Light        portScn:   0

port generation number:    0

state transition count:    0

 

portId:    010000

portIfId:    4302100d

portWwn:   20:00:00:05:1e:5b:f9:a3

portWwn of device(s) connected:

 

Distance:  normal

portSpeed: N4Gbps

 

LE domain: 0

FC Fastwrite: OFF

Interrupts:        2          Link_failure: 0          Frjt:         0

Unknown:           0          Loss_of_sync: 0          Fbsy:         0

Lli:               2          Loss_of_sig:  2

Proc_rqrd:         5          Protocol_err: 0

Timed_out:         0          Invalid_word: 0

Rx_flushed:        0          Invalid_crc:  0

Tx_unavail:        0          Delim_err:    0

Free_buffer:       0          Address_err:  0

Overrun:           0          Lr_in:        0

Suspended:         0          Lr_out:       0

Parity_err:        0          Ols_in:       0

2_parity_err:      0          Ols_out:      0

CMI_bus_err:       0

 

Port part of other ADs: No

 

FCP Adater on NetApp:

 

                  Node: jetfire

               Adapter: 1b

           Description: Fibre Channel Target Adapter 1b (QLogic 8324 (8362), rev. 2, 16G)

     Physical Protocol: fibre-channel

         Maximum Speed: 16

                Status: link not connected

             Substatus: ADAPTER UP

     Host Port Address: 0

     Firmware Revision: 6.10.0

Data Link Rate (Gbit): 0

    Fabric Established: false

Connection Established: loop

             Mediatype: ptp

      Configured Speed: 4

      Configured State: up

           Switch Port: :

 

 

AFAIK, the 16Gbit/s adapter should be backwards compatible to 4Gbit/s, our switch only has 4Gbit/s but it supports NPIV which seems to be a requirement for running Clustered Data Ontap via FC.

 

So, I have no idea what information I should provide upfront for someone who’s wanting to help me through get through that, but I’m more than happy to send more info when requested.

 

Thanks,

 

Alexander Griesser

System-Administrator

 

ANEXIA Internetdienstleistungs GmbH

 

Telefon: +43-5-0556-320

Telefax: +43-5-0556-500

 

E-Mail: ag@anexia.at

Web: http://www.anexia.at

 

Anschrift Hauptsitz Klagenfurt: Feldkirchnerstraße 140, 9020 Klagenfurt

Geschäftsführer: Alexander Windbichler

Firmenbuch: FN 289918a | Gerichtsstand: Klagenfurt | UID-Nummer: AT U63216601

 

_______________________________________________
Toasters mailing list
Toasters@teaparty.net
http://www.teaparty.net/mailman/listinfo/toasters


_______________________________________________
Toasters mailing list
Toasters@teaparty.net
http://www.teaparty.net/mailman/listinfo/toasters