Heino,
When you looked at the port stats for errors, did you look on both the switch and in ONTAP? I would be curious to see the stats from the cluster ports in ONTAP.
Is there any chance the multimode fiber is OM1 or OM2? You would need at least OM3 for 10Gb/s at 100m.
Thank you, Tim
From: Toasters toasters-bounces@teaparty.net On Behalf Of Heino Walther Sent: Monday, November 09, 2020 3:36 PM To: tmac tmacmd@gmail.com Cc: toasters@teaparty.net Subject: SV: Cluster stall issue going to switched cluster...
The other three SFP+ modules were FTLF8528P3BCV-N1 and the controller didn’t complain about them. The links also went up correctly as expected, and after migrating all ports, switching the network option to switchless-cluster true, the “cluster show” and “health” commands all showed that everything was OK… It clearly was not 😉 So we had to turn back fast, and didn’t have any time to investigate further. But I think just to be sure I will use some AFBR* SFP+ modules(Avargo branded I think), just to be 100% sure everything is supported.
/Heino
Fra: tmac <tmacmd@gmail.commailto:tmacmd@gmail.com> Dato: tirsdag, 10. november 2020 kl. 00.22 Til: Heino Walther <hw@beardmann.dkmailto:hw@beardmann.dk> Cc: toasters@teaparty.netmailto:toasters@teaparty.net <toasters@teaparty.netmailto:toasters@teaparty.net> Emne: Re: Cluster stall issue going to switched cluster... The CN1610s should be running EFOS 1.3.0.2 or 1.3.0.3 with ONTAP 9.7 And the Reference Configuration File (RCF) should be current (1.2). The Supported Optics include: 332-00363, AFBR-703SMZ-NA3, AFBR-703SMZ-NA4, AFBR-709SMZ-NA3, AFBR-709SMZ-NA4, PLRXPL-SC-S43NA1 and PLRXPL-SC-S43NA2
Anything is possible with unsupported Optics.
Another test you could do....use the optics and try the point-to-point connections with Optics and fibers first. Replace both e0a ports, then e0c, then e0b and finally e0d. If the issue returns, then the blame could certainly be the optics.
--tmac
Tim McCarthy, Principal Consultant
Proud Member of the #NetAppATeamhttps://twitter.com/NetAppATeam
I Blog at TMACsRackhttps://tmacsrack.wordpress.com/