Hi all, I have a 7.3.3 3170 HA pair, out of maintenance now, that’s become unresponsive to the console. It accepts the login/passwd and then nothing. No prompt, although it does appear to be echoing the log as it happens. Unit is experiencing high load, and I can’t get into it to find out why. Has anyone seen this before, and what was the fix fior it, if any? I know i can fail it over and reboot it, but I’d rather know what and why before I do so, as my mgmt team will want some form of answer that isn’t ‘meh’ with a shrug :(
Thanks,
Mark Flint mf1@sanger.ac.uk
Can you rsh/ssh over any commands?
Typed with my thumbs!
On Mar 13, 2014, at 5:27 AM, Mark Flint mf1@sanger.ac.uk wrote:
Hi all, I have a 7.3.3 3170 HA pair, out of maintenance now, that’s become unresponsive to the console. It accepts the login/passwd and then nothing. No prompt, although it does appear to be echoing the log as it happens. Unit is experiencing high load, and I can’t get into it to find out why. Has anyone seen this before, and what was the fix fior it, if any? I know i can fail it over and reboot it, but I’d rather know what and why before I do so, as my mgmt team will want some form of answer that isn’t ‘meh’ with a shrug :(
Thanks,
Mark Flint mf1@sanger.ac.uk
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
You could also confirm the contents of the /etc/messages file if you have it exported via NFS or shared via CIFs to see if that yields anything.
You could also try connecting via System Manager or Powershell?
If you mean the RLM I have seen it where users that login and then kill their session locks the RLM and you get the behaviour you mention. In the past I've restarted the RLM from the Ontap which has cleared this.
-- View this message in context: http://network-appliance-toasters.10978.n7.nabble.com/7-mode-console-unrespo... Sent from the Network Appliance - Toasters mailing list archive at Nabble.com.
Yes I can, and they return the output back to my terminal.
Weird.
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 13:23, Blake Golliher thelastman@gmail.com wrote:
Can you rsh/ssh over any commands?
Typed with my thumbs!
On Mar 13, 2014, at 5:27 AM, Mark Flint mf1@sanger.ac.uk wrote:
Hi all, I have a 7.3.3 3170 HA pair, out of maintenance now, that’s become unresponsive to the console. It accepts the login/passwd and then nothing. No prompt, although it does appear to be echoing the log as it happens. Unit is experiencing high load, and I can’t get into it to find out why. Has anyone seen this before, and what was the fix fior it, if any? I know i can fail it over and reboot it, but I’d rather know what and why before I do so, as my mgmt team will want some form of answer that isn’t ‘meh’ with a shrug :(
Thanks,
Mark Flint mf1@sanger.ac.uk
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
I've seen this (or something similar) happen, when the console was 'in a wizard' (e.g. lun setup) when you connect via e.g. SSH and the prompt would re-appear once you CTRL-C-ed out of it...
Sebastian
On 3/13/2014 3:03 PM, Mark Flint wrote:
Yes I can, and they return the output back to my terminal.
Weird.
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 13:23, Blake Golliher thelastman@gmail.com wrote:
Can you rsh/ssh over any commands?
Typed with my thumbs!
On Mar 13, 2014, at 5:27 AM, Mark Flint mf1@sanger.ac.uk wrote:
Hi all, I have a 7.3.3 3170 HA pair, out of maintenance now, that’s become unresponsive to the console. It accepts the login/passwd and then nothing. No prompt, although it does appear to be echoing the log as it happens. Unit is experiencing high load, and I can’t get into it to find out why. Has anyone seen this before, and what was the fix fior it, if any? I know i can fail it over and reboot it, but I’d rather know what and why before I do so, as my mgmt team will want some form of answer that isn’t ‘meh’ with a shrug :(
Thanks,
Mark Flint mf1@sanger.ac.uk
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Think I may have found out the root cause of this, seems to have occurred around the same time I started to see CIFSRPC issues with closing a share, so I’m going to leave it for a day or so, as I can get responses to ssh’d in commands, and then try and organise a failover, to kill the cifs server on node a, hopefully that will resolve the issue.
Thanks to all,
`Mark
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 14:17, Sebastian Goetze spgoetze@gmail.com wrote:
I've seen this (or something similar) happen, when the console was 'in a wizard' (e.g. lun setup) when you connect via e.g. SSH and the prompt would re-appear once you CTRL-C-ed out of it...
Sebastian
On 3/13/2014 3:03 PM, Mark Flint wrote:
Yes I can, and they return the output back to my terminal.
Weird.
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 13:23, Blake Golliher thelastman@gmail.com wrote:
Can you rsh/ssh over any commands?
Typed with my thumbs!
On Mar 13, 2014, at 5:27 AM, Mark Flint mf1@sanger.ac.uk wrote:
Hi all, I have a 7.3.3 3170 HA pair, out of maintenance now, that’s become unresponsive to the console. It accepts the login/passwd and then nothing. No prompt, although it does appear to be echoing the log as it happens. Unit is experiencing high load, and I can’t get into it to find out why. Has anyone seen this before, and what was the fix fior it, if any? I know i can fail it over and reboot it, but I’d rather know what and why before I do so, as my mgmt team will want some form of answer that isn’t ‘meh’ with a shrug :(
Thanks,
Mark Flint mf1@sanger.ac.uk
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
If you just mean the interactive ssh session and not the RLM, then it sounds like your one interactive session is tied up. Try sending a non interactive "logout telnet" (so, ssh root@controller logout telnet), then ssh into it again. The 'logout telnet' will hopefully kill the tied up interactive session.
-- Mike Garrison
On Thu, Mar 13, 2014 at 10:03 AM, Mark Flint mf1@sanger.ac.uk wrote:
Yes I can, and they return the output back to my terminal.
Weird.
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 13:23, Blake Golliher thelastman@gmail.com wrote:
Can you rsh/ssh over any commands?
Typed with my thumbs!
On Mar 13, 2014, at 5:27 AM, Mark Flint mf1@sanger.ac.uk wrote:
Hi all, I have a 7.3.3 3170 HA pair, out of maintenance now, that's become unresponsive to the console. It accepts the login/passwd and then nothing. No prompt, although it does appear to be echoing the log as it happens. Unit is experiencing high load, and I can't get into it to find out why. Has anyone seen this before, and what was the fix fior it, if any? I know i can fail it over and reboot it, but I'd rather know what and why before I do so, as my mgmt team will want some form of answer that isn't 'meh' with a shrug :(
Thanks,
Mark Flint mf1@sanger.ac.uk
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
nice idea, but it fails with "No active telnet session is present”
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 15:22, Michael Garrison mcgarr@umich.edu wrote:
If you just mean the interactive ssh session and not the RLM, then it sounds like your one interactive session is tied up. Try sending a non interactive "logout telnet" (so, ssh root@controller logout telnet), then ssh into it again. The 'logout telnet' will hopefully kill the tied up interactive session.
-- Mike Garrison
On Thu, Mar 13, 2014 at 10:03 AM, Mark Flint mf1@sanger.ac.uk wrote:
Yes I can, and they return the output back to my terminal.
Weird.
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 13:23, Blake Golliher thelastman@gmail.com wrote:
Can you rsh/ssh over any commands?
Typed with my thumbs!
On Mar 13, 2014, at 5:27 AM, Mark Flint mf1@sanger.ac.uk wrote:
Hi all, I have a 7.3.3 3170 HA pair, out of maintenance now, that's become unresponsive to the console. It accepts the login/passwd and then nothing. No prompt, although it does appear to be echoing the log as it happens. Unit is experiencing high load, and I can't get into it to find out why. Has anyone seen this before, and what was the fix fior it, if any? I know i can fail it over and reboot it, but I'd rather know what and why before I do so, as my mgmt team will want some form of answer that isn't 'meh' with a shrug :(
Thanks,
Mark Flint mf1@sanger.ac.uk
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Ok, the unit has become progressively worse, and I’ve now had to reboot to get some services running again, thanks to all for suggestions.
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 15:22, Michael Garrison mcgarr@umich.edu wrote:
If you just mean the interactive ssh session and not the RLM, then it sounds like your one interactive session is tied up. Try sending a non interactive "logout telnet" (so, ssh root@controller logout telnet), then ssh into it again. The 'logout telnet' will hopefully kill the tied up interactive session.
-- Mike Garrison
On Thu, Mar 13, 2014 at 10:03 AM, Mark Flint mf1@sanger.ac.uk wrote:
Yes I can, and they return the output back to my terminal.
Weird.
Mark Flint mf1@sanger.ac.uk
On 13 Mar 2014, at 13:23, Blake Golliher thelastman@gmail.com wrote:
Can you rsh/ssh over any commands?
Typed with my thumbs!
On Mar 13, 2014, at 5:27 AM, Mark Flint mf1@sanger.ac.uk wrote:
Hi all, I have a 7.3.3 3170 HA pair, out of maintenance now, that's become unresponsive to the console. It accepts the login/passwd and then nothing. No prompt, although it does appear to be echoing the log as it happens. Unit is experiencing high load, and I can't get into it to find out why. Has anyone seen this before, and what was the fix fior it, if any? I know i can fail it over and reboot it, but I'd rather know what and why before I do so, as my mgmt team will want some form of answer that isn't 'meh' with a shrug :(
Thanks,
Mark Flint mf1@sanger.ac.uk
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
-- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
-
Blake Golliher -
Mark Flint -
Martin -
Michael Garrison -
Sebastian Goetze