Hello Toasters
We have an old 3040 running as a single controller in a lab. The head had previously been part of an HA pair and the NVRAM6 card was therefore installed in slot 3 (correct for HA systems). For a single controller the card is supposed to be in slot 1.
I'm curious to know what the controller is doing with the NVRAM card? Is it using it at all or just writing everything through straight to disk? Could this cause slower than expected performance?
Thanks, Steve
__ Background Info __
A colleague recently asked advice on some poor performance with this system in his VMware lab and the first thing that jumps out is the log messages complaining about the card being in the wrong slot. This misconfiguration will be corrected shortly.
The system is running 8.1.4 7-mode if that make a difference. The controller has 2 loops of DS14MK4 shelves (168 15K FC drives) and is serving handful iSCSI LUNs to a small vSphere cluster (2 ESXi servers).
While looking at stats in OCSM 3.2, I observed >100ms iSCSI write latency with a load of ~300 IOPS and very low CPU utilisation (<20%). -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
In HA pair usable NVRAM size is reduced in half (second half is used to mirror partner NVRAM). Whether or not it will have visible impact depends on your workload.
Other than that I do not see how NVRAM slot would affect performance.
-----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Stephen Stocke Sent: Tuesday, July 07, 2015 12:34 PM To: toasters@teaparty.net Subject: NVRAM6 Card Installed in the Wrong Slot
Hello Toasters
We have an old 3040 running as a single controller in a lab. The head had previously been part of an HA pair and the NVRAM6 card was therefore installed in slot 3 (correct for HA systems). For a single controller the card is supposed to be in slot 1.
I'm curious to know what the controller is doing with the NVRAM card? Is it using it at all or just writing everything through straight to disk? Could this cause slower than expected performance?
Thanks, Steve
__ Background Info __
A colleague recently asked advice on some poor performance with this system in his VMware lab and the first thing that jumps out is the log messages complaining about the card being in the wrong slot. This misconfiguration will be corrected shortly.
The system is running 8.1.4 7-mode if that make a difference. The controller has 2 loops of DS14MK4 shelves (168 15K FC drives) and is serving handful iSCSI LUNs to a small vSphere cluster (2 ESXi servers).
While looking at stats in OCSM 3.2, I observed >100ms iSCSI write latency with a load of ~300 IOPS and very low CPU utilisation (<20%). -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
3140 should be more than adequate for that workload, especially with that number of spindles (15K disks should be able to handle 250 IOPS each) -- given of course that the aggregates are laid out correctly and actually making use of the spindle count. I'd be interested to see your sysconfig and a statit output or a full perfstat (you could see if you have latx to see what's going on -- latx.netapp.comhttp://latx.netapp.com -- instructions are provided online for uploading perfstat output). 100ms latency seems very high, like maybe he's running a spindle bound aggregate. Have you checked whether he's running them on an aggr0 with 3 drives or maybe at 95%+ utilization on the aggregate he is using? System housekeeping might be keeping the aggregate very busy, but I'd expect CPU utilization to be much higher in that case.
Statit/Perfstat will probably reveal more useful information as you troubleshoot this issue than info from OCSM too. I'd be happy to look over your statit output if you want to post a section.
Like Andrei says, card placement for NVRAM shouldn't make a difference other than the logs complaining loudly (and often) about it.
Anthony Bar 650.207.5368tel:650.207.5368 tbar@berkcom.commailto:tbar@berkcom.com
On Jul 7, 2015, at 2:53 AM, Borzenkov, Andrei <andrei.borzenkov@ts.fujitsu.commailto:andrei.borzenkov@ts.fujitsu.com> wrote:
In HA pair usable NVRAM size is reduced in half (second half is used to mirror partner NVRAM). Whether or not it will have visible impact depends on your workload.
Other than that I do not see how NVRAM slot would affect performance.
-----Original Message----- From: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Stephen Stocke Sent: Tuesday, July 07, 2015 12:34 PM To: toasters@teaparty.netmailto:toasters@teaparty.net Subject: NVRAM6 Card Installed in the Wrong Slot
Hello Toasters
We have an old 3040 running as a single controller in a lab. The head had previously been part of an HA pair and the NVRAM6 card was therefore installed in slot 3 (correct for HA systems). For a single controller the card is supposed to be in slot 1.
I'm curious to know what the controller is doing with the NVRAM card? Is it using it at all or just writing everything through straight to disk? Could this cause slower than expected performance?
Thanks, Steve
__ Background Info __
A colleague recently asked advice on some poor performance with this system in his VMware lab and the first thing that jumps out is the log messages complaining about the card being in the wrong slot. This misconfiguration will be corrected shortly.
The system is running 8.1.4 7-mode if that make a difference. The controller has 2 loops of DS14MK4 shelves (168 15K FC drives) and is serving handful iSCSI LUNs to a small vSphere cluster (2 ESXi servers).
While looking at stats in OCSM 3.2, I observed >100ms iSCSI write latency with a load of ~300 IOPS and very low CPU utilisation (<20%). -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
_______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Thanks Tony, Thanks Andrei,
I was only asked to pass a quick eye over the system to spot any obvious issues. I ran Config Advisor and it came back clean with regard to cabling, etc. However, it took nearly 10 minutes for CA to complete the query and the systems I look after normally complete in 20 seconds. I then started to wonder about possible network issues in addition to the NVRAM card location.
I was mostly curious about what the impact of having the NVRAM in the wrong slot would be. My colleague is going to look at his network and move the NVRAM card and let me know if things are better. If not, I'll run a perfstat. I've never used the LatX tool so I'll be sure to check it out.
If LatX doesn't bear any fruit I'll post some statit snippets here. Hopefully I won't have to take up any of your time.
Cheers, Steve -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
Note that moving NVRAM means shutting down filer and this alone may clear any temporary resource shortage.
-----Original Message----- From: Stephen Stocke [mailto:Stephen.Stocke@je.logicalis.com] Sent: Tuesday, July 07, 2015 4:50 PM To: Tony Bar; Borzenkov, Andrei Cc: toasters@teaparty.net Subject: RE: NVRAM6 Card Installed in the Wrong Slot
Thanks Tony, Thanks Andrei,
I was only asked to pass a quick eye over the system to spot any obvious issues. I ran Config Advisor and it came back clean with regard to cabling, etc. However, it took nearly 10 minutes for CA to complete the query and the systems I look after normally complete in 20 seconds. I then started to wonder about possible network issues in addition to the NVRAM card location.
I was mostly curious about what the impact of having the NVRAM in the wrong slot would be. My colleague is going to look at his network and move the NVRAM card and let me know if things are better. If not, I'll run a perfstat. I've never used the LatX tool so I'll be sure to check it out.
If LatX doesn't bear any fruit I'll post some statit snippets here. Hopefully I won't have to take up any of your time.
Cheers, Steve -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
IF I recall... Placing the NVRAM card in the "HA" slot will halve the NVRAM and establish a baseline for the system to think it is part of an HA pair Placing the NVRAM card in the "non-HA" will normalize everything.
However, There are going to be a number of environment variables that will need to be cleared / removed
I would suggest opening a case with NetApp before you do this. I may not be as simple as moving the card.
I *think* the BIOS command is "set-defaults" which will default EVERYTHING -> all environment variables get cleared.
That may do it and the system should boot. Please check with support to be sure.
--tmac
*Tim McCarthy* *Principal Consultant*
On Tue, Jul 7, 2015 at 9:52 AM, Borzenkov, Andrei < andrei.borzenkov@ts.fujitsu.com> wrote:
Note that moving NVRAM means shutting down filer and this alone may clear any temporary resource shortage.
-----Original Message----- From: Stephen Stocke [mailto:Stephen.Stocke@je.logicalis.com] Sent: Tuesday, July 07, 2015 4:50 PM To: Tony Bar; Borzenkov, Andrei Cc: toasters@teaparty.net Subject: RE: NVRAM6 Card Installed in the Wrong Slot
Thanks Tony, Thanks Andrei,
I was only asked to pass a quick eye over the system to spot any obvious issues. I ran Config Advisor and it came back clean with regard to cabling, etc. However, it took nearly 10 minutes for CA to complete the query and the systems I look after normally complete in 20 seconds. I then started to wonder about possible network issues in addition to the NVRAM card location.
I was mostly curious about what the impact of having the NVRAM in the wrong slot would be. My colleague is going to look at his network and move the NVRAM card and let me know if things are better. If not, I'll run a perfstat. I've never used the LatX tool so I'll be sure to check it out.
If LatX doesn't bear any fruit I'll post some statit snippets here. Hopefully I won't have to take up any of your time.
Cheers, Steve
This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Thanks Tim
Unfortunately, this is an old system that was upgraded and no longer under support. However, your tip led me to dig through the HA Configuration Guide for 8.1 7-mode and find the procedure.
For the benefit of future Googlers, the procedure to properly split an HA pair into two stand-alone systems is:
1. Ensure uniform disk ownership.
Use the "disk show -v" command to identify any shelves or loops which contain disks owned by both controllers. Record the information and decide which controller will own the shelf/loop.
2. Disable controller failover.
Use the commands "cf disable" and "license delete cf" to disable failover. Modify the /etc/rc file to remove references to the partner node in ifconfig entries.
3. Reconfigure nodes for stand-alone operation
Issue the "halt" command on both nodes.
From: tmac [tmacmd@gmail.com] Sent: 07 July 2015 15:14 To: Borzenkov, Andrei Cc: Stephen Stocke; Tony Bar; toasters@teaparty.net Subject: Re: NVRAM6 Card Installed in the Wrong Slot
IF I recall... Placing the NVRAM card in the "HA" slot will halve the NVRAM and establish a baseline for the system to think it is part of an HA pair Placing the NVRAM card in the "non-HA" will normalize everything.
However, There are going to be a number of environment variables that will need to be cleared / removed
I would suggest opening a case with NetApp before you do this. I may not be as simple as moving the card.
I *think* the BIOS command is "set-defaults" which will default EVERYTHING -> all environment variables get cleared.
That may do it and the system should boot. Please check with support to be sure.
--tmac
Tim McCarthy Principal Consultant -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
There is another command we sometimes need to run from the loader or cfe prompt to remove the environment variable for the partner. Otherwise the controller won't upgrade disk firmware in some cases because of a cluster dependency.
Loader/CFE> unsetenv partner-sysid
-----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Stephen Stocke Sent: Tuesday, July 7, 2015 11:17 PM To: tmac; Borzenkov, Andrei Cc: toasters@teaparty.net Subject: RE: NVRAM6 Card Installed in the Wrong Slot
Thanks Tim
Unfortunately, this is an old system that was upgraded and no longer under support. However, your tip led me to dig through the HA Configuration Guide for 8.1 7-mode and find the procedure.
For the benefit of future Googlers, the procedure to properly split an HA pair into two stand-alone systems is:
1. Ensure uniform disk ownership.
Use the "disk show -v" command to identify any shelves or loops which contain disks owned by both controllers. Record the information and decide which controller will own the shelf/loop.
2. Disable controller failover.
Use the commands "cf disable" and "license delete cf" to disable failover. Modify the /etc/rc file to remove references to the partner node in ifconfig entries.
3. Reconfigure nodes for stand-alone operation
Issue the "halt" command on both nodes.
From: tmac [tmacmd@gmail.com] Sent: 07 July 2015 15:14 To: Borzenkov, Andrei Cc: Stephen Stocke; Tony Bar; toasters@teaparty.net Subject: Re: NVRAM6 Card Installed in the Wrong Slot
IF I recall... Placing the NVRAM card in the "HA" slot will halve the NVRAM and establish a baseline for the system to think it is part of an HA pair Placing the NVRAM card in the "non-HA" will normalize everything.
However, There are going to be a number of environment variables that will need to be cleared / removed
I would suggest opening a case with NetApp before you do this. I may not be as simple as moving the card.
I *think* the BIOS command is "set-defaults" which will default EVERYTHING -> all environment variables get cleared.
That may do it and the system should boot. Please check with support to be sure.
--tmac
Tim McCarthy Principal Consultant -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Yes. Sorry but I hit send by mistake instead of save while the message was only half composed!
That will trip up someone! Thanks for fixing it for me, Scott.
From: Gelb, Scott Sent: Wednesday 8 July 07:31 Subject: RE: NVRAM6 Card Installed in the Wrong Slot To: Stephen Stocke, tmac, Borzenkov, Andrei Cc: 'toasters@teaparty.net'
There is another command we sometimes need to run from the loader or cfe prompt to remove the environment variable for the partner. Otherwise the controller won't upgrade disk firmware in some cases because of a cluster dependency. Loader/CFE> unsetenv partner-sysid -----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Stephen Stocke Sent: Tuesday, July 7, 2015 11:17 PM To: tmac; Borzenkov, Andrei Cc: toasters@teaparty.net Subject: RE: NVRAM6 Card Installed in the Wrong Slot Thanks Tim Unfortunately, this is an old system that was upgraded and no longer under support. However, your tip led me to dig through the HA Configuration Guide for 8.1 7-mode and find the procedure. For the benefit of future Googlers, the procedure to properly split an HA pair into two stand-alone systems is: 1. Ensure uniform disk ownership. Use the "disk show -v" command to identify any shelves or loops which contain disks owned by both controllers. Record the information and decide which controller will own the shelf/loop. 2. Disable controller failover. Use the commands "cf disable" and "license delete cf" to disable failover. Modify the /etc/rc file to remove references to the partner node in ifconfig entries. 3. Reconfigure nodes for stand-alone operation Issue the "halt" command on both nodes. From: tmac [tmacmd@gmail.com] Sent: 07 July 2015 15:14 To: Borzenkov, Andrei Cc: Stephen Stocke; Tony Bar; toasters@teaparty.net Subject: Re: NVRAM6 Card Installed in the Wrong Slot IF I recall... Placing the NVRAM card in the "HA" slot will halve the NVRAM and establish a baseline for the system to think it is part of an HA pair Placing the NVRAM card in the "non-HA" will normalize everything. However, There are going to be a number of environment variables that will need to be cleared / removed I would suggest opening a case with NetApp before you do this. I may not be as simple as moving the card. I *think* the BIOS command is "set-defaults" which will default EVERYTHING -> all environment variables get cleared. That may do it and the system should boot. Please check with support to be sure. --tmac Tim McCarthy Principal Consultant -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal -------------------------------------------------------------------------------- disclaimer This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any). Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes. The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF _______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
There is another command we sometimes need to run from the loader or cfe prompt to remove the environment variable for the partner. Otherwise the controller won't upgrade disk firmware in some cases because of a cluster dependency.
Loader/CFE> unsetenv partner-sysid
-----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Stephen Stocke Sent: Tuesday, July 7, 2015 11:17 PM To: tmac; Borzenkov, Andrei Cc: toasters@teaparty.net Subject: RE: NVRAM6 Card Installed in the Wrong Slot
Thanks Tim
Unfortunately, this is an old system that was upgraded and no longer under support. However, your tip led me to dig through the HA Configuration Guide for 8.1 7-mode and find the procedure.
For the benefit of future Googlers, the procedure to properly split an HA pair into two stand-alone systems is:
1. Ensure uniform disk ownership.
Use the "disk show -v" command to identify any shelves or loops which contain disks owned by both controllers. Record the information and decide which controller will own the shelf/loop.
2. Disable controller failover.
Use the commands "cf disable" and "license delete cf" to disable failover. Modify the /etc/rc file to remove references to the partner node in ifconfig entries.
3. Reconfigure nodes for stand-alone operation
Issue the "halt" command on both nodes.
From: tmac [tmacmd@gmail.com] Sent: 07 July 2015 15:14 To: Borzenkov, Andrei Cc: Stephen Stocke; Tony Bar; toasters@teaparty.net Subject: Re: NVRAM6 Card Installed in the Wrong Slot
IF I recall... Placing the NVRAM card in the "HA" slot will halve the NVRAM and establish a baseline for the system to think it is part of an HA pair Placing the NVRAM card in the "non-HA" will normalize everything.
However, There are going to be a number of environment variables that will need to be cleared / removed
I would suggest opening a case with NetApp before you do this. I may not be as simple as moving the card.
I *think* the BIOS command is "set-defaults" which will default EVERYTHING -> all environment variables get cleared.
That may do it and the system should boot. Please check with support to be sure.
--tmac
Tim McCarthy Principal Consultant -------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
-------------------------------------------------------------------------------- This e-mail message has been scanned for Viruses and Content and cleared by MailMarshal --------------------------------------------------------------------------------
disclaimer
This email communication does not create or vary any contractual relationship between LogicalisCI and you. Internet communications are not secure and accordingly LogicalisCI does not accept any legal liability for the contents of this message. The contents of this email are confidential to the intended recipient at the email address to which it has been addressed. It may not be disclosed to or used by anyone other than this addressee, nor may it be copied in any way. If received in error, please contact LogicalisCI on the above number (listed as Main) quoting the name of the sender and the addressee and then delete it from your system. Please note that neither LogicalisCI nor the sender accepts any responsibility for viruses and it is your responsibility to scan the email and attachments (if any).
Please be aware that LogicalisCI may monitor email traffic data and also email content for security purposes.
The following companies are collectively referred to in the above statements as LogicalisCI: Logicalis Channel Islands Limited, Registered in Jersey No: 67161, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Jersey Limited, Registered in Jersey No: 10124, Registered Office: Rue A La Dame, Five Oaks, St. Saviour, Jersey, JE2 7NH Logicalis Guernsey Limited, Registered in Guernsey No: 10896, Registered Office: Pitronnerie Road, St. Peter Port, Guernsey, GY1 2RF
-
Borzenkov, Andrei -
Gelb, Scott -
Stephen Stocke -
tmac -
Tony Bar