Hi people,
I am contemplating going to cluster mode on our 3170A and was wondering what peoples experience has been?
Any problems or gotchas?
We are on 8.1.2.
Regards, pdg
watcha going to use it for?
Date: Mon, 3 Dec 2012 11:52:24 +1100 From: pdg@uow.edu.au To: toasters@teaparty.net Subject: On cluster mode
Hi people,
I am contemplating going to cluster mode on our 3170A and was wondering what peoples experience has been?
Any problems or gotchas?
We are on 8.1.2.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
I'd suggest having a good conversation with your sales team to talk about the benefits and downsides. There are a few things to consider. As mentioned, you can't just upgrade. It's a data migration if you wish to keep existing data.
On 12/2/12 10:22 PM, "Peter D. Gray" pdg@uow.edu.au wrote:
On Mon, Dec 03, 2012 at 01:35:55AM +0000, steve klise wrote:
watcha going to use it for?
Its our main production filer, so we use it for everything.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
WE aren't running it yet, but I think when CIFS 3.0 is supported, we will take serious look. One thing Netapp should be working on is a forklift option; maybe its not an option to upgrade (yet), so its going to be a pain to migrate for us. Any new project, we will take a look. The other problem is we snapmirror most of our stuff and as of now, 7mode and cluster mode are not compatible.. I think you will need different DFM versions to monitor your environment, but don't quote me on that.. We have been waiting for other apps to catch up, such as Varonis, NTP software, etc.
Date: Mon, 3 Dec 2012 14:22:31 +1100 From: pdg@uow.edu.au To: sklise@hotmail.com CC: pdg@uow.edu.au; toasters@teaparty.net Subject: Re: On cluster mode
On Mon, Dec 03, 2012 at 01:35:55AM +0000, steve klise wrote:
watcha going to use it for?
Its our main production filer, so we use it for everything.
Regards, pdg
On Mon, Dec 03, 2012 at 03:35:12AM +0000, steve klise wrote:
WE aren't running it yet, but I think when CIFS 3.0 is supported, we will take serious look. One thing Netapp should be working on is a forklift option; maybe its not an option to upgrade (yet), so its going to be a pain to migrate for us. Any new project, we will take a look. The other problem is we snapmirror most of our stuff and as of now, 7mode and cluster mode are not compatible.. I think you will need different DFM versions to monitor your environment, but don't quote me on that.. We have been waiting for other apps to catch up, such as Varonis, NTP software, etc.
The driver for this for me is I am getting really really tired of moving data between volumes/aggrgates to manage space and performance. With our new cheap and slow sata drives, this is becoming a full time job (yes we have cache).
It would be so nice to move data without downtime.
It looks like it is ready for prime time, it the migration issues that will slow it all down.
Regards, pdg
I would agree.. I think I have moved the original bits 3 times now..
I think getting the data into some sort of data mover (vfilers, vservers, etc) is a step in the right direction. Each year, its about 400 hours of my time is dealing with upgrades, downtime, communication, blah blah.. If NA would have had an acopia like device a few years ago, this would have helped with multiple CIF migrations.. At least with the cluster mode, it can scale, and has a global name space.
Steve
From: toasters-bounces@teaparty.net [toasters-bounces@teaparty.net] On Behalf Of Peter D. Gray [pdg@uow.edu.au] Sent: Sunday, December 02, 2012 8:06 PM To: toasters@teaparty.net Subject: Re: On cluster mode
On Mon, Dec 03, 2012 at 03:35:12AM +0000, steve klise wrote:
WE aren't running it yet, but I think when CIFS 3.0 is supported, we will take serious look. One thing Netapp should be working on is a forklift option; maybe its not an option to upgrade (yet), so its going to be a pain to migrate for us. Any new project, we will take a look. The other problem is we snapmirror most of our stuff and as of now, 7mode and cluster mode are not compatible.. I think you will need different DFM versions to monitor your environment, but don't quote me on that.. We have been waiting for other apps to catch up, such as Varonis, NTP software, etc.
The driver for this for me is I am getting really really tired of moving data between volumes/aggrgates to manage space and performance. With our new cheap and slow sata drives, this is becoming a full time job (yes we have cache).
It would be so nice to move data without downtime.
It looks like it is ready for prime time, it the migration issues that will slow it all down.
Regards, pdg
_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Whilst probably a minor inconvenience you will lose active CIFS connections when you move a volume.
As such, you may still find you need to notify users/schedule changes out of hours etc.
-----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Klise, Steve Sent: 03 December 2012 04:11 To: Peter D. Gray; toasters@teaparty.net Subject: RE: On cluster mode
I would agree.. I think I have moved the original bits 3 times now..
I think getting the data into some sort of data mover (vfilers, vservers, etc) is a step in the right direction. Each year, its about 400 hours of my time is dealing with upgrades, downtime, communication, blah blah.. If NA would have had an acopia like device a few years ago, this would have helped with multiple CIF migrations.. At least with the cluster mode, it can scale, and has a global name space.
Steve
From: toasters-bounces@teaparty.net [toasters-bounces@teaparty.net] On Behalf Of Peter D. Gray [pdg@uow.edu.au] Sent: Sunday, December 02, 2012 8:06 PM To: toasters@teaparty.net Subject: Re: On cluster mode
On Mon, Dec 03, 2012 at 03:35:12AM +0000, steve klise wrote:
WE aren't running it yet, but I think when CIFS 3.0 is supported, we will take serious look. One thing Netapp should be working on is a forklift option; maybe its not an option to upgrade (yet), so its going to be a pain to migrate for us. Any new project, we will take a look. The other problem is we snapmirror most of our stuff and as of now, 7mode and cluster mode are not compatible.. I think you will need different DFM versions to monitor your environment, but don't quote me on that.. We have been waiting for other apps to catch up, such as Varonis, NTP software, etc.
The driver for this for me is I am getting really really tired of moving data between volumes/aggrgates to manage space and performance. With our new cheap and slow sata drives, this is becoming a full time job (yes we have cache).
It would be so nice to move data without downtime.
It looks like it is ready for prime time, it the migration issues that will slow it all down.
Regards, pdg
_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters _______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
To report this email as spam click https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ== .
Member of the CSR plc group of companies. CSR plc registered in England and Wales, registered number 4187346, registered office Churchill House, Cambridge Business Park, Cowley Road, Cambridge, CB4 0WZ, United Kingdom More information can be found at www.csr.com. Follow CSR on Twitter at http://twitter.com/CSR_PLC and read our blog at www.csr.com/blog
No loss of connection with clustered ONTAP when moving volumes around !
You might have a blip, when you move the LIF... OTOH 'indirect' access is having only a minimal impact on latency, so you can safely keep the LIF where it was until a more convenient time.
Sebastian
On 03.12.2012 11:47, Darren Sykes wrote:
Whilst probably a minor inconvenience you will lose active CIFS connections when you move a volume.
As such, you may still find you need to notify users/schedule changes out of hours etc.
-----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Klise, Steve Sent: 03 December 2012 04:11 To: Peter D. Gray; toasters@teaparty.net Subject: RE: On cluster mode
I would agree.. I think I have moved the original bits 3 times now..
I think getting the data into some sort of data mover (vfilers, vservers, etc) is a step in the right direction. Each year, its about 400 hours of my time is dealing with upgrades, downtime, communication, blah blah.. If NA would have had an acopia like device a few years ago, this would have helped with multiple CIF migrations.. At least with the cluster mode, it can scale, and has a global name space.
Steve
From: toasters-bounces@teaparty.net [toasters-bounces@teaparty.net] On Behalf Of Peter D. Gray [pdg@uow.edu.au] Sent: Sunday, December 02, 2012 8:06 PM To: toasters@teaparty.net Subject: Re: On cluster mode
On Mon, Dec 03, 2012 at 03:35:12AM +0000, steve klise wrote:
WE aren't running it yet, but I think when CIFS 3.0 is supported, we will take serious look. One thing Netapp should be working on is a forklift option; maybe its not an option to upgrade (yet), so its going to be a pain to migrate for us. Any new project, we will take a look. The other problem is we snapmirror most of our stuff and as of now, 7mode and cluster mode are not compatible.. I think you will need different DFM versions to monitor your environment, but don't quote me on that.. We have been waiting for other apps to catch up, such as Varonis, NTP software, etc.
The driver for this for me is I am getting really really tired of moving data between volumes/aggrgates to manage space and performance. With our new cheap and slow sata drives, this is becoming a full time job (yes we have cache).
It would be so nice to move data without downtime.
It looks like it is ready for prime time, it the migration issues that will slow it all down.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters _______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
To report this email as spam click https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ== .
Member of the CSR plc group of companies. CSR plc registered in England and Wales, registered number 4187346, registered office Churchill House, Cambridge Business Park, Cowley Road, Cambridge, CB4 0WZ, United Kingdom More information can be found at www.csr.com. Follow CSR on Twitter at http://twitter.com/CSR_PLC and read our blog at www.csr.com/blog
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
You're absolutely right - hadn't engaged my brain this morning.
Moving LIFs does break connections, as does failing back aggregates when locks exist from CIFS clients (assuming you choose to override the locks).
As for the latency introduced by accessing the 'wrong node', we'll have to agree to differ on that. We have a very small average file size and see very noticeable differences between remote and local DBLADE access.
Darren
-----Original Message----- From: Sebastian Goetze [mailto:spgoetze@gmail.com] Sent: 03 December 2012 11:09 To: Darren Sykes Cc: Klise, Steve; Peter D. Gray; toasters@teaparty.net Subject: Re: On cluster mode
No loss of connection with clustered ONTAP when moving volumes around !
You might have a blip, when you move the LIF... OTOH 'indirect' access is having only a minimal impact on latency, so you can safely keep the LIF where it was until a more convenient time.
Sebastian
On 03.12.2012 11:47, Darren Sykes wrote:
Whilst probably a minor inconvenience you will lose active CIFS connections when you move a volume.
As such, you may still find you need to notify users/schedule changes out of hours etc.
-----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Klise, Steve Sent: 03 December 2012 04:11 To: Peter D. Gray; toasters@teaparty.net Subject: RE: On cluster mode
I would agree.. I think I have moved the original bits 3 times now..
I think getting the data into some sort of data mover (vfilers, vservers, etc) is a step in the right direction. Each year, its about 400 hours of my time is dealing with upgrades, downtime, communication, blah blah.. If NA would have had an acopia like device a few years ago, this would have helped with multiple CIF migrations.. At least with the cluster mode, it can scale, and has a global name space.
Steve
From: toasters-bounces@teaparty.net [toasters-bounces@teaparty.net] On Behalf Of Peter D. Gray [pdg@uow.edu.au] Sent: Sunday, December 02, 2012 8:06 PM To: toasters@teaparty.net Subject: Re: On cluster mode
On Mon, Dec 03, 2012 at 03:35:12AM +0000, steve klise wrote:
WE aren't running it yet, but I think when CIFS 3.0 is supported, we will take serious look. One thing Netapp should be working on is a forklift option; maybe its not an option to upgrade (yet), so its going to be a pain to migrate for us. Any new project, we will take a look. The other problem is we snapmirror most of our stuff and as of now, 7mode and cluster mode are not compatible.. I think you will need different DFM versions to monitor your environment, but don't quote me on that.. We have been waiting for other apps to catch up, such as Varonis, NTP software, etc.
The driver for this for me is I am getting really really tired of moving data between volumes/aggrgates to manage space and performance. With our new cheap and slow sata drives, this is becoming a full time job (yes we have cache).
It would be so nice to move data without downtime.
It looks like it is ready for prime time, it the migration issues that will slow it all down.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters _______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
To report this email as spam click https://www.mailcontrol.com/sr/MZbqvYs5QwJvpeaetUwhCQ== .
Member of the CSR plc group of companies. CSR plc registered in England and Wales, registered number 4187346, registered office Churchill House, Cambridge Business Park, Cowley Road, Cambridge, CB4 0WZ, United Kingdom More information can be found at www.csr.com. Follow CSR on Twitter at http://twitter.com/CSR_PLC and read our blog at www.csr.com/blog
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
To the best if my knowledge, there is still no in place upgrade to clustered ontap. You must migrate to different heads.
With that said, I have three different clusters... One large (4 fas 6280's) in my lab, one small(2 x fas 3240's) on my regular network and one more (2 x fas6080) used as backup or inter cluster snap mirror.
Still 8.1.1p1d1
All I can say right now is watch out for a few nfsv4/parallel NFS bugs. Other than that... It had been real nice. On Dec 2, 2012 7:57 PM, "Peter D. Gray" pdg@uow.edu.au wrote:
Hi people,
I am contemplating going to cluster mode on our 3170A and was wondering what peoples experience has been?
Any problems or gotchas?
We are on 8.1.2.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Hi,
Your mentioned in the cluster thread of NFSv4 bugs caught my eye. Can you elaborate on that? We are moving RHEL 6.x servers to NFSv4 and a few odd issues have popped up (Bad Sequence ID errors, losing mounts).
Running 8.1.1P1 across the board.
On Dec 2, 2012, at 8:57 PM, tmac tmacmd@gmail.com wrote:
To the best if my knowledge, there is still no in place upgrade to clustered ontap. You must migrate to different heads.
With that said, I have three different clusters... One large (4 fas 6280's) in my lab, one small(2 x fas 3240's) on my regular network and one more (2 x fas6080) used as backup or inter cluster snap mirror.
Still 8.1.1p1d1
All I can say right now is watch out for a few nfsv4/parallel NFS bugs. Other than that... It had been real nice.
On Dec 2, 2012 7:57 PM, "Peter D. Gray" pdg@uow.edu.au wrote: Hi people,
I am contemplating going to cluster mode on our 3170A and was wondering what peoples experience has been?
Any problems or gotchas?
We are on 8.1.2.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters _______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Should have mentioned the bugs that I have seen are fixed in 8.1.2
In my environment....performance related bugs. I was fine with a couple dozen hosts... opening the floodgates to a couple hundred nfsv4 hosts broke. Had to revert to nfsv3 (not a big deal, just revert the autofs table I was using).
--tmac
*Tim McCarthy* *Principal Consultant*
Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE5 805007643429572 NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Expires w/release of RHEL7 Expires: 08 November 2014
On Mon, Dec 3, 2012 at 9:07 AM, Scott Eno s.eno@me.com wrote:
Hi,
Your mentioned in the cluster thread of NFSv4 bugs caught my eye. Can you elaborate on that? We are moving RHEL 6.x servers to NFSv4 and a few odd issues have popped up (Bad Sequence ID errors, losing mounts).
Running 8.1.1P1 across the board.
On Dec 2, 2012, at 8:57 PM, tmac tmacmd@gmail.com wrote:
To the best if my knowledge, there is still no in place upgrade to clustered ontap. You must migrate to different heads.
With that said, I have three different clusters... One large (4 fas 6280's) in my lab, one small(2 x fas 3240's) on my regular network and one more (2 x fas6080) used as backup or inter cluster snap mirror.
Still 8.1.1p1d1
All I can say right now is watch out for a few nfsv4/parallel NFS bugs. Other than that... It had been real nice. On Dec 2, 2012 7:57 PM, "Peter D. Gray" pdg@uow.edu.au wrote:
Hi people,
I am contemplating going to cluster mode on our 3170A and was wondering what peoples experience has been?
Any problems or gotchas?
We are on 8.1.2.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Are there any NetApp bug reports you can point me to?
We aren't using any of the "higher brain functions" of NFSv4 like file ownership and kerberos. UNIX admins started using it to fix a problem they saw on a volume shared by, up to, 17 hosts. Under NFSv3, when one host would write a file to the volume, other hosts wouldn't see the file. This problem goes away with NFSv4 mounts. Other problems, however, are appearing. A host will lose a mount to the NetApp and start writing to local disk. The RHEL OS, however, is adamant that the mount is still there. Very strange.
They are also seeing "Bad Sequence ID" errors in the RHEL logs, but both NetApp and Red Hat claim this issue was resolved in earlier versions of their respective OS's.
Now I'm wondering if 8.1.2 contains enough fixes for NFSv4 to cover our issues as well.
On Dec 3, 2012, at 9:13 AM, tmac tmacmd@gmail.com wrote:
Should have mentioned the bugs that I have seen are fixed in 8.1.2
In my environment....performance related bugs. I was fine with a couple dozen hosts... opening the floodgates to a couple hundred nfsv4 hosts broke. Had to revert to nfsv3 (not a big deal, just revert the autofs table I was using).
--tmac
Tim McCarthy Principal Consultant
Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE5 805007643429572 NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Expires w/release of RHEL7 Expires: 08 November 2014
On Mon, Dec 3, 2012 at 9:07 AM, Scott Eno s.eno@me.com wrote: Hi,
Your mentioned in the cluster thread of NFSv4 bugs caught my eye. Can you elaborate on that? We are moving RHEL 6.x servers to NFSv4 and a few odd issues have popped up (Bad Sequence ID errors, losing mounts).
Running 8.1.1P1 across the board.
On Dec 2, 2012, at 8:57 PM, tmac tmacmd@gmail.com wrote:
To the best if my knowledge, there is still no in place upgrade to clustered ontap. You must migrate to different heads.
With that said, I have three different clusters... One large (4 fas 6280's) in my lab, one small(2 x fas 3240's) on my regular network and one more (2 x fas6080) used as backup or inter cluster snap mirror.
Still 8.1.1p1d1
All I can say right now is watch out for a few nfsv4/parallel NFS bugs. Other than that... It had been real nice.
On Dec 2, 2012 7:57 PM, "Peter D. Gray" pdg@uow.edu.au wrote: Hi people,
I am contemplating going to cluster mode on our 3170A and was wondering what peoples experience has been?
Any problems or gotchas?
We are on 8.1.2.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters _______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Can't say I have seen your issues. There have been plenty of RHEL NFS fixes in most of the kernel release thus far. All I can tell you is to try it out and be prepared to revert to nfsv3 if it doesn't work out.
If it does not work out, try and set up a small testbed where you can get line traces and open support calls with NetApp and/or RedHat.
--tmac
*Tim McCarthy* *Principal Consultant*
Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE5 805007643429572 NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Expires w/release of RHEL7 Expires: 08 November 2014
On Mon, Dec 3, 2012 at 9:23 AM, Scott Eno s.eno@me.com wrote:
Are there any NetApp bug reports you can point me to?
We aren't using any of the "higher brain functions" of NFSv4 like file ownership and kerberos. UNIX admins started using it to fix a problem they saw on a volume shared by, up to, 17 hosts. Under NFSv3, when one host would write a file to the volume, other hosts wouldn't see the file. This problem goes away with NFSv4 mounts. Other problems, however, are appearing. A host will lose a mount to the NetApp and start writing to local disk. The RHEL OS, however, is adamant that the mount is still there. Very strange.
They are also seeing "Bad Sequence ID" errors in the RHEL logs, but both NetApp and Red Hat claim this issue was resolved in earlier versions of their respective OS's.
Now I'm wondering if 8.1.2 contains enough fixes for NFSv4 to cover our issues as well.
On Dec 3, 2012, at 9:13 AM, tmac tmacmd@gmail.com wrote:
Should have mentioned the bugs that I have seen are fixed in 8.1.2
In my environment....performance related bugs. I was fine with a couple dozen hosts... opening the floodgates to a couple hundred nfsv4 hosts broke. Had to revert to nfsv3 (not a big deal, just revert the autofs table I was using).
--tmac
*Tim McCarthy* *Principal Consultant*
Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE5 805007643429572 NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Expires w/release of RHEL7 Expires: 08 November 2014
On Mon, Dec 3, 2012 at 9:07 AM, Scott Eno s.eno@me.com wrote:
Hi,
Your mentioned in the cluster thread of NFSv4 bugs caught my eye. Can you elaborate on that? We are moving RHEL 6.x servers to NFSv4 and a few odd issues have popped up (Bad Sequence ID errors, losing mounts).
Running 8.1.1P1 across the board.
On Dec 2, 2012, at 8:57 PM, tmac tmacmd@gmail.com wrote:
To the best if my knowledge, there is still no in place upgrade to clustered ontap. You must migrate to different heads.
With that said, I have three different clusters... One large (4 fas 6280's) in my lab, one small(2 x fas 3240's) on my regular network and one more (2 x fas6080) used as backup or inter cluster snap mirror.
Still 8.1.1p1d1
All I can say right now is watch out for a few nfsv4/parallel NFS bugs. Other than that... It had been real nice. On Dec 2, 2012 7:57 PM, "Peter D. Gray" pdg@uow.edu.au wrote:
Hi people,
I am contemplating going to cluster mode on our 3170A and was wondering what peoples experience has been?
Any problems or gotchas?
We are on 8.1.2.
Regards, pdg
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters