Aside from goin up in ontap version to 8 (currently at 726 and going to 733) and upgrading hardware (currently a 3070) is the 16tb aggr size a hard limit ?
Sent via BlackBerry from T-Mobile
AS far as I know, It is a hard-coded limit into ONTAP with regards to memory structures. It *is* a 32-bit file system and you cannot go above 16TB.
Moving to ONTAP, i.e. MAJOR UPGRADE, the filesystem has been completely redone as a 64-bit File System. You cannot just upgrade the filesystem either. You must use some data movement technology to relocate your date from the 32-bit aggr to the 64-bit aggr.
Things like Snapmirror, volcopy, ndmpcopy, rsync, etc.
--tmac
On Fri, Jul 30, 2010 at 4:52 PM, lists@up-south.com wrote:
Aside from goin up in ontap version to 8 (currently at 726 and going to 733) and upgrading hardware (currently a 3070) is the 16tb aggr size a hard limit ?
Sent via BlackBerry from T-Mobile
On Fri, Jul 30, 2010 at 08:52:48PM +0000, lists@up-south.com wrote:
Aside from goin up in ontap version to 8 (currently at 726 and going to 733) and upgrading hardware (currently a 3070) is the 16tb aggr size a hard limit ?
It is my understandign that 8 has two modes: 8-in-7 mode, which still has the annoying 16 TB limit, and 'native' 8-mode which does not have that limit. Also, keep in mind that to move to >16 TB aggr, you have to recreate aggr and reinitialize snapmirror, which is really not funny to do.
Do you think 8 is ready for production use? (I mean that as a neutral question)
Grtnx,
Not exactly true. 7-mode in ONTAP 8 does have larger than 16T aggregates, although it is for new aggregates. How large depends on your model, but it can be as high as 100T out of the gate with future increases to come in future releases.
-- Adam Fox Systems Engineer adamfox@netapp.com
-----Original Message----- From: Bert Kiers [mailto:kiersb@xs4all.net] Sent: Friday, July 30, 2010 5:09 PM To: lists@up-south.com Cc: Toasters Subject: Re: max aggr size of 16TB
On Fri, Jul 30, 2010 at 08:52:48PM +0000, lists@up-south.com wrote:
Aside from goin up in ontap version to 8 (currently at 726 and going to 733) and upgrading hardware (currently a 3070) is the 16tb aggr size a hard limit ?
It is my understandign that 8 has two modes: 8-in-7 mode, which still has the annoying 16 TB limit, and 'native' 8-mode which does not have that limit. Also, keep in mind that to move to >16 TB aggr, you have to recreate aggr and reinitialize snapmirror, which is really not funny to do.
Do you think 8 is ready for production use? (I mean that as a neutral question)
Grtnx,
On Fri, Jul 30, 2010 at 05:20:17PM -0400, Fox, Adam wrote:
Not exactly true. 7-mode in ONTAP 8 does have larger than 16T aggregates, although it is for new aggregates. How large depends on your model, but it can be as high as 100T out of the gate with future increases to come in future releases.
That is good to hear. But then, what is the difference between 7-mode and native?
Any tips on how to migrate? We are thinking about breaking the sync- mirror relation in out FMC, the recreating one aggr on one side, do vol copy, then destroying the other side and reinitialize the sync mirror. The vol copy will however take too long as far as we know now. Now we have several aggr with 2 volumes each, close to 16 TB, with email and we cannot afford more than 1 or 2 hours downtime.
Even at 10 GbE (which interfaces we don't have), it will take minimum 4.5 hours that way :( And breaking the mirror makes me nervous.
Grtnx,
Now that aggregate sizes are inching up (finally!) have they also raised the limit on the number of volumes in an aggregate as well?
I'm starting to think that a single large aggregate covering my 3140s, with bunchs of volumes is the way to move forward. I like qtrees too, but they're a pain to manage as well.
And don't even talk to me about SnapMirror across a WAN. It's good when the changerate is low, but god forbid someone creates a 100g file, waits for a snapshot and then deletes it. Blows the SLA out the window...
John
On Tue, Aug 03, 2010 at 10:30:31AM -0400, John Stoffel wrote:
Hi,
And don't even talk to me about SnapMirror across a WAN. It's good when the changerate is low, but god forbid someone creates a 100g file, waits for a snapshot and then deletes it. Blows the SLA out the window...
What is a low changerate? We are snapmirroring 8 multi-TB volumes with chagerates of about 3637877 KB/hour (email, one file per mail), scheduled every hour without problems across a WAN.
Grtnx,
"Bert" == Bert Kiers kiersb@xs4all.net writes:
Bert> On Tue, Aug 03, 2010 at 10:30:31AM -0400, John Stoffel wrote: Bert> Hi,
And don't even talk to me about SnapMirror across a WAN. It's good when the changerate is low, but god forbid someone creates a 100g file, waits for a snapshot and then deletes it. Blows the SLA out the window...
Bert> What is a low changerate? We are snapmirroring 8 multi-TB Bert> volumes with chagerates of about 3637877 KB/hour (email, one Bert> file per mail), scheduled every hour without problems across a Bert> WAN.
We're looking at a WAN link across the US, and we can have changes of upto 500gb per day (creates, modifies, deletes) which are just tough to handle.
John
Actually 8.0 in 7-mode supports both 32 and 64 bit aggrs and can therefore create large aggrs.
As for the math for 32-bit aggr max size, 2^32 (#addressable blocks) * 4k (the block size) = 16TB.
Share and enjoy!
Peter Learmonth Virtualization Solutions Architect
NetApp 408.822.6072
peterl@netapp.com http://blogs.netapp.com/getvirtical/
-----Original Message----- From: Bert Kiers [mailto:kiersb@xs4all.net] Sent: Friday, July 30, 2010 2:09 PM To: lists@up-south.com Cc: Toasters Subject: Re: max aggr size of 16TB
On Fri, Jul 30, 2010 at 08:52:48PM +0000, lists@up-south.com wrote:
Aside from goin up in ontap version to 8 (currently at 726 and going to 733) and upgrading hardware (currently a 3070) is the 16tb aggr size a hard limit ?
It is my understandign that 8 has two modes: 8-in-7 mode, which still has the annoying 16 TB limit, and 'native' 8-mode which does not have that limit. Also, keep in mind that to move to >16 TB aggr, you have to recreate aggr and reinitialize snapmirror, which is really not funny to do.
Do you think 8 is ready for production use? (I mean that as a neutral question)
Grtnx,
ONTAP 8.0 is not limited to 16TB aggregates in 7-mode. The maximum 64 bit aggregate size is platform specific. For instance, here are the maximum 64 bit aggregate sizes for various controller models (listed in the system configuration guide on NOW):
3140 - 40TB 3160 - 50TB 3170 - 70TB 6040 - 70TB 6080 - 100TB
On Jul 30, 2010, at 5:09 PM, Bert Kiers wrote:
It is my understandign that 8 has two modes: 8-in-7 mode, which still has the annoying 16 TB limit, and 'native' 8-mode which does not have that limit.