we have done the "disk replace" method mentioned and it worked without a flaw. it took a few weeks but we actually were able to remove 6 physical shelves with no downtime other than a planned cf takeover->uncable loops of unused shelves->cf giveback.

-- Daniel Leeds Manager, Storage Operations Edmunds, Inc. 1620 26th Street, Suite 400 South Santa Monica, CA 90404

310-309-4999 desk 310-430-0536 cell

-----Original Message----- From: owner-toasters@mathworks.com on behalf of Nils Vogels Sent: Thu 11/13/2008 1:16 PM To: Ray Van Dolson Cc: toasters@mathworks.com Subject: Re: Removing a shelf.

Hey Ray,

On Thu, Nov 13, 2008 at 9:31 PM, Ray Van Dolson rvandolson@esri.com wrote:

An aggregate spans two shelves, one of which is the shelf that needs to be returned. This aggregate contains a FlexVol currently in use. I'd like to preserve the FlexVol but remove the shelf.

If you can afford the downtime, you could offline the aggregate concerned, swap the disks into the shelf that can remain, and online the aggregate again. Should be a few minutes.

Another way, which does take a lot longer, is to use "disk replace" to copy the used disks from their old position to their new ones. No downtime, but the disks get copied one at a time, which can be a few hours.

HTH & HAND

You can get access to the console through the rlm port.

On 11/14/08, Ray Van Dolson rvandolson@esri.com wrote:

On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:

...

Hi all;

We have a loaner NetApp that has three shelves on it. One of those shelves needs to be returned to the vendor.

An aggregate spans two shelves, one of which is the shelf that needs to be returned. This aggregate contains a FlexVol currently in use. I'd like to preserve the FlexVol but remove the shelf.

What are my options? Doesn't look like I can shrink an aggregate. Is my best bet to shut down everything usin the FlexVol, then vol copy it to another aggregate, destroy the original aggregate, remove the shelf and then recreate the aggregate again?

Thanks in advance! Ray

Thanks all for the response.

It's only a 512GB (SIS enabled) volume, so I created a new volume on the other aggregate and am using vol copy to copy the data over. This seems incredibly slow (it's estimating two hours to complete) -- I thought it might be a little quicker since there is only about 130GB of data on the volume.

Gotta figure out how to up the concurrent login limit on the filer as well, can't even fire up another console to stop the copy if I wanted to! :)

Thanks, Ray

On Fri, Nov 14, 2008 at 09:43:49AM -0800, Ray Van Dolson wrote:

On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:

...

Hi all;

We have a loaner NetApp that has three shelves on it. One of those shelves needs to be returned to the vendor.

An aggregate spans two shelves, one of which is the shelf that needs to be returned. This aggregate contains a FlexVol currently in use. I'd like to preserve the FlexVol but remove the shelf.

What are my options? Doesn't look like I can shrink an aggregate. Is my best bet to shut down everything usin the FlexVol, then vol copy it to another aggregate, destroy the original aggregate, remove the shelf and then recreate the aggregate again?

Thanks in advance! Ray

Thanks all for the response.

It's only a 512GB (SIS enabled) volume, so I created a new volume on the other aggregate and am using vol copy to copy the data over. This seems incredibly slow (it's estimating two hours to complete) -- I thought it might be a little quicker since there is only about 130GB of data on the volume.

Gotta figure out how to up the concurrent login limit on the filer as well, can't even fire up another console to stop the copy if I wanted to! :)

Thanks, Ray

So go the volume all moved. Went well. However, I just realized that vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely while the filer is running?

I guess I could snapshot it, vol copy it to aggr1... what would be the side-effects though?

Ray

On Fri, Nov 14, 2008 at 02:12:12PM -0800, Webster, Stetson wrote:

How to move or rename the root volume on a filer: https://now.netapp.com/Knowledgebase/solutionarea.asp?id=kb6360

Thanks Stetson... perfect.

Ray

Probably too late to the party given the rest of the thread, but the plan that Daniel mentioned is the best\easiest: replace the disks with ones that are on the shelf you own.

Here's another way to do it:

If you have to return the shelf, you have to take downtime ANYWAYS (cannot hot-remove shelf from loop)... so just move all the disks from one shelf to the other and give it back to NetApp. Or better even, if the shelf you have to give back has data disks on it, and the shelf you have to keep does not, just give them the other shelf (assuming they are the same).

Glenn

________________________________

From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Leeds, Daniel Sent: Friday, November 14, 2008 5:15 PM To: Ray Van Dolson; toasters@mathworks.com Subject: RE: Removing a shelf.

one by one disk replace. if vol0 were a trad volume with 2 disks you would disk replace the first one to a spare disk on the other aggregate. once complete do the same with the other disk. do this *one by one* for all disks that make up your vol0 volume.

-- Daniel Leeds Manager, Storage Operations Edmunds, Inc. 1620 26th Street, Suite 400 South Santa Monica, CA 90404

310-309-4999 desk 310-430-0536 cell

-----Original Message----- From: owner-toasters@mathworks.com on behalf of Ray Van Dolson Sent: Fri 11/14/2008 1:55 PM To: toasters@mathworks.com Subject: Re: Removing a shelf.

On Fri, Nov 14, 2008 at 09:43:49AM -0800, Ray Van Dolson wrote:

On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:

...

Hi all;

We have a loaner NetApp that has three shelves on it. One of those shelves needs to be returned to the vendor.

An aggregate spans two shelves, one of which is the shelf that needs

to

...

be returned. This aggregate contains a FlexVol currently in use.

I'd

...

like to preserve the FlexVol but remove the shelf.

What are my options? Doesn't look like I can shrink an aggregate.

Is

...

my best bet to shut down everything usin the FlexVol, then vol copy

it

...

to another aggregate, destroy the original aggregate, remove the

shelf

...

and then recreate the aggregate again?

Thanks in advance! Ray

Thanks all for the response.

It's only a 512GB (SIS enabled) volume, so I created a new volume on the other aggregate and am using vol copy to copy the data over. This seems incredibly slow (it's estimating two hours to complete) -- I thought it might be a little quicker since there is only about 130GB

of

data on the volume.

Gotta figure out how to up the concurrent login limit on the filer as well, can't even fire up another console to stop the copy if I wanted to! :)

Thanks, Ray

So go the volume all moved. Went well. However, I just realized that vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely while the filer is running?

I guess I could snapshot it, vol copy it to aggr1... what would be the side-effects though?

Ray

On Fri, Nov 14, 2008 at 02:17:04PM -0800, Nicholas Bernstein wrote:

On 11/14/08 1:55 PM, "Ray Van Dolson" rvandolson@esri.com wrote:

...

So go the volume all moved. Went well. However, I just realized that vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely while the filer is running?

I guess I could snapshot it, vol copy it to aggr1... what would be the side-effects though?

Ray

There's no side-effects that I know of, it's a normal vol copy, afik. The new volume won't be the "root" volume until you give it a: "vol options newvol root" though; once you reboot your filer newvol is then root.

-Nick

FWIW I did the following:

* aggr0 is the old aggregate I need to get rid of containing vol0 which is the default root volume currently

vol create root aggr1 90g ndmpd on ndmpcopy /etc /vol/root/etc ndmpd off vol options root root aggr options aggr1 root

At a later time I'll perform these steps:

reboot vol offline vol0 vol rename root vol0 aggr offline aggr0 aggr destroy aggr0 aggr rename aggr1 aggr0

Then I should be able to remove my shelf and hopefully all will be well. :)

Ray

On Fri, Nov 14, 2008 at 03:09:24PM -0800, Ray Van Dolson wrote:

On Fri, Nov 14, 2008 at 02:17:04PM -0800, Nicholas Bernstein wrote:

...

On 11/14/08 1:55 PM, "Ray Van Dolson" rvandolson@esri.com wrote:

...

So go the volume all moved. Went well. However, I just realized that vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely while the filer is running?

I guess I could snapshot it, vol copy it to aggr1... what would be the side-effects though?

Ray

There's no side-effects that I know of, it's a normal vol copy, afik. The new volume won't be the "root" volume until you give it a: "vol options newvol root" though; once you reboot your filer newvol is then root.

-Nick

FWIW I did the following:

• aggr0 is the old aggregate I need to get rid of containing vol0 which is the default root volume currently

...

vol create root aggr1 90g ndmpd on ndmpcopy /etc /vol/root/etc ndmpd off vol options root root aggr options aggr1 root

At a later time I'll perform these steps:

...

reboot vol offline vol0 vol rename root vol0 aggr offline aggr0 aggr destroy aggr0 aggr rename aggr1 aggr0

Then I should be able to remove my shelf and hopefully all will be well. :)

Ray

Follow-up on this... everything went well. I would like to have tried the disk fail option, but this method went quite smoothly and only ended up being a few minutes of downtime.

Thanks again to all for the assistance!

Ray