Stephen,
Actually it was me that had the problem with ndmpcopy....
Problem: File system was fragmented due to manner in which addition of disks was done. We would add 1 or 2 at a time over the last 2 years. It got to the point where backups were kicked off but it would be 3+ hours before it would write to tape.
ndmpcopy: When I attempted to use ndmpcopy to split this volume up I got the same write delay and a transfer rate of 1gb/hr. Yes, that's ONE GB per HOUR. So, 156 hours later........ Not a chance.
A NetApp SE was onsite to witness this and had no idea why it was doing this. Finally settled on rsync. Do you have any idea why it would do this?
~JK
Stephen Manley wrote:
Hi Jessica,
I'm curious why you would think filesystem fragmentation would prevent the use of NDMPcopy?
NDMPcopy, by its nature, acts as a natural file system defragmenter -- that is, the system that is the destination of the NDMPcopy has pretty much an ideal file system layout for performance.
And because the NDMPcopy data stream generator is integrated into the filer, it should be able to read a fragmented file system better than rsync...
Is your experience different than my theory, or am I missing something blindingly obvious?
Stephen Manley DAM and NDMP Circus Clown
I would imagine the most efficient method is to use snapmirror. However, if you have the problem I do which is wanting to copy specific data from one volume to another you use something like ndmpcopy. My particular case is special and ndmpcopy doesn't work for me either due to filesystem fragmentation so rsync is my only option.
~JK
Jessica Fernandez wrote:
What are your recommendations of copying data from one filer to another?
I have estimated time of 28 hours to transfer 70 GB via a copy command on the host machine.
I have tried to copy via CIFS accessing from NT servers using drag and drop. Encountered errors which halted the copy process due to files that were linked to incorrect locations. Unix files in the users desktop were linked to other machines and the path was invalid. Did a grep to locate these linked files in the user folders, and found too many to change one by one.
The vol copy command is only useful when copying from volume to volume on the same filer, correct?
I am looking for the most efficient way to move data.
Any suggestions would be great!
JessicaJESSICA A. S. FERNANDEZ ESA-FM Facility Management E-mail: jasf@lanl.gov TA-16-661-101, MS-C933 Voice: 505-665-8051 Los Alamos National Laboratory Pager: 104-6707 Los Alamos, New Mexico 87545 FAX: 505-665-9490
--
Jeff Kennedy Unix Administrator AMCC jlkennedy@amcc.com