RE: ndmpcopy, jndmpcopy and multiple level 1 transfers

-- Michael W. Sphar - IS&T - Lead Systems Administrator SMBU Engineering Support Services, BMC Software -----Original Message----- From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Paul Letta Sent: Friday, November 10, 2006 7:22 AM To: toasters@mathworks.com Subject: ndmpcopy, jndmpcopy and multiple level 1 transfers I am getting ready to do a big data migration. I am planning on doing an initial level 0, and then multiple level 1's leading up to the big day. I know the that native ndmpcopy in OnTap 7.1 can only do one level 1, and one level 2 for each level 0. But I have read that if you get ndmpcopy or jnmdpcopy from ndmp.org that it supports multiple level 1 dumps based on the same level 0. But I am getting the same errors I got with the native ndmpcopy when I use ndmpcopy and jndmpcopy from a unix host. I just grabbed the latest copies for ndmp.org yesterday. > java jndmpcopy.JNdmpcopy -version java version "1.4.2" gcj (GCC) 3.4.6 20060404 (Red Hat 3.4.6-3) So I did a level 0, and then one level 1 that both worked just fine. Then I re-ran the level 1 with the same command, and get the errors below. This is the same error I get if I try this with the native ndmpcopy command on the filer itself. I am moving about 1TB of data (about 16M files) off of 1 traditional volume onto multiple new flex vols on the same filer. If what I'm doing is flat out wrong, what would others suggest ? tar wouldn't give me the incrementals and rsync would take a long time with this number of files. Suggestions ? Thanks, Paul > java jndmpcopy.JNdmpcopy filer:/vol/vol0/source filer:/vol/destination -sa xxxxxxx -da xxxxxxx -level 1 Nov 09 03:53:25 [ndmpd:0]: Now waiting for source and destination to finish. SrcFiler: Nov 09 03:53:25 [ndmpd:0]: DUMP: creating "/vol/vol0/../snapshot_for_backup.153" snapshot. SrcFiler: Nov 09 03:53:26 [ndmpd:0]: DUMP: Using subtree dump SrcFiler: Nov 09 03:53:42 [ndmpd:0]: DUMP: Date of this level 1 dump: Thu Nov 9 15:53:25 2006. SrcFiler: Nov 09 03:53:42 [ndmpd:0]: DUMP: Date of last level 0 dump: Thu Nov 9 15:48:10 2006. SrcFiler: Nov 09 03:53:42 [ndmpd:0]: DUMP: Dumping /vol/vol0/source to NDMP connection SrcFiler: Nov 09 03:53:42 [ndmpd:0]: DUMP: mapping (Pass I)[regular files] SrcFiler: Nov 09 03:53:43 [ndmpd:0]: DUMP: mapping (Pass II)[directories] SrcFiler: Nov 09 03:54:09 [ndmpd:0]: DUMP: estimated 18 KB. SrcFiler: Nov 09 03:54:09 [ndmpd:0]: DUMP: dumping (Pass III) [directories] DstFiler: Nov 09 03:54:13 [ndmpd:0]: RESTORE: Thu Nov 9 15:54:13 2006: Begin incremental restore DstFiler: Nov 09 03:54:13 [ndmpd:0]: RESTORE: This incremental dump does not follow the previous dump that you have restored. DstFiler: Nov 09 03:54:13 [ndmpd:0]: RESTORE: This dump is based on Thu Nov 9 15:48:10 2006. DstFiler: Nov 09 03:54:13 [ndmpd:0]: RESTORE: It should be based on Thu Nov 9 15:50:28 2006. DstFiler: Nov 09 03:54:13 [ndmpd:0]: RESTORE: Could not use tape. DstFiler: Nov 09 03:54:13 [ndmpd:0]: RESTORE: RESTORE IS ABORTED Nov 09 03:54:13 [ndmpd:0]: DstFiler just halted. Nov 09 03:54:13 [ndmpd:0]: Reason: ndmp_data_halted_internal_error : Dump aborted. SrcFiler: Nov 09 03:54:13 [ndmpd:0]: DUMP: dumping (Pass IV) [regular files] SrcFiler: Nov 09 03:54:17 [ndmpd:0]: DUMP: Network communication error SrcFiler: Nov 09 03:54:17 [ndmpd:0]: DUMP: DUMP IS ABORTED SrcFiler: Nov 09 03:54:18 [ndmpd:0]: DUMP: Deleting "/vol/vol0/../snapshot_for_backup.153" snapshot. Nov 09 03:54:19 [ndmpd:0]: SrcFiler just halted. Nov 09 03:54:19 [ndmpd:0]: Reason: ndmp_data_halted_internal_error : Dump aborted. Nov 09 03:54:19 [ndmpd:0]: jndmpcopy finished -- Paul Letta Thomas Jefferson National Accelerator Facility Computer Center Unix System Administrator EMail: letta@jlab.org Phone: (757)269-5106