NDMP copy (within a filer).

2nd example is from a Solaris (2.6?) to a filer.

Note: This was from a F630 filer on a 100tx-fd connection. Light load on the subnet.

John Summers

Subject: ndmpcopy speed test

John,

I did some ndmpcopy speed test and here's the results:

-- Using the loopback on a 630 -- limited to 10Mbps --or-- 1.5MBps

ultra5-rtp@root> ./ndmpcopy f630-rtp:/vol/vol0 f630-rtp:/vol/vol2 Password: Connecting to f630-rtp. Connecting to f630-rtp. f630-rtp: CONNECT: Connection established. f630-rtp: CONNECT: Connection established. f630-rtp: LOG: DUMP: f630-rtp: LOG: creating "/vol/vol0/../snapshot_for_backup.55" snapshot. f630-rtp: LOG: DUMP: f630-rtp: LOG: Using Full Volume Dump f630-rtp: LOG: DUMP: f630-rtp: LOG: Date of this level 0 dump: Thu Mar 7 12:41:56 2002. f630-rtp: LOG: DUMP: f630-rtp: LOG: Date of last level 0 dump: the epoch. f630-rtp: LOG: DUMP: f630-rtp: LOG: Dumping /vol/vol0/ to NDMP connection f630-rtp: LOG: DUMP: f630-rtp: LOG: mapping (Pass I)[regular files] f630-rtp: LOG: DUMP: f630-rtp: LOG: mapping (Pass II)[directories] f630-rtp: LOG: DUMP: f630-rtp: LOG: estimated 112610 KB. f630-rtp: LOG: DUMP: f630-rtp: LOG: dumping (Pass III) [directories] f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:42:00 2002: Begin level 0 restore f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:42:00 2002: Reading directories from the backup f630-rtp: LOG: DUMP: f630-rtp: LOG: dumping (Pass IV) [regular files] f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:42:00 2002: Creating files and directories. f630-rtp: LOG: RESTORE: f630-rtp: LOG: Warning: cannot create directory etc: File exists f630-rtp: LOG: RESTORE: f630-rtp: LOG: Warning: cannot create directory tmp: File exists f630-rtp: LOG: RESTORE: f630-rtp: LOG: The file: ./restore_symboltable could not be restored with its original name. f630-rtp: LOG: RESTORE: f630-rtp: LOG: It has been renamed to: ./rstabRENAME3C8B5BA4 f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:42:01 2002: Writing data to files. f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:43:09 2002: Restoring NT ACLs. f630-rtp: LOG: DUMP: f630-rtp: LOG: dumping (Pass V) [ACLs] f630-rtp: LOG: DUMP: f630-rtp: LOG: 112587 KB f630-rtp: LOG: DUMP: f630-rtp: LOG: DUMP IS DONE f630-rtp: LOG: DUMP: f630-rtp: LOG: Deleting "/vol/vol0/../snapshot_for_backup.55" snapshot. f630-rtp: LOG: RESTORE: f630-rtp: LOG: RESTORE IS DONE f630-rtp: HALT: The operation was successful! Waiting for f630-rtp to halt too. The transfer was successful, but the source filer hasn't halted yet. Elapsed time: 0 hours, 1 minutes, 22 seconds.

f630-rtp: HALT: The operation was successful! The transfer is complete. Elapsed time: 0 hours, 1 minutes, 23 seconds.

-- sysstat is showing a throughput of ~1.8MBps

ultra5-rtp@root> rsh f630-rtp sysstat -sx 5 CPU NFS CIFS HTTP Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk in out read write read write age hit time ty util 1% 0 0 0 0 0 0 11 40 0 0 >60 100% 3% T 3% 0% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 1% 0 0 0 0 0 0 9 39 0 0 >60 100% 3% T 4% 0% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 1% 0 0 0 0 0 0 9 39 0 0 >60 100% 3% T 4% 4% 0 0 0 0 1 1 349 82 0 0 >60 97% 12% 2 16% 85% 0 0 0 0 825 825 1695 2046 0 0 >60 96% 22% F 32% 48% 0 0 0 0 1291 1291 1580 12759 0 0 >60 99% 100% : 100% 68% 0 0 0 0 2685 2685 2947 8422 0 0 >60 100% 78% B 69% 42% 0 0 0 0 1902 1902 1924 6442 0 0 >60 100% 66% F 51% 47% 0 0 0 0 2568 2568 2543 5582 0 0 >60 100% 49% F 45% 27% 0 0 0 0 1715 1715 1683 1229 0 0 >60 99% 13% F 11% 33% 0 0 0 0 1570 1569 1764 4264 0 0 >60 98% 38% : 34% 45% 0 0 0 0 2244 2244 2140 5722 0 0 >60 100% 50% F 46% 20% 0 0 0 0 1240 1240 2329 0 0 0 >60 99% 0% - 86% 26% 0 0 0 0 951 951 1330 5629 0 0 >60 100% 48% F 59% 20% 0 0 0 0 1339 1339 1806 0 0 0 >60 98% 0% - 66% 46% 0 0 0 0 1757 1757 2380 5375 0 0 >60 99% 48% F 64% 22% 0 0 0 0 1401 1401 1287 0 0 0 >60 100% 0% - 14% CPU NFS CIFS HTTP Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk in out read write read write age hit time ty util 56% 0 0 0 0 1951 1951 1756 6995 0 0 >60 100% 72% F 59% 47% 0 0 0 0 48 48 79 3974 0 0 >60 100% 49% Z 32% 0% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 12% 0 0 0 0 0 0 96 5488 0 0 >60 100% 42% T 41% 1% 0 0 0 0 0 0 3 18 0 0 >60 100% 2% : 2% 18% 642 0 0 642 135 217 0 0 0 0 >60 100% 0% - 0%

============================================= -- ndmpcopy via the 100Mbps link:

ultra5-rtp@root> ./ndmpcopy f810-rtp:/vol/vol0 f630-rtp:/vol/vol2 Password: Connecting to f810-rtp. Connecting to f630-rtp. f810-rtp: CONNECT: Connection established. f630-rtp: CONNECT: Connection established. f810-rtp: LOG: DUMP: f810-rtp: LOG: creating "/vol/vol0/../snapshot_for_backup.5" snapshot. f810-rtp: LOG: DUMP: f810-rtp: LOG: Using Full Volume Dump f810-rtp: LOG: DUMP: f810-rtp: LOG: Date of this level 0 dump: Thu Mar 7 12:43:34 2002. f810-rtp: LOG: DUMP: f810-rtp: LOG: Date of last level 0 dump: the epoch. f810-rtp: LOG: DUMP: f810-rtp: LOG: Dumping /vol/vol0/ to NDMP connection f810-rtp: LOG: DUMP: f810-rtp: LOG: mapping (Pass I)[regular files] f810-rtp: LOG: DUMP: f810-rtp: LOG: mapping (Pass II)[directories] f810-rtp: LOG: DUMP: f810-rtp: LOG: estimated 195915 KB. f810-rtp: LOG: DUMP: f810-rtp: LOG: dumping (Pass III) [directories] f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:44:10 2002: Begin level 0 restore f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:44:10 2002: Reading directories from the backup f810-rtp: LOG: DUMP: f810-rtp: LOG: dumping (Pass IV) [regular files] f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:44:12 2002: Creating files and directories. f630-rtp: LOG: RESTORE: f630-rtp: LOG: Warning: cannot create directory etc: File exists f630-rtp: LOG: RESTORE: f630-rtp: LOG: Warning: cannot create directory tmp: File exists f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:44:13 2002: Writing data to files. f630-rtp: LOG: RESTORE: f630-rtp: LOG: Thu Mar 7 12:45:07 2002: Restoring NT ACLs. f810-rtp: LOG: DUMP: f810-rtp: LOG: dumping (Pass V) [ACLs] f810-rtp: LOG: DUMP: f810-rtp: LOG: 194475 KB f810-rtp: LOG: DUMP: f810-rtp: LOG: DUMP IS DONE f810-rtp: LOG: DUMP: f810-rtp: LOG: Deleting "/vol/vol0/../snapshot_for_backup.5" snapshot. f810-rtp: HALT: The operation was successful! Waiting for f630-rtp to halt too. f630-rtp: LOG: RESTORE: f630-rtp: LOG: RESTORE IS DONE f630-rtp: HALT: The operation was successful! The transfer is complete. Elapsed time: 0 hours, 1 minutes, 12 seconds.

-- sysstat showing a throughput of ~4.850 MBps

CPU NFS CIFS HTTP Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk in out read write read write age hit time ty util 1% 0 0 0 0 0 0 9 39 0 0 >60 100% 3% T 3% 1% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 1% 0 0 0 0 11 1 8 40 0 0 >60 92% 3% T 3% 48% 0 0 0 0 708 15 9 551 0 0 >60 95% 8% F 4% 76% 0 0 0 0 3036 63 212 12866 0 0 >60 100% 100% B 97% 96% 0 0 0 0 4835 100 181 10638 0 0 >60 100% 87% F 82% 100% 0 0 0 0 5087 105 178 10726 0 0 >60 100% 87% F 82% 63% 0 0 0 0 3220 67 107 6211 0 0 >60 100% 56% F 50% 100% 0 0 0 0 4991 103 175 10579 0 0 >60 100% 87% F 80% 95% 0 0 0 0 4901 101 161 9847 0 0 >60 100% 82% F 77% CPU NFS CIFS HTTP Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk in out read write read write age hit time ty util 100% 0 0 0 0 5268 109 171 10368 0 0 >60 100% 85% F 81% 35% 0 0 0 0 1582 33 95 5522 0 0 >60 100% 46% F 43% 7% 0 0 0 0 483 10 0 0 0 0 >60 100% 0% - 0% 81% 0 0 0 0 4305 89 124 7385 0 0 >60 100% 63% F 57% 87% 0 0 0 0 3066 63 167 10077 0 0 >60 100% 89% F 84% 0% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 1% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 12% 0 0 0 0 0 0 92 5349 0 0 >60 100% 42% T 40% 0% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 1% 0 0 0 0 0 0 11 40 0 0 >60 100% 3% T 3% 0% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 1% 0 0 0 0 0 0 12 42 0 0 >60 100% 4% T 4% 1% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0% 0% 0 0 0 0 0 0 0 0 0 0 >60 100% 0% - 0%