On Fri, Oct 19, 2012 at 2:49 PM, Peter Kain pkain42@gmail.com wrote:
Thanks for the quick replies:
The volume is the destination for a SnapMirror from the production filer.
The volume contains a single LUN.
FAS3210> df -h /vol/papayasg1_mirror Filesystem total used avail capacity Mounted on /vol/papayasg1_mirror/ 260GB 212GB 47GB 82% /vol/papayasg1_mirror/ /vol/papayasg1_mirror/.snapshot 0GB 11GB 0GB ---% /vol/papayasg1_mirror/.snapshot
The LUN is 200GB
FAS3210> lun show /vol/papayasg1_mirror/papayasg1db /vol/papayasg1_mirror/papayasg1db 200.0g (214778511360) (r/o, online)
NetApp OnCommand System Manager reports that the LUN is 60% used with 79GB free(not sure how to do this at the command line). So that would be 120GB used and that matches what I see when i run a dump. When I run smtape backup it reports 139GB backed up. Not sure why but I think it has to do with SnapShots.
Here's today's test run to a tape drive:
-- dump takes 19 minutes 34 seconds to back up 120GB@105MB/sec , which I consider to be rather good for an LTO4 tape drive
-- smtape backed up 139.481 GB bytes in 0:44:56 so 52MB/sec
FAS3210> sysstat -u 3 CPU Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk ops/s in out read write read write age hit time ty util 2% 0 0 0 0 0 0 0 >60 100% 0% - 0% 1% 0 0 0 0 0 0 0 >60 100% 0% - 0% 1% 0 0 0 9 297 0 0 >60 92% 4% T 3% 5% 0 0 0 0 0 0 0 >60 100% 0% - 0%
FAS3210> mt -f nrst0h status Tape drive: IBM LTO 4 ULT3580 Status: ready, write enabled Format: LTO 4 800GB fileno = 0 blockno = 0 resid = 0
FAS3210> date; dump 0f nrst0h /vol/papayasg1_mirror; date Fri Oct 19 12:58:34 PDT 2012
DUMP: Using Full Volume Dump DUMP: Dumping tape file 1 on nrst0h DUMP: Date of this level 0 dump: Fri Oct 19 02:50:36 2012.
DUMP: Date of last level 0 dump: the epoch. DUMP: Dumping /vol/papayasg1_mirror to nrst0h
DUMP: mapping (Pass I)[regular files] DUMP: mapping (Pass II)[directories] DUMP: estimated 126938643 KB.
DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: Fri Oct 19 13:03:35 2012 : We have written 33948408 KB. 32GB@110MBsec DUMP: Fri Oct 19 13:08:35 2012 : We have written 68791721 KB. 33GB@113MBsec DUMP: Fri Oct 19 13:13:35 2012 : We have written 99138845 KB. 28GB@98MB/sec DUMP: dumping (Pass V) [ACLs] DUMP: 126442444 KB DUMP: This dump has written to 1 tapefile(s). DUMP: DUMP IS DONE Fri Oct 19 13:18:08 PDT 2012
FAS3210> smtape backup /vol/papayasg1_mirror nrst0h
FAS3210> rdfile /etc/log/backup
(null) Fri Oct 19 13:20:18 PDT /vol/papayasg1_mirror CLI-Backup (nrst0h) 25 Fri Oct 19 13:20:18 PDT /vol/papayasg1_mirror BKP-Start (level 0 backup of Backup Set ID b93ab842-1bbc-11e2-8766-00a09813e8e0) 25 Fri Oct 19 13:20:18 PDT /vol/papayasg1_mirror BKP-Params (originator=CLI mode=dw-data tape_record_size=240KB tape=nrst0h all_snapshots tape_seeding) 25 Fri Oct 19 13:20:19 PDT /vol/papayasg1_mirror BKP-DW-Start 25 Fri Oct 19 14:05:12 PDT /vol/papayasg1_mirror BKP-DW-End (phase completed in 0:44:53; 34870380 blocks moved) 25 Fri Oct 19 14:05:14 PDT /vol/papayasg1_mirror BKP-Tape-Stats (wait_time=488s wait_count=264987 total_count=582596 avail_count=345482/79992/79015/78107) 25 Fri Oct 19 14:05:14 PDT /vol/papayasg1_mirror BKP-End (backed up 139.481 GB bytes in 0:44:56; performance=186.251 GB/hour) FAS3210>
FAS3210> snap list papayasg1_mirror Volume papayasg1_mirror working...
%/used %/total date name
0% ( 0%) 0% ( 0%) Oct 19 02:50 FAS3210(1573774893)_papayasg1_mirror.405 (snapmirror) 0% ( 0%) 0% ( 0%) Oct 19 02:50 @snapmir@{D1FE5C41-8C5A-4BAF-BE56-C7E32FCF8C0E}
0% ( 0%) 0% ( 0%) Oct 18 19:03 FAS3210(1573774893)_papayasg1_mirror.404 0% ( 0%) 0% ( 0%) Oct 18 19:03 @snapmir@{9937F7F6-FCC7-4D74-8A79-847C620B5825}
0% ( 0%) 0% ( 0%) Oct 18 19:01 exchsnap__papaya__recent 1% ( 1%) 0% ( 0%) Oct 17 19:01 exchsnap__papaya_10-17-2012_19.00.24__daily 1% ( 1%) 1% ( 0%) Oct 16 19:01 exchsnap__papaya_10-16-2012_19.00.27__daily 2% ( 0%) 1% ( 0%) Oct 16 03:17 FAS3210(1573774893)_papayasg1_mirror.399 (snapmirror) 2% ( 0%) 1% ( 0%) Oct 15 19:01 exchsnap__papaya_10-15-2012_19.00.25__daily 2% ( 0%) 1% ( 0%) Oct 15 13:07 exchsnap__papaya_10-15-2012_13.06.38__daily 3% ( 0%) 1% ( 0%) Oct 14 19:01 exchsnap__papaya_10-14-2012_19.00.26__daily 3% ( 0%) 1% ( 0%) Oct 13 19:01 exchsnap__papaya_10-13-2012_19.00.38__daily 3% ( 0%) 2% ( 0%) Oct 12 19:01 exchsnap__papaya_10-12-2012_19.00.31__daily 4% ( 0%) 2% ( 0%) Oct 11 19:01 exchsnap__papaya_10-11-2012_19.00.26__daily 4% ( 1%) 2% ( 0%) Oct 10 19:01 exchsnap__papaya_10-10-2012_19.00.32__daily 5% ( 1%) 2% ( 0%) Oct 09 19:01 exchsnap__papaya_10-09-2012_19.00.48__daily 6% ( 1%) 3% ( 0%) Oct 08 19:01 exchsnap__papaya_10-08-2012_19.00.30__daily 6% ( 1%) 3% ( 0%) Oct 07 19:01 exchsnap__papaya_10-07-2012_19.00.22__daily 6% ( 0%) 3% ( 0%) Oct 06 19:01 exchsnap__papaya_10-06-2012_19.00.34__daily 7% ( 0%) 3% ( 0%) Oct 05 19:01 exchsnap__papaya_10-05-2012_19.00.29__daily 7% ( 1%) 4% ( 0%) Oct 04 19:01 exchsnap__papaya_10-04-2012_19.00.28__daily 9% ( 2%) 5% ( 1%) Sep 26 21:51 FAS3210(1573774893)_papayasg1_mirror.358 (snapmirror)
Pete
On Fri, Oct 19, 2012 at 12:01 PM, Kennedy, Jeffrey jkennedy@qualcomm.comwrote:
Do you have a large volume with a small amount of data? Dump will only backup the data but smtape backs up all the blocks regardless if there’s data or not.****
Jeff Kennedy****
Qualcomm, Incorporated****
QCT Engineering Compute****
858-651-6592****
*From:* toasters-bounces@teaparty.net [mailto: toasters-bounces@teaparty.net] *On Behalf Of *Peter Kain *Sent:* Friday, October 19, 2012 10:24 AM *To:* toasters@teaparty.net *Subject:* smtape vs. dump****
I'm looking at backing up our filer to tape for DR purposes. I've tested both smtape and dump and was surprised that dump was 3 times faster than smtape. The test was preformed on a idle filer. The filer is the destination for SnapMirrors at night and idle during the day.
Given that smtape is a block backup I'd expect it to be as fast or faster than dump. The test Volume contains a single LUN.
FAS3210> version NetApp Release 8.0.2P6 7-Mode: Fri Jan 27 14:48:08 PST 2012
- filer is idle
FAS3210> sysstat -u 1 CPU Total Net kB/s Disk kB/s Tape kB/s Cache Cache CP CP Disk ops/s in out read write read write age hit time ty util 2% 0 1 0 0 0 0 0 2s 100% 0% - 0% 1% 0 2 2 0 0 0 0 2s 100% 0% - 0%
- dump to null takes about 13 minutes
FAS3210> date; dump f null /vol/papayasg1_mirror; date Tue Oct 16 12:48:06 PDT 2012 DUMP: Using Full Volume Dump
DUMP: Dumping tape file 1 on null DUMP: Date of this level 0 dump: Tue Oct 16 03:17:08 2012. DUMP: Date of last level 0 dump: the epoch. DUMP: Dumping /vol/papayasg1_mirror to null DUMP: mapping (Pass I)[regular files] DUMP: mapping (Pass II)[directories] DUMP: estimated 126361315 KB. DUMP: dumping (Pass III) [directories] DUMP: dumping (Pass IV) [regular files] DUMP: Tue Oct 16 12:53:07 2012 : We have written 52672652 KB. 50GB@171MB/sec DUMP: Tue Oct 16 12:58:07 2012 : We have written 99181873 KB. 44GB@151MB/sec DUMP: dumping (Pass V) [ACLs] DUMP: 125867380 KB 120GB@155MB/sec DUMP: DUMP IS DONE Tue Oct 16 13:01:18 PDT 2012
- smtape backup to null takes 44 minutes
FAS3210> rdfile /etc/log/backup (null) Tue Oct 16 13:05:32 PDT /vol/papayasg1_mirror CLI-Backup (null) 19 Tue Oct 16 13:05:32 PDT / vol/papayasg1_mirror BKP-Start (level 0 backup of Backup Set ID 2bc95ed2-195f-11e2-8766-00a09813e8e0) 19 Tue Oct 16 13:05:32 PDT /vol/papayasg1_mirror BKP-Params (originator=CLI mode=dw-data tape_record_size=240KB tape=null all_snapshots tape_seeding) 19 Tue Oct 16 13:05:33 PDT /vol/papayasg1_mirror BKP-DW-Start 19 Tue Oct 16 13:50:26 PDT /vol/papayasg1_mirror BKP-DW-End (phase completed in 0:44:53; 34394279 blocks moved) 19 Tue Oct 16 13:50:26 PDT /vol/papayasg1_mirror BKP-Tape-Stats (wait_time=0s wait_count=0 total_count=0 avail_count=0/0/0/0) 19 Tue Oct 16 13:50:26 PDT /vol/papayasg1_mirror BKP-End (backed up 137.577 GB bytes in 0:44:54; performance=183.844 GB/hour)
-- Pete Kain 310-506-4475****
-- Pete Kain 310-506-4475
-
Peter Kain