toasters

toasters@lists.teaparty.net

13531 discussions

Snapmirror throughput question
by Hill, Aaron 06 Mar '03

06 Mar '03

Hi people, What are the maximum data throughputs that Snapmirroring people are seeing across a WAN? Is anyone seeing 15-20+ Mbit bandwidth usage from a snapmirror data stream? The reason I ask is because I have a dedicated 20Mbit Ethernet link between 2 filers and am only seeing a maximum of 6-8Mbit of that available 20Mbit being used by snapmirror. Details; 1) No CPU or disk bottlenecking on source or target 2) Source is F880 target F820 3) 3 snapmirror streams at volume level 4) Approximately 30-60 Gb of data per volume is snapmirrored per day. 5) 20Mbit WAN is about 95% dedicated to Snapmirror. The rest is small ftp, http traffic etc. 6) ftp transfers have been tested between filers and these saturate the 20Mbit immediately 7) snapmirror.conf is set to transfer at 6am each day. Current kbs=10000. i.e. 1 transfer per volume per day. This is for Disaster recovery synchronization requirements. 8) No packets are being dropped on the switch interface. 9) Single 1000Mbit Interface on source filer, 100Mbit interface on target. 10) Neither interface shows saturation. 11) Unix clients only at both source and target filers. 98%+ would be NFS traffic. Now, NetApp support informs me that even if I had a dedicated VLAN between filer interfaces across the 20Mbit, I cannot expect to see full utilization. I do not believe this. Someone out there must be transferring large amounts of data across a WAN and have seen higher throughput. If you are seeing higher throughput rates, what type of setup do you have? Things I am currently considering; - multiple qtrees snapmirrored. i.e. more snapmirror streams results in more throughput - multiple snapmirror transfers per day - dedicated VLAN between source and target Any expert advice here would be appreciated. Thanks, Aaron www.navitaire.com

1 0

A humble plea from a novice.
by John Enger 06 Mar '03

06 Mar '03

I have just gotten hold of an old 2nd hand NetApp F330. I got it because I'm curious and l love to learn new things hands on. Most of my skills have been picked up by troubling and searching for info and so forth, but when it comes to the NetApp, things are very different. What I need is a good source of info on how it works, a prom monitor command map or similar. Where/how the OS is stored, very common info. I have been searching the net for this, but found nothing so far. I found you guys, but your discussions are way too advanced for me to participate in or to understand much of. At least until I get my own up and running... :o) So does anyone of you have a tip on where such info might be available? If it's at all available? Thanks! John

1 0

SnapMirror delays.
by Ngoh, Clarence 06 Mar '03

06 Mar '03

Hi folks I am having some difficulties tracking down a particular user or qtree that is causing delays on our SnapMirror process. The most relevant information of our setup are this: Filer head : FAS940 OS: DOT 6.3.1 Filername : Let's call it "FilerA" OS to troubleshoot from : Windows, but open sourced solutions welcomed. Filer A contains several different qtrees with different business units. Every so often, the snapshots are SnapMirrored to our DR site. Of late, we noticed that FilerA is lagging behind the DR site by a fair amount of time -- 16 hours. The amount of data transferred for this period is around 15 GB. Please do not offer solutions regarding network latency, as the amount of data change is the cause of the lag. I would like to trace the particular user or qtree that is making this changes. We are using DFM 2.1 for W2K server. DFM did not register data deletions or additions for any business unit -- I suspect then that data changes are the culprits, but where is this coming from? Cheers Clarence. ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. **************************************************

1 0

wafl scan
by Ambrose_Earle＠shamrockfoods.com 06 Mar '03

06 Mar '03

Does anyone have any (good) experience with the wafl scan commands? I am testing Snapmirror and used it to mirror 7x34's to 10x34's. Of course, the data was only written to the first seven drives, so I used 'wafl scan reallocate <volume>' and it seemed to improve the layout quite dramatically. Is this a good use of the command? Other than affecting performance, I'm assuming everything is accessible during the run of this command? Thanks in advance,

2 1

RE: Disk writes occuring when no network activity?
by Art Hebert 06 Mar '03

06 Mar '03

What I did was completely wipe out the netapp and reinstall 6.1.2R3. We are reracking our qa lab so I figured it would be a good time to let our Microsoft admin get to learn how to install a netapp, etc. So its a fresh install and before we put our databases back on it I did a sysstat and noticed the activity. I've let it run overnight so maybe the memory scrubs are finished and that was the activity. I am hoping at some point we can upgrade the netapps we have to the 960's and I can maybe get to attend Netapp training to get some inside knowledge of the boxes. We are running on a nonexistant budget and its tough supporting all this gear without maintenance contracts. art -----Original Message----- From: Borders, Rich [mailto:Rich.Borders@netapp.com] Sent: Thursday, March 06, 2003 2:52 AM To: Art Hebert; toasters(a)mathworks.com Subject: RE: Disk writes occuring when no network activity? Disk Scrubs? Did you just upgrade? > > -----Original Message----- > From: Art Hebert [mailto:art@arzoon.com] > Sent: Wednesday, March 05, 2003 11:02 PM > To: toasters(a)mathworks.com > > > Would anybody know why I have disk writes occurring on my > netapp when it is completely disconnected from the network. > It is doing memory scrubs, but would this cause writes to the disk? > > Here is what sysstat looks like. As you can see there isn't > any nfs, cifs or http activity. On my other filers that are > hooked up to a network the Disk writes go to zero when there > isn't any activity. > > smf760-01*> sysstat 1 > CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape > kB/s Cache > in out read write read > write age > 2% 0 0 0 0 0 0 762 0 > 0 59 > 1% 0 0 0 0 0 0 740 0 > 0 59 > 2% 0 0 0 0 0 0 752 0 > 0 59 > 1% 0 0 0 0 0 0 764 0 > 0 59 > 2% 0 0 0 0 0 0 788 0 > 0 59 > 1% 0 0 0 0 0 0 788 0 > 0 59 > 2% 0 0 0 0 0 0 784 0 > 0 59 > 1% 0 0 0 0 0 0 808 0 > 0 59 > 2% 0 0 0 0 0 0 804 0 > 0 59 > 3% 0 0 0 0 0 156 1108 0 > 0 59 > 2% 0 0 0 0 0 0 824 0 > 0 60 > 1% 0 0 0 0 0 0 868 0 > 0 60 > 2% 0 0 0 0 0 0 888 0 > 0 60 > 4% 0 0 0 0 0 0 880 0 > 0 60 > 2% 0 0 0 0 0 0 844 0 > 0 60 > 2% 0 0 0 0 0 0 892 0 > 0 60 > 2% 0 0 0 0 0 0 872 0 > 0 60 > 1% 0 0 0 0 0 0 880 0 > 0 60 > 2% 0 0 0 0 0 0 884 0 > 0 60 > CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape > kB/s Cache > in out read write read > write age > 1% 0 0 0 0 0 0 852 0 > 0 60 > 4% 0 0 0 0 0 164 1148 0 > 0 60 > > Thanks > > art >

1 0

RE: Disk writes occuring when no network activity?
by Borders, Rich 06 Mar '03

06 Mar '03

Disk Scrubs? Did you just upgrade? > > -----Original Message----- > From: Art Hebert [mailto:art@arzoon.com] > Sent: Wednesday, March 05, 2003 11:02 PM > To: toasters(a)mathworks.com > > > Would anybody know why I have disk writes occurring on my > netapp when it is completely disconnected from the network. > It is doing memory scrubs, but would this cause writes to the disk? > > Here is what sysstat looks like. As you can see there isn't > any nfs, cifs or http activity. On my other filers that are > hooked up to a network the Disk writes go to zero when there > isn't any activity. > > smf760-01*> sysstat 1 > CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape > kB/s Cache > in out read write read > write age > 2% 0 0 0 0 0 0 762 0 > 0 59 > 1% 0 0 0 0 0 0 740 0 > 0 59 > 2% 0 0 0 0 0 0 752 0 > 0 59 > 1% 0 0 0 0 0 0 764 0 > 0 59 > 2% 0 0 0 0 0 0 788 0 > 0 59 > 1% 0 0 0 0 0 0 788 0 > 0 59 > 2% 0 0 0 0 0 0 784 0 > 0 59 > 1% 0 0 0 0 0 0 808 0 > 0 59 > 2% 0 0 0 0 0 0 804 0 > 0 59 > 3% 0 0 0 0 0 156 1108 0 > 0 59 > 2% 0 0 0 0 0 0 824 0 > 0 60 > 1% 0 0 0 0 0 0 868 0 > 0 60 > 2% 0 0 0 0 0 0 888 0 > 0 60 > 4% 0 0 0 0 0 0 880 0 > 0 60 > 2% 0 0 0 0 0 0 844 0 > 0 60 > 2% 0 0 0 0 0 0 892 0 > 0 60 > 2% 0 0 0 0 0 0 872 0 > 0 60 > 1% 0 0 0 0 0 0 880 0 > 0 60 > 2% 0 0 0 0 0 0 884 0 > 0 60 > CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape > kB/s Cache > in out read write read > write age > 1% 0 0 0 0 0 0 852 0 > 0 60 > 4% 0 0 0 0 0 164 1148 0 > 0 60 > > Thanks > > art >

1 0

Disk writes occuring when no network activity?
by Art Hebert 06 Mar '03

06 Mar '03

Would anybody know why I have disk writes occurring on my netapp when it is completely disconnected from the network. It is doing memory scrubs, but would this cause writes to the disk? Here is what sysstat looks like. As you can see there isn't any nfs, cifs or http activity. On my other filers that are hooked up to a network the Disk writes go to zero when there isn't any activity. smf760-01*> sysstat 1 CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 2% 0 0 0 0 0 0 762 0 0 59 1% 0 0 0 0 0 0 740 0 0 59 2% 0 0 0 0 0 0 752 0 0 59 1% 0 0 0 0 0 0 764 0 0 59 2% 0 0 0 0 0 0 788 0 0 59 1% 0 0 0 0 0 0 788 0 0 59 2% 0 0 0 0 0 0 784 0 0 59 1% 0 0 0 0 0 0 808 0 0 59 2% 0 0 0 0 0 0 804 0 0 59 3% 0 0 0 0 0 156 1108 0 0 59 2% 0 0 0 0 0 0 824 0 0 60 1% 0 0 0 0 0 0 868 0 0 60 2% 0 0 0 0 0 0 888 0 0 60 4% 0 0 0 0 0 0 880 0 0 60 2% 0 0 0 0 0 0 844 0 0 60 2% 0 0 0 0 0 0 892 0 0 60 2% 0 0 0 0 0 0 872 0 0 60 1% 0 0 0 0 0 0 880 0 0 60 2% 0 0 0 0 0 0 884 0 0 60 CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 1% 0 0 0 0 0 0 852 0 0 60 4% 0 0 0 0 0 164 1148 0 0 60 Thanks art

1 0

etc/log/snapmirror.log parsing
by Todd C. Merrill 05 Mar '03

05 Mar '03

Has anyone written anything to parse the snapmirror logs to convert: dst Wed Mar 5 03:00:00 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 Request (Scheduled) dst Wed Mar 5 03:00:04 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 Start dst Wed Mar 5 03:51:58 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 End (28215980 KB) into something a bit more useful, like: dst Wed Mar 5 03:51:58 EST bat07:/vol/vol0/- bat00bak:/vol/vol1/bat07_vol0 End (28215980 kB, 00:51:54, 530 MB/min)? which adds elapsed time and transfer rate? Or, something further that completely parses the log and reports: Source Size Elapsed Rate ------------------------------------------------------------------ xxxxx:/vol/vol0/- 28215980 kB 00:51:54 530 MB/min zzzzz:/vol/vol0/qtree 4345164 kB 00:16:13 262 MB/min [...] for all my snapmirror transfers for the night? Until next time... The MathWorks, Inc. 508-647-7000 x7792 3 Apple Hill Drive, Natick, MA 01760-2098 508-647-7001 FAX tmerrill(a)mathworks.com http://www.mathworks.com ---

2 2

RE: etc/log/snapmirror.log parsing
by Yee, Steven 05 Mar '03

05 Mar '03

there is a snapmirror log parsing tool available on the tools section of NOW, if it doesn't do what you want it should be easily extendable (its in perl) from the NOW page blurb: SnapMirror Log Parser (parse_smlog) This Perl script is an example of how the SnapMirror log file can be parsed so that they can be more easily understood. This script runs under Perl5 and should run on most Unix based systems. steve. -----Original Message----- From: Todd C. Merrill [mailto:tmerrill@mathworks.com] Sent: Wednesday, March 05, 2003 8:08 AM To: toasters(a)mathworks.com Subject: etc/log/snapmirror.log parsing Has anyone written anything to parse the snapmirror logs to convert: dst Wed Mar 5 03:00:00 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 Request (Scheduled) dst Wed Mar 5 03:00:04 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 Start dst Wed Mar 5 03:51:58 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 End (28215980 KB) into something a bit more useful, like: dst Wed Mar 5 03:51:58 EST bat07:/vol/vol0/- bat00bak:/vol/vol1/bat07_vol0 End (28215980 kB, 00:51:54, 530 MB/min)? which adds elapsed time and transfer rate? Or, something further that completely parses the log and reports: Source Size Elapsed Rate ------------------------------------------------------------------ xxxxx:/vol/vol0/- 28215980 kB 00:51:54 530 MB/min zzzzz:/vol/vol0/qtree 4345164 kB 00:16:13 262 MB/min [...] for all my snapmirror transfers for the night? Until next time... The MathWorks, Inc. 508-647-7000 x7792 3 Apple Hill Drive, Natick, MA 01760-2098 508-647-7001 FAX tmerrill(a)mathworks.com http://www.mathworks.com ---

1 0

NetApp Logs
by Steve Evans 05 Mar '03

05 Mar '03

Are there any products out there that parse NetApp logs and will just show me/e-mail me/etc the interesting stuff. Steve Evans SDSU Foundation (619) 594-0653

1 0

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters