toasters

toasters@lists.teaparty.net

1 participants
13523 discussions

RE: Snapmirror throughput question
by Mohler, Jeff 07 Mar '03

07 Mar '03

This Vlan, is it delivered over ATM? -----Original Message----- From: Hill, Aaron [mailto:aaron.hill@navitaire.com <mailto:aaron.hill@navitaire.com> ] Sent: Thursday, March 06, 2003 4:31 PM To: 'Michael van Elst' Cc: 'toasters(a)mathworks.com' Subject: RE: Snapmirror throughput question Hey, thanks for the info. Here is the network path; Source Filer GigE ----- GigE on 4006 Cisco switch 100/FastE ---- 100/FastE 3660 Router 100/FastE ==== 20M VLAN ==== 100/FastE 3600 Router 100/FastE ---- 100/FastE 2924 Cisco Switch 100/FastE ---- 100/FastE Target Filer The VLAN carrier, UECOMM tells us no traffic shaping on the VLAN given to us. Our network team has no traffic shaping on the 3660 nor the 3600. See anything else in there causing an issue? Aaron -----Original Message----- From: Michael van Elst [mailto:mlelstv@serpens.de <mailto:mlelstv@serpens.de> ] Sent: Friday, March 07, 2003 10:44 AM To: Hill, Aaron Subject: Re: Snapmirror throughput question On Thu, Mar 06, 2003 at 04:40:11PM -0600, Hill, Aaron wrote: > Hi people, > What are the maximum data throughputs that Snapmirroring people are seeing > across a WAN? Is anyone seeing 15-20+ Mbit bandwidth usage from a snapmirror > data stream? I had a setup with three F840 clusters mirroring to a single F840 cluster using a 100Mbps tunnel. During the initial full copy this saturated the tunnel, the subsequent incremental updates were on a much lower level (4-8Mbps), because there weren't that many changes to the data. When I paused the mirror for a while and then resumed it, the then much bigger update again saturated the tunnel. The filers all had GigE and for the tunnel a dedicated GigE each, so that snapmirror traffic didn't compete with regular accesses. The filers were connected to Catalyst6509s that had a 100TX link to the tunnel routers. I am a bit confused what the "dedicated 20Mbit Ethernet link" of yours is exactly. If that's some kind of allocated bandwidth or subject to traffic shaping, it could easily explain the bad utilization. Greetings, -- Michael van Elst Internet: mlelstv(a)serpens.de "A potential Snark may lurk in every tree."

1 0

RE: A humble plea from a novice.
by Ngoh, Clarence 06 Mar '03

06 Mar '03

John Do you have an account with now.netapp.com? It provides a wealth of resources online and this includes manuals that come with the toasters :) You may find the following manuals useful: 1. The system administrator's guide 2. Data Protection Guide 3. Command Reference. This should get you started with the basic commands and setups. Regards, Clarence Ngoh Institutional Banking Services, Technology Office Level 5, 48 Martin Place Sydney, 2000 (o): +612 9378 5967 | (f): 02 9378 5202 | (e):clarence.ngoh@cba.com.au > -----Original Message----- > From: John Enger [mailto:john@johnenger.com] > Sent: Friday, 7 March 2003 09:38 AM > To: toasters(a)mathworks.com > Subject: A humble plea from a novice. > > > I have just gotten hold of an old 2nd hand NetApp F330. > I got it because I'm curious and l love to learn new things > hands on. Most of my skills have been picked up by troubling > and searching for info and so forth, but when it comes to the > NetApp, things are very different. > > What I need is a good source of info on how it works, a prom > monitor command map or similar. Where/how the OS is stored, > very common info. I have been searching the net for this, but > found nothing so far. > > I found you guys, but your discussions are way too advanced > for me to participate in or to understand much of. At least > until I get my own up and running... :o) > > So does anyone of you have a tip on where such info might be > available? If it's at all available? > > > Thanks! > > John > > ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. **************************************************

1 0

Snapmirror throughput question
by Hill, Aaron 06 Mar '03

06 Mar '03

Hi people, What are the maximum data throughputs that Snapmirroring people are seeing across a WAN? Is anyone seeing 15-20+ Mbit bandwidth usage from a snapmirror data stream? The reason I ask is because I have a dedicated 20Mbit Ethernet link between 2 filers and am only seeing a maximum of 6-8Mbit of that available 20Mbit being used by snapmirror. Details; 1) No CPU or disk bottlenecking on source or target 2) Source is F880 target F820 3) 3 snapmirror streams at volume level 4) Approximately 30-60 Gb of data per volume is snapmirrored per day. 5) 20Mbit WAN is about 95% dedicated to Snapmirror. The rest is small ftp, http traffic etc. 6) ftp transfers have been tested between filers and these saturate the 20Mbit immediately 7) snapmirror.conf is set to transfer at 6am each day. Current kbs=10000. i.e. 1 transfer per volume per day. This is for Disaster recovery synchronization requirements. 8) No packets are being dropped on the switch interface. 9) Single 1000Mbit Interface on source filer, 100Mbit interface on target. 10) Neither interface shows saturation. 11) Unix clients only at both source and target filers. 98%+ would be NFS traffic. Now, NetApp support informs me that even if I had a dedicated VLAN between filer interfaces across the 20Mbit, I cannot expect to see full utilization. I do not believe this. Someone out there must be transferring large amounts of data across a WAN and have seen higher throughput. If you are seeing higher throughput rates, what type of setup do you have? Things I am currently considering; - multiple qtrees snapmirrored. i.e. more snapmirror streams results in more throughput - multiple snapmirror transfers per day - dedicated VLAN between source and target Any expert advice here would be appreciated. Thanks, Aaron www.navitaire.com

1 0

A humble plea from a novice.
by John Enger 06 Mar '03

06 Mar '03

I have just gotten hold of an old 2nd hand NetApp F330. I got it because I'm curious and l love to learn new things hands on. Most of my skills have been picked up by troubling and searching for info and so forth, but when it comes to the NetApp, things are very different. What I need is a good source of info on how it works, a prom monitor command map or similar. Where/how the OS is stored, very common info. I have been searching the net for this, but found nothing so far. I found you guys, but your discussions are way too advanced for me to participate in or to understand much of. At least until I get my own up and running... :o) So does anyone of you have a tip on where such info might be available? If it's at all available? Thanks! John

1 0

SnapMirror delays.
by Ngoh, Clarence 06 Mar '03

06 Mar '03

Hi folks I am having some difficulties tracking down a particular user or qtree that is causing delays on our SnapMirror process. The most relevant information of our setup are this: Filer head : FAS940 OS: DOT 6.3.1 Filername : Let's call it "FilerA" OS to troubleshoot from : Windows, but open sourced solutions welcomed. Filer A contains several different qtrees with different business units. Every so often, the snapshots are SnapMirrored to our DR site. Of late, we noticed that FilerA is lagging behind the DR site by a fair amount of time -- 16 hours. The amount of data transferred for this period is around 15 GB. Please do not offer solutions regarding network latency, as the amount of data change is the cause of the lag. I would like to trace the particular user or qtree that is making this changes. We are using DFM 2.1 for W2K server. DFM did not register data deletions or additions for any business unit -- I suspect then that data changes are the culprits, but where is this coming from? Cheers Clarence. ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. **************************************************

1 0

wafl scan
by Ambrose_Earle＠shamrockfoods.com 06 Mar '03

06 Mar '03

Does anyone have any (good) experience with the wafl scan commands? I am testing Snapmirror and used it to mirror 7x34's to 10x34's. Of course, the data was only written to the first seven drives, so I used 'wafl scan reallocate <volume>' and it seemed to improve the layout quite dramatically. Is this a good use of the command? Other than affecting performance, I'm assuming everything is accessible during the run of this command? Thanks in advance,

2 1

RE: Disk writes occuring when no network activity?
by Art Hebert 06 Mar '03

06 Mar '03

What I did was completely wipe out the netapp and reinstall 6.1.2R3. We are reracking our qa lab so I figured it would be a good time to let our Microsoft admin get to learn how to install a netapp, etc. So its a fresh install and before we put our databases back on it I did a sysstat and noticed the activity. I've let it run overnight so maybe the memory scrubs are finished and that was the activity. I am hoping at some point we can upgrade the netapps we have to the 960's and I can maybe get to attend Netapp training to get some inside knowledge of the boxes. We are running on a nonexistant budget and its tough supporting all this gear without maintenance contracts. art -----Original Message----- From: Borders, Rich [mailto:Rich.Borders@netapp.com] Sent: Thursday, March 06, 2003 2:52 AM To: Art Hebert; toasters(a)mathworks.com Subject: RE: Disk writes occuring when no network activity? Disk Scrubs? Did you just upgrade? > > -----Original Message----- > From: Art Hebert [mailto:art@arzoon.com] > Sent: Wednesday, March 05, 2003 11:02 PM > To: toasters(a)mathworks.com > > > Would anybody know why I have disk writes occurring on my > netapp when it is completely disconnected from the network. > It is doing memory scrubs, but would this cause writes to the disk? > > Here is what sysstat looks like. As you can see there isn't > any nfs, cifs or http activity. On my other filers that are > hooked up to a network the Disk writes go to zero when there > isn't any activity. > > smf760-01*> sysstat 1 > CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape > kB/s Cache > in out read write read > write age > 2% 0 0 0 0 0 0 762 0 > 0 59 > 1% 0 0 0 0 0 0 740 0 > 0 59 > 2% 0 0 0 0 0 0 752 0 > 0 59 > 1% 0 0 0 0 0 0 764 0 > 0 59 > 2% 0 0 0 0 0 0 788 0 > 0 59 > 1% 0 0 0 0 0 0 788 0 > 0 59 > 2% 0 0 0 0 0 0 784 0 > 0 59 > 1% 0 0 0 0 0 0 808 0 > 0 59 > 2% 0 0 0 0 0 0 804 0 > 0 59 > 3% 0 0 0 0 0 156 1108 0 > 0 59 > 2% 0 0 0 0 0 0 824 0 > 0 60 > 1% 0 0 0 0 0 0 868 0 > 0 60 > 2% 0 0 0 0 0 0 888 0 > 0 60 > 4% 0 0 0 0 0 0 880 0 > 0 60 > 2% 0 0 0 0 0 0 844 0 > 0 60 > 2% 0 0 0 0 0 0 892 0 > 0 60 > 2% 0 0 0 0 0 0 872 0 > 0 60 > 1% 0 0 0 0 0 0 880 0 > 0 60 > 2% 0 0 0 0 0 0 884 0 > 0 60 > CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape > kB/s Cache > in out read write read > write age > 1% 0 0 0 0 0 0 852 0 > 0 60 > 4% 0 0 0 0 0 164 1148 0 > 0 60 > > Thanks > > art >

1 0

RE: Disk writes occuring when no network activity?
by Borders, Rich 06 Mar '03

06 Mar '03

Disk Scrubs? Did you just upgrade? > > -----Original Message----- > From: Art Hebert [mailto:art@arzoon.com] > Sent: Wednesday, March 05, 2003 11:02 PM > To: toasters(a)mathworks.com > > > Would anybody know why I have disk writes occurring on my > netapp when it is completely disconnected from the network. > It is doing memory scrubs, but would this cause writes to the disk? > > Here is what sysstat looks like. As you can see there isn't > any nfs, cifs or http activity. On my other filers that are > hooked up to a network the Disk writes go to zero when there > isn't any activity. > > smf760-01*> sysstat 1 > CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape > kB/s Cache > in out read write read > write age > 2% 0 0 0 0 0 0 762 0 > 0 59 > 1% 0 0 0 0 0 0 740 0 > 0 59 > 2% 0 0 0 0 0 0 752 0 > 0 59 > 1% 0 0 0 0 0 0 764 0 > 0 59 > 2% 0 0 0 0 0 0 788 0 > 0 59 > 1% 0 0 0 0 0 0 788 0 > 0 59 > 2% 0 0 0 0 0 0 784 0 > 0 59 > 1% 0 0 0 0 0 0 808 0 > 0 59 > 2% 0 0 0 0 0 0 804 0 > 0 59 > 3% 0 0 0 0 0 156 1108 0 > 0 59 > 2% 0 0 0 0 0 0 824 0 > 0 60 > 1% 0 0 0 0 0 0 868 0 > 0 60 > 2% 0 0 0 0 0 0 888 0 > 0 60 > 4% 0 0 0 0 0 0 880 0 > 0 60 > 2% 0 0 0 0 0 0 844 0 > 0 60 > 2% 0 0 0 0 0 0 892 0 > 0 60 > 2% 0 0 0 0 0 0 872 0 > 0 60 > 1% 0 0 0 0 0 0 880 0 > 0 60 > 2% 0 0 0 0 0 0 884 0 > 0 60 > CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape > kB/s Cache > in out read write read > write age > 1% 0 0 0 0 0 0 852 0 > 0 60 > 4% 0 0 0 0 0 164 1148 0 > 0 60 > > Thanks > > art >

1 0

Disk writes occuring when no network activity?
by Art Hebert 06 Mar '03

06 Mar '03

Would anybody know why I have disk writes occurring on my netapp when it is completely disconnected from the network. It is doing memory scrubs, but would this cause writes to the disk? Here is what sysstat looks like. As you can see there isn't any nfs, cifs or http activity. On my other filers that are hooked up to a network the Disk writes go to zero when there isn't any activity. smf760-01*> sysstat 1 CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 2% 0 0 0 0 0 0 762 0 0 59 1% 0 0 0 0 0 0 740 0 0 59 2% 0 0 0 0 0 0 752 0 0 59 1% 0 0 0 0 0 0 764 0 0 59 2% 0 0 0 0 0 0 788 0 0 59 1% 0 0 0 0 0 0 788 0 0 59 2% 0 0 0 0 0 0 784 0 0 59 1% 0 0 0 0 0 0 808 0 0 59 2% 0 0 0 0 0 0 804 0 0 59 3% 0 0 0 0 0 156 1108 0 0 59 2% 0 0 0 0 0 0 824 0 0 60 1% 0 0 0 0 0 0 868 0 0 60 2% 0 0 0 0 0 0 888 0 0 60 4% 0 0 0 0 0 0 880 0 0 60 2% 0 0 0 0 0 0 844 0 0 60 2% 0 0 0 0 0 0 892 0 0 60 2% 0 0 0 0 0 0 872 0 0 60 1% 0 0 0 0 0 0 880 0 0 60 2% 0 0 0 0 0 0 884 0 0 60 CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 1% 0 0 0 0 0 0 852 0 0 60 4% 0 0 0 0 0 164 1148 0 0 60 Thanks art

1 0

etc/log/snapmirror.log parsing
by Todd C. Merrill 05 Mar '03

05 Mar '03

Has anyone written anything to parse the snapmirror logs to convert: dst Wed Mar 5 03:00:00 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 Request (Scheduled) dst Wed Mar 5 03:00:04 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 Start dst Wed Mar 5 03:51:58 EST xxxxx:/vol/vol0/- yyyyy:/vol/vol1/xxxxx_vol0 End (28215980 KB) into something a bit more useful, like: dst Wed Mar 5 03:51:58 EST bat07:/vol/vol0/- bat00bak:/vol/vol1/bat07_vol0 End (28215980 kB, 00:51:54, 530 MB/min)? which adds elapsed time and transfer rate? Or, something further that completely parses the log and reports: Source Size Elapsed Rate ------------------------------------------------------------------ xxxxx:/vol/vol0/- 28215980 kB 00:51:54 530 MB/min zzzzz:/vol/vol0/qtree 4345164 kB 00:16:13 262 MB/min [...] for all my snapmirror transfers for the night? Until next time... The MathWorks, Inc. 508-647-7000 x7792 3 Apple Hill Drive, Natick, MA 01760-2098 508-647-7001 FAX tmerrill(a)mathworks.com http://www.mathworks.com ---

2 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters