toasters

toasters@lists.teaparty.net

13515 discussions

RE: snapmirroring over WAN
by Lai, Derek 10 Nov '05

10 Nov '05

Lori, Local initial snapmirror is a good idea whenever it's an option. I've setup DR to St. Louis first and now Plano, Texas and it's been very reliable. Snapmirroring is also pretty good at setting up a checkpoint re-start if it has problem getting through. I am also pretty confident that it knows how to handle overlapping snapmirror. I've seen it happen to us when there is networking problem. If it detects that a snapmirroring is still in progress it will not kick off the same snapmirror. Snapmirror has been really reliable. I've had lots more problem with the WAN. The only problem I've seen with Snapmirror is when you run out of disk space (We are using mostly qtree snapmirror). Derek -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Lori Barfield Sent: Thursday, November 10, 2005 9:30 AM To: toasters(a)mathworks.com Subject: Re: snapmirroring over WAN On 11/10/05, Brian Parent <bparent(a)calvin.ucsd.edu> wrote: > If I recall correctly, snapmirror uses very little bandwidth, and > shouldn't be a problem on any modern network. It only copies the > blocks which were changed, rather than entire files. ah yes, sorry that i didn't mention this point...we're doing an initial ndmpcopy over a little gig switch here at the office before moving the filer to the colo. some of our data is going to be large image files, so we aren't sure yet how much bandwidth the syncs are going to want. i was more concerned about the jerks and jolts and irregular paths you get when you fling data out into the wild...not sure how well netapps handle hiccups in the middle of snapping. ...lori

1 0

RE: snapmirroring over WAN
by Johnson, John T. 10 Nov '05

10 Nov '05

SnapMirror will consume as much bandwidth as it can get. I have a DS3 between Minneapolis and Denver and SnapMirror will flood it 100% no matter if it's a full or incremental transfer. The only difference is how long it floods the pipe. There's two areas where you can change this. If you can set QOS on your VPN link between Filers IP addresses and set a reasonable bandwidth parameter, I would do that. Otherwise you can set in in Filerview when setting up the Snapmirror volume relationship under Maximum Transfer Rate. This can be tedious as you have to set it on each replicated volume. We set it on our Cisco router to run at 10 Mbit during the day and automatically jump to 40 Mbit after 10:00 PM. I replicate Exchange and SQL data daily with logs getting replicated every 2 hours. My delta changes are roughly 300 gigs per night and at 40 Mbits (the other 5 Mbits we reserve for AD replication and normal network traffic), it takes about 6 hours. SnapMirror also doesn't thread its transfers. It just blasts the pipe so if you can stagger your transfers you should get better throughput. Good luck, John -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Lori Barfield Sent: Thursday, November 10, 2005 10:50 AM To: toasters(a)mathworks.com Subject: snapmirroring over WAN for offsite backups, we hope to snapmirror our new fas 3020 on a regular schedule via vpn over the internet to an older filer at our colo. obviously, intermittent latency is a concern since we don't have a dedicated link. and so is the potential for overpowering the modest firewall/network hardware currently in place. does anyone have a suggestion for how we might throttle the snapmirrors to improve reliability in the transmission? and how are you folks handling encryption for remote mirroring? we have a small pix, sonicwall, or cisco to choose from...i'm guessing we may have to try all three but i hope to pick the one most likely to succeed the first time. ...lori

1 0

RE: snapmirroring over WAN
by Leeds, Daniel 10 Nov '05

10 Nov '05

yeah but that initial transfer can be fun if you are mirroring a couple terabyte volumes or if the application is generating alot of changes. a DS3 wan link would be no problem but they may need to rate limit snapmirror on much smaller wan links. -----Original Message----- From: owner-toasters(a)mathworks.com on behalf of Brian Parent Sent: Thu 11/10/2005 9:08 AM To: toasters(a)mathworks.com Subject: Re: snapmirroring over WAN If I recall correctly, snapmirror uses very little bandwidth, and shouldn't be a problem on any modern network. It only copies the blocks which were changed, rather than entire files. Re: > Date: Thu, 10 Nov 2005 08:49:38 -0800 > From: Lori Barfield <itdirector(a)gmail.com> > To: toasters(a)mathworks.com > Subject: snapmirroring over WAN > > for offsite backups, we hope to snapmirror our new fas 3020 on a > regular schedule via vpn over the internet to an older filer at our colo. > obviously, intermittent latency is a concern since we don't have a > dedicated link. and so is the potential for overpowering the modest > firewall/network hardware currently in place. does anyone have a > suggestion for how we might throttle the snapmirrors to improve > reliability in the transmission? > > and how are you folks handling encryption for remote mirroring? > we have a small pix, sonicwall, or cisco to choose from...i'm > guessing we may have to try all three but i hope to pick the one > most likely to succeed the first time. > > > ...lori

1 0

RE: snapmirroring over WAN
by Frank, Jason 10 Nov '05

10 Nov '05

Well, that all depends on how many changed blocks you expect in a day, as well as what kind of link you have, how busy the link is currently, what exact model of PIX or Sonicwall you have, and what the operating hours of the business are. Snapmirror does include a throttle, but if you throttle it too much, you'll be perpetually behind. And if you don't throttle it enough, it's about the same as not having one. It might be possible to do your snapmirror overnight, if it's acceptable to your client, and not throttle it at all. There are really a lot of options here. -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Lori Barfield Sent: Thursday, November 10, 2005 10:50 AM To: toasters(a)mathworks.com Subject: snapmirroring over WAN for offsite backups, we hope to snapmirror our new fas 3020 on a regular schedule via vpn over the internet to an older filer at our colo. obviously, intermittent latency is a concern since we don't have a dedicated link. and so is the potential for overpowering the modest firewall/network hardware currently in place. does anyone have a suggestion for how we might throttle the snapmirrors to improve reliability in the transmission? and how are you folks handling encryption for remote mirroring? we have a small pix, sonicwall, or cisco to choose from...i'm guessing we may have to try all three but i hope to pick the one most likely to succeed the first time. ...lori

3 2

High network traffic due to RPC Authoriztion (nfs mounts)
by Tavis Gustafson 10 Nov '05

10 Nov '05

We are seeing extremely high network traffic from single clients to nfs mounted filers. In most cases running nfswatch on the client shows almost all of the traffic due to "RPC Authorization". We are talking 50-80Mbits of traffic with nothing sticking out on the clients process list. Has anyone seen weird high network traffic via nfs over udp? thank -tavis -- ___ /\__\ /:/ / /:/__/ /::\ \ /:/\:\ \ \/__\:\ \ \:\__\ \/__/ avis tavis(a)hq.newdream.net New Dream Network

2 3

samba acls and Re: howto document for initial volume architecting?
by Lori Barfield 09 Nov '05

09 Nov '05

thank you, greg and john, for the recommendations and the pdf links. i was not aware of FlexVols and it looks like this is suddenly going to be a much more challenging exercise. :) i do have two followup questions right now, before i start untangling the reading in detail. On 11/9/05, John Stoffel <john.stoffel(a)taec.toshiba.com> wrote: > Lori> our architecture is currently flat- one volume per filer with > Lori> the data only split up into separate directories. > > Are you using qtrees at all? I find them to be very useful. i am still learning about the existing architecture but don't believe qtrees are in use. originally i was concerned about setting any up because i am not a permanent fixture here, and i should not leave an overly complex design in my wake. so it is important to create an architecture that makes sense but does not require a lot of close watching to avoid failures and admins learning a whole new command set to stay afloat. please correct me if my vague impression about qtrees is ignorant, but don't they make it that much more difficult to do the day-to-day work of maintaining filers? > Lori> all hosts can mount all directories on all volumes if needed. > > Sure, makes sense. I assume you use permissions to keep people from > touching what they shouldn't? er, some work does need to be done here. with root and non-privileged access paradigms as well. good thing we get to work from scratch with the new filer. :) i do have a question about samba; hope it's okay to present that here. right now our permissions are group-based...meaning that we seem to create a new custom group for every single shared dir. (want to add another user? new group on every unix workstation! :) and there is no NIS here in this Windows house; nsswitch.conf is not even understood.) so it's time to switch to acls, but here again is unfamiliar territory for me and concern about making it too hard for the next guy to figure out. is there a good how-to acls document for samba that might include the pitfalls of this approach? thanks again! ...lori (busy printing pdfs :)

2 1

RE: samba acls and Re: howto document for initial volume architecting?
by Hirschorn, Steven 09 Nov '05

09 Nov '05

Hi Lori, Just thought I'd follow up about qtrees - we use just Windows and CIFS here generally, so I might be missing some subtlety about qtrees in a multiprotocol environment, but as I understand it, the one disadvantage of qtrees is that they can't be set up within Explorer. You need to use the console or Filerview. The advantages of Qtrees on the other hand: - You can apply tree quotas to them - You can do NDMP backups of a single Qtree, rather than an entire volume (I believe you can do this on a non-qtree subtree, but it's slower) - You can do NDMPCopies of a single qtree - You can use QTree Snapmirror on a Qtree - If you use DFM, it will monitor the QTrees for you and produce pretty graphs of the qtrees over time, so you can tell approximately where the data growth in your organisation is. The fact that most of our data is in QTrees is also aiding our migration to 7G as we can QSM all the data to new flexvols. We have one chunk of data outside of a qtree due to an oversight, and if it didn't consume such a large proportion of the volume, I'd have moved it to a qtree long ago. I've deliberately restricted access to the volume root shares to just my team and advised them never to create a root level folder without making it a qtree. I don't suppose anyone on the list can answer these questions? - Is there an easy way of changing a non qtree root level directory to a qtree? I'm guessing the only way is to NDMPCopy the data to a new qtree? - Is there any way of getting DFM to monitor subtree growth, as well as qtrees? I'm guessing again that DFM uses the filer's in-built quota monitoring to do the qtree size measurement, and so there isn't any flexibility here? Thanks! -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com]On Behalf Of Lori Barfield Sent: 09 November 2005 17:43 To: John Stoffel; Greg.Libert(a)plexus.com Cc: toasters(a)mathworks.com Subject: samba acls and Re: howto document for initial volume architecting? thank you, greg and john, for the recommendations and the pdf links. i was not aware of FlexVols and it looks like this is suddenly going to be a much more challenging exercise. :) i do have two followup questions right now, before i start untangling the reading in detail. On 11/9/05, John Stoffel <john.stoffel(a)taec.toshiba.com> wrote: > Lori> our architecture is currently flat- one volume per filer with > Lori> the data only split up into separate directories. > > Are you using qtrees at all? I find them to be very useful. i am still learning about the existing architecture but don't believe qtrees are in use. originally i was concerned about setting any up because i am not a permanent fixture here, and i should not leave an overly complex design in my wake. so it is important to create an architecture that makes sense but does not require a lot of close watching to avoid failures and admins learning a whole new command set to stay afloat. please correct me if my vague impression about qtrees is ignorant, but don't they make it that much more difficult to do the day-to-day work of maintaining filers? > Lori> all hosts can mount all directories on all volumes if needed. > > Sure, makes sense. I assume you use permissions to keep people from > touching what they shouldn't? er, some work does need to be done here. with root and non-privileged access paradigms as well. good thing we get to work from scratch with the new filer. :) i do have a question about samba; hope it's okay to present that here. right now our permissions are group-based...meaning that we seem to create a new custom group for every single shared dir. (want to add another user? new group on every unix workstation! :) and there is no NIS here in this Windows house; nsswitch.conf is not even understood.) so it's time to switch to acls, but here again is unfamiliar territory for me and concern about making it too hard for the next guy to figure out. is there a good how-to acls document for samba that might include the pitfalls of this approach? thanks again! ...lori (busy printing pdfs :) ------------------------------------------------------------------------------------ Free to all: Catalogue Awareness Day, 9th December at The National Archives in Kew www.nationalarchives.gov.uk/events/calendar/catagenda.htm ------------------------------------------------------------------------------------ National Archives Disclaimer This e-mail message (and attachments) may contain information that is confidential to The National Archives. If you are not the intended recipient you cannot use, distribute or copy the message or attachments. In such a case, please notify the sender by return e-mail immediately and erase all copies of the message and attachments. Opinions, conclusions and other information in this message and attachments that do not relate to the official business of The National Archives are neither given nor endorsed by it. ------------------------------------------------------------------------------------

1 0

Find a sexoholic tonight
by Leta Noel 09 Nov '05

09 Nov '05

"Where love reigns the impossible may be attained" a insightful man once said;) And soon you can discover passion for yourself aswell, without the pointless dates;) If its either a One-Nite stand or maybe something more serious, you'll find it here;-) http://www.look-for-singles-online.us

1 0

Symlink/automount/widelink question
by Shawn Stephens 08 Nov '05

08 Nov '05

I'm looking to find a way to solve absolute symlinks created on a NFS automount and their resolution in CIFS. I'm looking at the docs for Widelinks in Data ONTAP, and I can see where this could come in useful, but only if it somehow knows about all of the UNIX automount maps in an environment. What I'm thinking is a script (perl) that would create a symlink.translations and cifsconfig_shares.cfg configuration based off of an automount map (or multiple automount maps). Has anybody seen something like this? So it's output would generate something like: automount map: auto.foo data1 filer1:/vol/vol1/data1 data2 filer2:/vol/vol2/data2 autofs: User creates a symlink in their homedir to /foo/data1 and /foo/data2: /home/user> ln -s /foo/data1 data1 /home/user> ln -s /foo/data2 data2 cifsconfig_share.cfg on filer1: cifs shares -add -widelink -vscan "foo_data1" "/vol/vol1/data1" cifsconfig_share.cfg on filer2: cifs shares -add - widelink -vscan "foo_data2" "/vol/vol2/data2" symlink.translations: Widelink /foo/data1/* \\filer1\foo_data1\* Widelink /foo/data2/* \\filer2\foo_data2\* Thoughts: 1) Of course we would trust the automount maps! 2) All clients would have DFS support. 3) Hopefully, we don't do anything that would cause issues with share boundary checking. 4) Hopefully, we don't have issues with any special characters, etc. that are in the automount maps (we'll have to get rid of & wildcards). 4) We would be able to run this configuration on a change in the automount maps (perhaps in cron?) If you've made it this far in my wandering and actually understand what's going on here, do you have any more thoughts? If so, please reply to me, and I will post a SUMMARY once I have an idea of what this will entail. Thanks, Shawn Shawn Stephens Sr. UNIX Systems Consultant stephenssh(a)saic.com The life of the creative man is lead, directed and controlled by boredom. Avoiding boredom is one of our most important purposes. - Saul Steinberg

1 0

AW: R200 licensing
by Conzen, Christoph (C.) 08 Nov '05

08 Nov '05

When you have purchased the licenses then you will find the proper code on NOW. Look at "My Licenses for Serial Numbers" and supply your machine serial number, accept the term and coditions and supply the serial number of your R200 on the next form-click GO. You will see the Capacity dependant Licenses in the List for your system. Rgards, Christoph -----Ursprüngliche Nachricht----- Von: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] Im Auftrag von Mats.Oberg(a)tietoenator.com Gesendet: Dienstag, 8. November 2005 16:14 An: toasters(a)mathworks.com Betreff: R200 licensing Hi, We just purchased an upgrade of our R200 from 8 to 16TB. And since the disks have arrived I want to start using them. But as I understandit, the R200 has a different licensing than other filers in that you purchase licenses for a specific tier-level. What happens if I connect the extra shelfes? will it stop working? Do I have to punch in a new licensekey? We did purchase the licenses, but I haven't seen any keys yet. Looking on the output from the license command doesn't reveal anything about what size the R200 is licensed for, so how do I find out? /Mats

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters