toasters

toasters@lists.teaparty.net

13517 discussions

RE: Block-Level Backup of Filer Volumes
by Holland, William L 15 Nov '05

15 Nov '05

We use Backup Express and it works fine. We SnapVault from our main filers to an R200 then NDMP backup to tape with Backup Express. -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:Jason.Palmer@drkw.com] Sent: Tuesday, November 15, 2005 8:29 AM To: 'Ben Rockwood'; toasters(a)mathworks.com Subject: RE: Block-Level Backup of Filer Volumes Netvault (Backbone) - Tested SMT sucessfully Backup Express (Syncsort) - Not tested by me yet but awaiting to eval These allow the backup of the volume using Snapmirror to tape (SMT) Back at the time I tested NetVault it was pretty basic, but I got the volume + block level snapshots sucessfully off to a Virtual Backup Library (Another nice feature) and then back from the virtual tape library onto another Filers volume intact. Not sure is either of these products have enhanced their block level capabilities since I looked at them last year. I would also be interested to see what others say and come back with Jason -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Ben Rockwood Sent: 15 November 2005 08:14 To: toasters(a)mathworks.com Subject: Block-Level Backup of Filer Volumes I'm looking into various methods for tape backup of our filers. Due to the large number of files a file level backup would be significantly slower than a block-level backup method, however I'm not sure if one exists. I was hoping someone could clarify. NDMP utilizes dump, which is file-based so that doesn't solve the performance issues, and from what I can tell SnapVault is only for disk-to-disk backup, not tape. Even if I direct connect a tape robot to the filer I'd still be using dump and the throughput isn't being limited by the network capacity, so that doesn't help either. I'm hoping there is a block-level method I'm unaware of. NDMP in my tests has been dog slow and standard backups via NFS mount don't sound appealing. Suggestions are welcome. benr. ---------------------------------------------------------------------------- ---- The information contained herein is confidential and is intended solely for the addressee. Access by any other party is unauthorised without the express written permission of the sender. If you are not the intended recipient, please contact the sender either via the company switchboard on +44 (0)20 7623 8000, or via e-mail return. If you have received this e-mail in error or wish to read our e-mail disclaimer statement and monitoring policy, please refer to http://www.drkw.com/disc/email/ or contact the sender. 3167 ---------------------------------------------------------------------------- ----

1 0

RE: Block-Level Backup of Filer Volumes
by Palmer, Jason 15 Nov '05

15 Nov '05

Netvault (Backbone) - Tested SMT sucessfully Backup Express (Syncsort) - Not tested by me yet but awaiting to eval These allow the backup of the volume using Snapmirror to tape (SMT) Back at the time I tested NetVault it was pretty basic, but I got the volume + block level snapshots sucessfully off to a Virtual Backup Library (Another nice feature) and then back from the virtual tape library onto another Filers volume intact. Not sure is either of these products have enhanced their block level capabilities since I looked at them last year. I would also be interested to see what others say and come back with Jason -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Ben Rockwood Sent: 15 November 2005 08:14 To: toasters(a)mathworks.com Subject: Block-Level Backup of Filer Volumes I'm looking into various methods for tape backup of our filers. Due to the large number of files a file level backup would be significantly slower than a block-level backup method, however I'm not sure if one exists. I was hoping someone could clarify. NDMP utilizes dump, which is file-based so that doesn't solve the performance issues, and from what I can tell SnapVault is only for disk-to-disk backup, not tape. Even if I direct connect a tape robot to the filer I'd still be using dump and the throughput isn't being limited by the network capacity, so that doesn't help either. I'm hoping there is a block-level method I'm unaware of. NDMP in my tests has been dog slow and standard backups via NFS mount don't sound appealing. Suggestions are welcome. benr. -------------------------------------------------------------------------------- The information contained herein is confidential and is intended solely for the addressee. Access by any other party is unauthorised without the express written permission of the sender. If you are not the intended recipient, please contact the sender either via the company switchboard on +44 (0)20 7623 8000, or via e-mail return. If you have received this e-mail in error or wish to read our e-mail disclaimer statement and monitoring policy, please refer to http://www.drkw.com/disc/email/ or contact the sender. 3167 --------------------------------------------------------------------------------

1 0

Cat5/6/Coax/Optical test gear
by Jeff Mohler 11 Nov '05

11 Nov '05

What do Y'all here have as recommendations for a handheld test set to certify the listed types of signal paths? Theres so many..thought Id ask the list. Thanks!

1 0

Re: howto document for initial volume architecting?
by Chris Thompson 11 Nov '05

11 Nov '05

Jeff Mery writes: > > Here's how to do the tracking-only trees (from our active quota file). > Enabling it causes no problems. We actually turn on certain tracking > quotas in the middle of the day from time to time. > > #Qtree Quotas > #--------------------------------------------------------------------------------------------- > #Target Type Disk Files Thold Sdisk > Sfile Comment > #--------------------------------------------------------------------------------------------- > > <------------snip > /vol/perforce/ActiveXContainer tree - > /vol/perforce/ASIC tree - > /vol/perforce/ATC tree - > /vol/perforce/CodeMart tree - > /vol/perforce/ComponentWorks tree - > /vol/perforce/CVI tree - > /vol/perforce/DAQ tree - > /vol/perforce/DAQConfig tree - > /vol/perforce/DevSuite tree - > <------------snip Alternatively, #Target Type Disk Files * tree@/vol/perforce - will make a default tracking-but-unlimited quota for every qtree on the volume not given its own quota. Apart from not having to list the qtrees explictly, this has the advantage of also applying to any qtrees created after the "quota on". -- Chris Thompson Email: cet1(a)cam.ac.uk

2 1

RE: howto document for initial volume architecting?
by Lai, Derek 10 Nov '05

10 Nov '05

Lori, Sounds like a very interesting day. Why is Samba even needed now? Derek -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Lori Barfield Sent: Thursday, November 10, 2005 8:29 AM To: John Stoffel; Greg.Libert(a)plexus.com; toasters(a)mathworks.com Subject: Re: howto document for initial volume architecting? i'm so grateful for the help yesterday! just for fun, i will share the day i had back with you all. i hope i get the chance to return the assistance some day. thanks to the two best netapp salesmen on earth ;) i spent the morning yesterday printing pdfs and planning data migrations to ontap 7 and flexvols. the flexvol sizing calculation i am especially grateful for- it isn't obvious and i would certainly have guessed wrong. armed with a clear direction about where my day was going, i marched into the office...and right into a user-impacting outage due to a full volume. up until yesterday i had never logged into any of the filers and knew nothing about them. so in the midst of the firefight, i had several revelations about the configuration. as for the full volume, i found that snapshots were being kept for only one week and used 17gb. but there was 180gb of snap reserve. so i cut the snap reserve in half, quieting the tumult, and explained to the boss that ten weeks of snap reserve is awfully nice to have, and if you're going to set that much space aside, you might want to keep a little more backup data around. :) about the configurations, dozens of qtrees exist, many duplicated from filer to filer, but some very tiny, as if perhaps there was going to be mirroring at one time, but instead over the years the second qtree got used just a little on the second filer. none of the qtrees is running quotas and they all have the default unix permissions, so the implementation was never exploited. some of the directories at /vol/vol1/ aren't in qtrees, so consistency suffered over the years as well. however, the computer gods truely love me...the boss already upgraded the filers to ontap 7! each filer has two flexvols, one for system and one for data. so, to plan the rearchitecting and data migration project, i spent the rest of the day making a spreadsheet describing the existing data directories and filling in nfs ops statistics for all the qtrees, the one real blessing of that feature in this setup. because of the single volume for everything i don't have snap statistics for each tree, but i created columns for that in my spreadsheet and we'll iterate on the configuration as stats come in later. stupidly, i counted the space each data directory is taking with du -sk, so i got the snaps as well and all the numbers are off. i guess today i'm going to be adding up directory sizes with a massive find -prune loop. (or is there a better way?) at the end of the day, we met to discuss the spreadsheet, and decided the intuitive thing to do was create a new data architecture that mirrored the corporate org chart. this will facilitate setting up samba file sharing that makes sense. right now filer space is all mounted at / but in the future each top-level organization will have its own top-level directory on the sun servers for the mount points for the flexvol/qtrees it needs. with samba, right now folders for multiperson efforts are kind of shared all over the place whereever users happen to be working. going forward, for consistency each team will have a group-shareable folder for all the team members (whether it's needed now or not). and potentially, each major project will have a shareable folder that will span teams, not individuals. but project folders will all belong in a hierarchy owned by a project lead or someone, so the data can be maintained and removed later when it's no longer needed. i plan to add the flexvol space calculation to the spreadsheet today so it can be used as a tool to redistribute space on the fly during architecture discussions. thank you all again. :) ...lori On 11/9/05, Lori Barfield <itdirector(a)gmail.com> wrote: > thank you, greg and john, for the recommendations and the pdf links. > i was not aware of FlexVols and it looks like this is suddenly going > to be a much more challenging exercise. :)

1 0

RE: snapmirroring over WAN
by Henry.Chan＠Emulex.Com 10 Nov '05

10 Nov '05

Unfortunately just SnapMirror. SnapVault has no option to create tape baseline. -----Original Message----- From: John Stoffel [mailto:john.stoffel@taec.toshiba.com] Sent: Thu 11/10/2005 11:16 AM To: Chan, Henry Cc: dleeds(a)edmunds.com; bparent(a)calvin.ucsd.edu; toasters(a)mathworks.com Subject: RE: snapmirroring over WAN Henry> We also had to back up our volumes to a remote site via Henry> snapmirror accross a T1 WAN. One of the vols was over 1TB and Henry> it would have taken days to create the initial baseline over Henry> the T1 so we snapped to SDLT tape, sent it down to CA and Henry> created the baseline in a "snap"! Now our nightly VSMs take Henry> about 2 hours for 5 gigs (our average delta size). Can you do this with SnapVaults, or just snapmirrors? This would be a great way to get an initial snapvault setup for my remote sites, since they are on fast links, but far away and the TCP bandwidth delay is killing my performance. John

2 1

Re: howto document for initial volume architecting?
by Lori Barfield 10 Nov '05

10 Nov '05

i'm so grateful for the help yesterday! just for fun, i will share the day i had back with you all. i hope i get the chance to return the assistance some day. thanks to the two best netapp salesmen on earth ;) i spent the morning yesterday printing pdfs and planning data migrations to ontap 7 and flexvols. the flexvol sizing calculation i am especially grateful for- it isn't obvious and i would certainly have guessed wrong. armed with a clear direction about where my day was going, i marched into the office...and right into a user-impacting outage due to a full volume. up until yesterday i had never logged into any of the filers and knew nothing about them. so in the midst of the firefight, i had several revelations about the configuration. as for the full volume, i found that snapshots were being kept for only one week and used 17gb. but there was 180gb of snap reserve. so i cut the snap reserve in half, quieting the tumult, and explained to the boss that ten weeks of snap reserve is awfully nice to have, and if you're going to set that much space aside, you might want to keep a little more backup data around. :) about the configurations, dozens of qtrees exist, many duplicated from filer to filer, but some very tiny, as if perhaps there was going to be mirroring at one time, but instead over the years the second qtree got used just a little on the second filer. none of the qtrees is running quotas and they all have the default unix permissions, so the implementation was never exploited. some of the directories at /vol/vol1/ aren't in qtrees, so consistency suffered over the years as well. however, the computer gods truely love me...the boss already upgraded the filers to ontap 7! each filer has two flexvols, one for system and one for data. so, to plan the rearchitecting and data migration project, i spent the rest of the day making a spreadsheet describing the existing data directories and filling in nfs ops statistics for all the qtrees, the one real blessing of that feature in this setup. because of the single volume for everything i don't have snap statistics for each tree, but i created columns for that in my spreadsheet and we'll iterate on the configuration as stats come in later. stupidly, i counted the space each data directory is taking with du -sk, so i got the snaps as well and all the numbers are off. i guess today i'm going to be adding up directory sizes with a massive find -prune loop. (or is there a better way?) at the end of the day, we met to discuss the spreadsheet, and decided the intuitive thing to do was create a new data architecture that mirrored the corporate org chart. this will facilitate setting up samba file sharing that makes sense. right now filer space is all mounted at / but in the future each top-level organization will have its own top-level directory on the sun servers for the mount points for the flexvol/qtrees it needs. with samba, right now folders for multiperson efforts are kind of shared all over the place whereever users happen to be working. going forward, for consistency each team will have a group-shareable folder for all the team members (whether it's needed now or not). and potentially, each major project will have a shareable folder that will span teams, not individuals. but project folders will all belong in a hierarchy owned by a project lead or someone, so the data can be maintained and removed later when it's no longer needed. i plan to add the flexvol space calculation to the spreadsheet today so it can be used as a tool to redistribute space on the fly during architecture discussions. thank you all again. :) ...lori On 11/9/05, Lori Barfield <itdirector(a)gmail.com> wrote: > thank you, greg and john, for the recommendations and the pdf links. > i was not aware of FlexVols and it looks like this is suddenly going > to be a much more challenging exercise. :)

6 7

RE: howto document for initial volume architecting?
by Brian Pauley 10 Nov '05

10 Nov '05

Alternatively, you can use a "du"-like script which avoids traversing the ".snapshot" directory: #!/bin/perl # # Usage mydu [dir] # opendir (DIR, $ARGV[0]) || die "Can't open $ARGV[0] $!"; @dirs = readdir(DIR); closedir (DIR); foreach $d (@dirs) { next if ($d eq "." || $d eq ".." || $d eq ".snapshot"); system ("du -s $ARGV[0]/$d"); } Brian Pauley Systems Engineer Dataline, Inc 2551 Eltham Avenue, Suite O Norfolk, VA 23513 Phone (757)858-0613 ext. 264 Fax (757)858-0606 email: brian.pauley(a)dataline.com -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Andrew Siegel Sent: Thursday, November 10, 2005 2:13 PM To: Lori Barfield Cc: toasters(a)mathworks.com Subject: Re: howto document for initial volume architecting? Lori Barfield wrote: > > stupidly, i > counted the space each data directory is taking with du -sk, so i got > the snaps as well and all the numbers are off. i guess today i'm > going to be adding up directory sizes with a massive find -prune loop. > (or is there a better way?) One trick for doing du's without encountering any .snapshot directories is to do the du within a snapshot.

1 0

RE: snapmirroring over WAN
by Henry.Chan＠Emulex.Com 10 Nov '05

10 Nov '05

We also had to back up our volumes to a remote site via snapmirror accross a T1 WAN. One of the vols was over 1TB and it would have taken days to create the initial baseline over the T1 so we snapped to SDLT tape, sent it down to CA and created the baseline in a "snap"! Now our nightly VSMs take about 2 hours for 5 gigs (our average delta size). Henry -----Original Message----- From: owner-toasters(a)mathworks.com on behalf of Leeds, Daniel Sent: Thu 11/10/2005 9:21 AM To: Brian Parent; toasters(a)mathworks.com Cc: Subject: RE: snapmirroring over WAN yeah but that initial transfer can be fun if you are mirroring a couple terabyte volumes or if the application is generating alot of changes. a DS3 wan link would be no problem but they may need to rate limit snapmirror on much smaller wan links. -----Original Message----- From: owner-toasters(a)mathworks.com on behalf of Brian Parent Sent: Thu 11/10/2005 9:08 AM To: toasters(a)mathworks.com Subject: Re: snapmirroring over WAN If I recall correctly, snapmirror uses very little bandwidth, and shouldn't be a problem on any modern network. It only copies the blocks which were changed, rather than entire files. Re: > Date: Thu, 10 Nov 2005 08:49:38 -0800 > From: Lori Barfield <itdirector(a)gmail.com> > To: toasters(a)mathworks.com > Subject: snapmirroring over WAN > > for offsite backups, we hope to snapmirror our new fas 3020 on a > regular schedule via vpn over the internet to an older filer at our colo. > obviously, intermittent latency is a concern since we don't have a > dedicated link. and so is the potential for overpowering the modest > firewall/network hardware currently in place. does anyone have a > suggestion for how we might throttle the snapmirrors to improve > reliability in the transmission? > > and how are you folks handling encryption for remote mirroring? > we have a small pix, sonicwall, or cisco to choose from...i'm > guessing we may have to try all three but i hope to pick the one > most likely to succeed the first time. > > > ...lori

2 1

snapmirroring over WAN
by Lori Barfield 10 Nov '05

10 Nov '05

for offsite backups, we hope to snapmirror our new fas 3020 on a regular schedule via vpn over the internet to an older filer at our colo. obviously, intermittent latency is a concern since we don't have a dedicated link. and so is the potential for overpowering the modest firewall/network hardware currently in place. does anyone have a suggestion for how we might throttle the snapmirrors to improve reliability in the transmission? and how are you folks handling encryption for remote mirroring? we have a small pix, sonicwall, or cisco to choose from...i'm guessing we may have to try all three but i hope to pick the one most likely to succeed the first time. ...lori

5 5

RE: howto document for initial volume architecting?
by Palmer, Jason 10 Nov '05

10 Nov '05

If you use Qtrees you can snapmirror on a Qtree basis (QSM) rather than a whole volume - does not bring across the snapshot history like a volume snapmirror (VSM) You can also set Qtree Quotas based upon the Qtree directory, and also you can have different security styles set on a Qtree by Qtree basis. Some backup vendors (Legatto / Symantec nee Veritas) also recognise Qtrees and allows administrators to make the backups more granular, breaking down a potentially multi Tb volume backup into a number of more manageable Gb Qtrees. Qtrees make manipulating and managing data a little easier - sometimes if you don't think you will need to use them, you find that you wish you had at a later date :o) Been there ! Jason -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Lori Barfield Sent: 10 November 2005 18:49 To: Jerry Cc: John Stoffel; toasters(a)mathworks.com Subject: Re: howto document for initial volume architecting? On 11/10/05, Jerry <juanino(a)yahoo.com> wrote: > Whats the primary reason to use qtrees under flexvols? from my reading, it looks like the only way to define access rights in a non-unix way is to have qtrees. i'd think this could be critical to admins in heterogeneous environments. i found qtrees to be useful yesterday for their nfs ops stats. if you are stuck with one big volume of data, and all your other stats are aggregate, that's a blessing. ...lori -------------------------------------------------------------------------------- The information contained herein is confidential and is intended solely for the addressee. Access by any other party is unauthorised without the express written permission of the sender. If you are not the intended recipient, please contact the sender either via the company switchboard on +44 (0)20 7623 8000, or via e-mail return. If you have received this e-mail in error or wish to read our e-mail disclaimer statement and monitoring policy, please refer to http://www.drkw.com/disc/email/ or contact the sender. 3167 --------------------------------------------------------------------------------

1 0

howto document for initial volume architecting?
by Lori Barfield 10 Nov '05

10 Nov '05

we have the opportunity to build several filers from scratch for our LAN, which will serve all departments in the company, fileshare through Samba, host htdocs for the internal web site, etc. can someone please point me to a good document that offers guidelines for doing the rearchitecting? our architecture is currently flat- one volume per filer with the data only split up into separate directories. all hosts can mount all directories on all volumes if needed. we are overpowered so i'm not too concerned about performance. it does makes sense to have multiple volumes for varying snap schedules, for instance; however i'd like to learn more about what the trade-offs are because i do understand there is a storage penalty. the security paradigm is to depend on firewall protection on the perimeter and to have a relatively open internal network. backups will be snap mirrors to a sibling filer at our offsite colo, with an occasional archival to tape for some of the data. thanks in advance. ...lori

3 3

RE: snapmirroring over WAN
by Lai, Derek 10 Nov '05

10 Nov '05

Lori, Local initial snapmirror is a good idea whenever it's an option. I've setup DR to St. Louis first and now Plano, Texas and it's been very reliable. Snapmirroring is also pretty good at setting up a checkpoint re-start if it has problem getting through. I am also pretty confident that it knows how to handle overlapping snapmirror. I've seen it happen to us when there is networking problem. If it detects that a snapmirroring is still in progress it will not kick off the same snapmirror. Snapmirror has been really reliable. I've had lots more problem with the WAN. The only problem I've seen with Snapmirror is when you run out of disk space (We are using mostly qtree snapmirror). Derek -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Lori Barfield Sent: Thursday, November 10, 2005 9:30 AM To: toasters(a)mathworks.com Subject: Re: snapmirroring over WAN On 11/10/05, Brian Parent <bparent(a)calvin.ucsd.edu> wrote: > If I recall correctly, snapmirror uses very little bandwidth, and > shouldn't be a problem on any modern network. It only copies the > blocks which were changed, rather than entire files. ah yes, sorry that i didn't mention this point...we're doing an initial ndmpcopy over a little gig switch here at the office before moving the filer to the colo. some of our data is going to be large image files, so we aren't sure yet how much bandwidth the syncs are going to want. i was more concerned about the jerks and jolts and irregular paths you get when you fling data out into the wild...not sure how well netapps handle hiccups in the middle of snapping. ...lori

1 0

RE: snapmirroring over WAN
by Johnson, John T. 10 Nov '05

10 Nov '05

SnapMirror will consume as much bandwidth as it can get. I have a DS3 between Minneapolis and Denver and SnapMirror will flood it 100% no matter if it's a full or incremental transfer. The only difference is how long it floods the pipe. There's two areas where you can change this. If you can set QOS on your VPN link between Filers IP addresses and set a reasonable bandwidth parameter, I would do that. Otherwise you can set in in Filerview when setting up the Snapmirror volume relationship under Maximum Transfer Rate. This can be tedious as you have to set it on each replicated volume. We set it on our Cisco router to run at 10 Mbit during the day and automatically jump to 40 Mbit after 10:00 PM. I replicate Exchange and SQL data daily with logs getting replicated every 2 hours. My delta changes are roughly 300 gigs per night and at 40 Mbits (the other 5 Mbits we reserve for AD replication and normal network traffic), it takes about 6 hours. SnapMirror also doesn't thread its transfers. It just blasts the pipe so if you can stagger your transfers you should get better throughput. Good luck, John -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Lori Barfield Sent: Thursday, November 10, 2005 10:50 AM To: toasters(a)mathworks.com Subject: snapmirroring over WAN for offsite backups, we hope to snapmirror our new fas 3020 on a regular schedule via vpn over the internet to an older filer at our colo. obviously, intermittent latency is a concern since we don't have a dedicated link. and so is the potential for overpowering the modest firewall/network hardware currently in place. does anyone have a suggestion for how we might throttle the snapmirrors to improve reliability in the transmission? and how are you folks handling encryption for remote mirroring? we have a small pix, sonicwall, or cisco to choose from...i'm guessing we may have to try all three but i hope to pick the one most likely to succeed the first time. ...lori

1 0

RE: snapmirroring over WAN
by Leeds, Daniel 10 Nov '05

10 Nov '05

yeah but that initial transfer can be fun if you are mirroring a couple terabyte volumes or if the application is generating alot of changes. a DS3 wan link would be no problem but they may need to rate limit snapmirror on much smaller wan links. -----Original Message----- From: owner-toasters(a)mathworks.com on behalf of Brian Parent Sent: Thu 11/10/2005 9:08 AM To: toasters(a)mathworks.com Subject: Re: snapmirroring over WAN If I recall correctly, snapmirror uses very little bandwidth, and shouldn't be a problem on any modern network. It only copies the blocks which were changed, rather than entire files. Re: > Date: Thu, 10 Nov 2005 08:49:38 -0800 > From: Lori Barfield <itdirector(a)gmail.com> > To: toasters(a)mathworks.com > Subject: snapmirroring over WAN > > for offsite backups, we hope to snapmirror our new fas 3020 on a > regular schedule via vpn over the internet to an older filer at our colo. > obviously, intermittent latency is a concern since we don't have a > dedicated link. and so is the potential for overpowering the modest > firewall/network hardware currently in place. does anyone have a > suggestion for how we might throttle the snapmirrors to improve > reliability in the transmission? > > and how are you folks handling encryption for remote mirroring? > we have a small pix, sonicwall, or cisco to choose from...i'm > guessing we may have to try all three but i hope to pick the one > most likely to succeed the first time. > > > ...lori

1 0

RE: snapmirroring over WAN
by Frank, Jason 10 Nov '05

10 Nov '05

Well, that all depends on how many changed blocks you expect in a day, as well as what kind of link you have, how busy the link is currently, what exact model of PIX or Sonicwall you have, and what the operating hours of the business are. Snapmirror does include a throttle, but if you throttle it too much, you'll be perpetually behind. And if you don't throttle it enough, it's about the same as not having one. It might be possible to do your snapmirror overnight, if it's acceptable to your client, and not throttle it at all. There are really a lot of options here. -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Lori Barfield Sent: Thursday, November 10, 2005 10:50 AM To: toasters(a)mathworks.com Subject: snapmirroring over WAN for offsite backups, we hope to snapmirror our new fas 3020 on a regular schedule via vpn over the internet to an older filer at our colo. obviously, intermittent latency is a concern since we don't have a dedicated link. and so is the potential for overpowering the modest firewall/network hardware currently in place. does anyone have a suggestion for how we might throttle the snapmirrors to improve reliability in the transmission? and how are you folks handling encryption for remote mirroring? we have a small pix, sonicwall, or cisco to choose from...i'm guessing we may have to try all three but i hope to pick the one most likely to succeed the first time. ...lori

3 2

High network traffic due to RPC Authoriztion (nfs mounts)
by Tavis Gustafson 10 Nov '05

10 Nov '05

We are seeing extremely high network traffic from single clients to nfs mounted filers. In most cases running nfswatch on the client shows almost all of the traffic due to "RPC Authorization". We are talking 50-80Mbits of traffic with nothing sticking out on the clients process list. Has anyone seen weird high network traffic via nfs over udp? thank -tavis -- ___ /\__\ /:/ / /:/__/ /::\ \ /:/\:\ \ \/__\:\ \ \:\__\ \/__/ avis tavis(a)hq.newdream.net New Dream Network

2 3

samba acls and Re: howto document for initial volume architecting?
by Lori Barfield 09 Nov '05

09 Nov '05

thank you, greg and john, for the recommendations and the pdf links. i was not aware of FlexVols and it looks like this is suddenly going to be a much more challenging exercise. :) i do have two followup questions right now, before i start untangling the reading in detail. On 11/9/05, John Stoffel <john.stoffel(a)taec.toshiba.com> wrote: > Lori> our architecture is currently flat- one volume per filer with > Lori> the data only split up into separate directories. > > Are you using qtrees at all? I find them to be very useful. i am still learning about the existing architecture but don't believe qtrees are in use. originally i was concerned about setting any up because i am not a permanent fixture here, and i should not leave an overly complex design in my wake. so it is important to create an architecture that makes sense but does not require a lot of close watching to avoid failures and admins learning a whole new command set to stay afloat. please correct me if my vague impression about qtrees is ignorant, but don't they make it that much more difficult to do the day-to-day work of maintaining filers? > Lori> all hosts can mount all directories on all volumes if needed. > > Sure, makes sense. I assume you use permissions to keep people from > touching what they shouldn't? er, some work does need to be done here. with root and non-privileged access paradigms as well. good thing we get to work from scratch with the new filer. :) i do have a question about samba; hope it's okay to present that here. right now our permissions are group-based...meaning that we seem to create a new custom group for every single shared dir. (want to add another user? new group on every unix workstation! :) and there is no NIS here in this Windows house; nsswitch.conf is not even understood.) so it's time to switch to acls, but here again is unfamiliar territory for me and concern about making it too hard for the next guy to figure out. is there a good how-to acls document for samba that might include the pitfalls of this approach? thanks again! ...lori (busy printing pdfs :)

2 1

RE: samba acls and Re: howto document for initial volume architecting?
by Hirschorn, Steven 09 Nov '05

09 Nov '05

Hi Lori, Just thought I'd follow up about qtrees - we use just Windows and CIFS here generally, so I might be missing some subtlety about qtrees in a multiprotocol environment, but as I understand it, the one disadvantage of qtrees is that they can't be set up within Explorer. You need to use the console or Filerview. The advantages of Qtrees on the other hand: - You can apply tree quotas to them - You can do NDMP backups of a single Qtree, rather than an entire volume (I believe you can do this on a non-qtree subtree, but it's slower) - You can do NDMPCopies of a single qtree - You can use QTree Snapmirror on a Qtree - If you use DFM, it will monitor the QTrees for you and produce pretty graphs of the qtrees over time, so you can tell approximately where the data growth in your organisation is. The fact that most of our data is in QTrees is also aiding our migration to 7G as we can QSM all the data to new flexvols. We have one chunk of data outside of a qtree due to an oversight, and if it didn't consume such a large proportion of the volume, I'd have moved it to a qtree long ago. I've deliberately restricted access to the volume root shares to just my team and advised them never to create a root level folder without making it a qtree. I don't suppose anyone on the list can answer these questions? - Is there an easy way of changing a non qtree root level directory to a qtree? I'm guessing the only way is to NDMPCopy the data to a new qtree? - Is there any way of getting DFM to monitor subtree growth, as well as qtrees? I'm guessing again that DFM uses the filer's in-built quota monitoring to do the qtree size measurement, and so there isn't any flexibility here? Thanks! -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com]On Behalf Of Lori Barfield Sent: 09 November 2005 17:43 To: John Stoffel; Greg.Libert(a)plexus.com Cc: toasters(a)mathworks.com Subject: samba acls and Re: howto document for initial volume architecting? thank you, greg and john, for the recommendations and the pdf links. i was not aware of FlexVols and it looks like this is suddenly going to be a much more challenging exercise. :) i do have two followup questions right now, before i start untangling the reading in detail. On 11/9/05, John Stoffel <john.stoffel(a)taec.toshiba.com> wrote: > Lori> our architecture is currently flat- one volume per filer with > Lori> the data only split up into separate directories. > > Are you using qtrees at all? I find them to be very useful. i am still learning about the existing architecture but don't believe qtrees are in use. originally i was concerned about setting any up because i am not a permanent fixture here, and i should not leave an overly complex design in my wake. so it is important to create an architecture that makes sense but does not require a lot of close watching to avoid failures and admins learning a whole new command set to stay afloat. please correct me if my vague impression about qtrees is ignorant, but don't they make it that much more difficult to do the day-to-day work of maintaining filers? > Lori> all hosts can mount all directories on all volumes if needed. > > Sure, makes sense. I assume you use permissions to keep people from > touching what they shouldn't? er, some work does need to be done here. with root and non-privileged access paradigms as well. good thing we get to work from scratch with the new filer. :) i do have a question about samba; hope it's okay to present that here. right now our permissions are group-based...meaning that we seem to create a new custom group for every single shared dir. (want to add another user? new group on every unix workstation! :) and there is no NIS here in this Windows house; nsswitch.conf is not even understood.) so it's time to switch to acls, but here again is unfamiliar territory for me and concern about making it too hard for the next guy to figure out. is there a good how-to acls document for samba that might include the pitfalls of this approach? thanks again! ...lori (busy printing pdfs :) ------------------------------------------------------------------------------------ Free to all: Catalogue Awareness Day, 9th December at The National Archives in Kew www.nationalarchives.gov.uk/events/calendar/catagenda.htm ------------------------------------------------------------------------------------ National Archives Disclaimer This e-mail message (and attachments) may contain information that is confidential to The National Archives. If you are not the intended recipient you cannot use, distribute or copy the message or attachments. In such a case, please notify the sender by return e-mail immediately and erase all copies of the message and attachments. Opinions, conclusions and other information in this message and attachments that do not relate to the official business of The National Archives are neither given nor endorsed by it. ------------------------------------------------------------------------------------

1 0

Find a sexoholic tonight
by Leta Noel 09 Nov '05

09 Nov '05

"Where love reigns the impossible may be attained" a insightful man once said;) And soon you can discover passion for yourself aswell, without the pointless dates;) If its either a One-Nite stand or maybe something more serious, you'll find it here;-) http://www.look-for-singles-online.us

1 0

Symlink/automount/widelink question
by Shawn Stephens 08 Nov '05

08 Nov '05

I'm looking to find a way to solve absolute symlinks created on a NFS automount and their resolution in CIFS. I'm looking at the docs for Widelinks in Data ONTAP, and I can see where this could come in useful, but only if it somehow knows about all of the UNIX automount maps in an environment. What I'm thinking is a script (perl) that would create a symlink.translations and cifsconfig_shares.cfg configuration based off of an automount map (or multiple automount maps). Has anybody seen something like this? So it's output would generate something like: automount map: auto.foo data1 filer1:/vol/vol1/data1 data2 filer2:/vol/vol2/data2 autofs: User creates a symlink in their homedir to /foo/data1 and /foo/data2: /home/user> ln -s /foo/data1 data1 /home/user> ln -s /foo/data2 data2 cifsconfig_share.cfg on filer1: cifs shares -add -widelink -vscan "foo_data1" "/vol/vol1/data1" cifsconfig_share.cfg on filer2: cifs shares -add - widelink -vscan "foo_data2" "/vol/vol2/data2" symlink.translations: Widelink /foo/data1/* \\filer1\foo_data1\* Widelink /foo/data2/* \\filer2\foo_data2\* Thoughts: 1) Of course we would trust the automount maps! 2) All clients would have DFS support. 3) Hopefully, we don't do anything that would cause issues with share boundary checking. 4) Hopefully, we don't have issues with any special characters, etc. that are in the automount maps (we'll have to get rid of & wildcards). 4) We would be able to run this configuration on a change in the automount maps (perhaps in cron?) If you've made it this far in my wandering and actually understand what's going on here, do you have any more thoughts? If so, please reply to me, and I will post a SUMMARY once I have an idea of what this will entail. Thanks, Shawn Shawn Stephens Sr. UNIX Systems Consultant stephenssh(a)saic.com The life of the creative man is lead, directed and controlled by boredom. Avoiding boredom is one of our most important purposes. - Saul Steinberg

1 0

AW: R200 licensing
by Conzen, Christoph (C.) 08 Nov '05

08 Nov '05

When you have purchased the licenses then you will find the proper code on NOW. Look at "My Licenses for Serial Numbers" and supply your machine serial number, accept the term and coditions and supply the serial number of your R200 on the next form-click GO. You will see the Capacity dependant Licenses in the List for your system. Rgards, Christoph -----Ursprüngliche Nachricht----- Von: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] Im Auftrag von Mats.Oberg(a)tietoenator.com Gesendet: Dienstag, 8. November 2005 16:14 An: toasters(a)mathworks.com Betreff: R200 licensing Hi, We just purchased an upgrade of our R200 from 8 to 16TB. And since the disks have arrived I want to start using them. But as I understandit, the R200 has a different licensing than other filers in that you purchase licenses for a specific tier-level. What happens if I connect the extra shelfes? will it stop working? Do I have to punch in a new licensekey? We did purchase the licenses, but I haven't seen any keys yet. Looking on the output from the license command doesn't reveal anything about what size the R200 is licensed for, so how do I find out? /Mats

1 0

R200 licensing
by Mats.Oberg＠tietoenator.com 08 Nov '05

08 Nov '05

Hi, We just purchased an upgrade of our R200 from 8 to 16TB. And since the disks have arrived I want to start using them. But as I understandit, the R200 has a different licensing than other filers in that you purchase licenses for a specific tier-level. What happens if I connect the extra shelfes? will it stop working? Do I have to punch in a new licensekey? We did purchase the licenses, but I haven't seen any keys yet. Looking on the output from the license command doesn't reveal anything about what size the R200 is licensed for, so how do I find out? /Mats

1 0

FW:
by Ahmed Alhussaini 08 Nov '05

08 Nov '05

________________________________ From: Ahmed Alhussaini Sent: Tuesday, July 19, 2005 7:12 AM To: 'toasters(a)mathworks.com' Subject: Unsubscribe toasters AHUSSAINI(a)commerce.gov.bh End

1 0

Best order to delete multiple snapshots?
by Jeremy Webber 07 Nov '05

07 Nov '05

I am wondering what is the best order to delete multiple snapshots - oldest first or newest first? I have assumed that deleting the oldest first will result in less copying of blocks between snapshots, but am wondering if this assumption is correct? My specific platform is a FAS960 running DataOnTAP 6.5.3P3 but I'm hoping that the answer to this isn't version specific! TIA, Jeremy -- Jeremy Webber Senior System Administrator Animal Logic Phone: +61 2 9383 4837 Fax: +61 2 9383 4801 Switch: +61 2 9383 4800

4 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters