toasters

toasters@lists.teaparty.net

13515 discussions

RE: Removing disks from a volume
by Mike Sphar 28 Aug '00

28 Aug '00

It's worth taking a look at the trend in space utilization though, because it's entirely possible that at their current rate they may need to buy a new shelf X months down the road anyway, and if so it may be more cost-effective to just buy it now and save the headache and downtime involved with shrinking the existing volume. I find with our filers that I can pretty much plot out on a graph when a new shelf is needed, and it's usually less than a year. Of course, the moral of this story is: Be careful when you add disks to volumes. -- Mike Sphar - Sr Systems Administrator - Engineering Support Services, BOFH, GWP, MCP, MCP+I, MCSE, BFD -----Original Message----- From: Brian Tao [mailto:taob@risc.org] Sent: Wednesday, August 23, 2000 3:14 PM To: Bruce Sterling Woodcock Cc: Aaron Sherman; toasters(a)mathworks.com Subject: Re: Removing disks from a volume On Mon, 21 Aug 2000, Bruce Sterling Woodcock wrote: > > Is the time worth the cost of another disk? I doubt it. ... plus a whole new disk shelf (and the space and power required) if he runs with full shelves with one spare, the way I suspect most people do. -- Brian Tao (BT300, taob(a)risc.org) "Though this be madness, yet there is method in't"

3 2

I.T. SERVICE ANNOUNCMENT for Sat., Aug. 26th, 2000
by Murray, Brian 25 Aug '00

25 Aug '00

When: Saturday, August 26, 2000 at 4:00 PM PDT for 2.5 HOURS What: Migrate Internet network segments at Sunnyvale site Why: To complete the migration from Vendor X to Vendor Y network equip., the network segments that lead to the Internet must be migrated from the Vendor X switch to our existing Vendor Y network. Impact: The following web sites will be "off the air": * NOW web site * E-Market web site Other Internet services interrupted: * E-mail delivery * Chat

1 0

Re: Removing disks from a volume
by mds＠gbnet.net 23 Aug '00

23 Aug '00

The real secret to this is re-laying out the filesystem data and altering and relaying out the metadata, which is why AFAIK, only VxFS can do this at the moment - it's perceived to be both hard and uncommon (despite all sysadmin's experiences to the contrary, and the manifest existence of fs-reorganisers) so most fs authors don't bother. Shrinking volumes, by comparison, is just moving a fencepost. It's what they contain that needs the work. -- -Mark ... an Englishman in New York ...

4 3

Backup Questions
by Jay Orr 23 Aug '00

23 Aug '00

Hi all! So, we're evaluating backup software to replace Budtool. When we used budtool, it used Netapp's Dump to backup the files, not NDMP. Now, I don't claim to have all the ins-and-outs down on NDMP, but here's what I understand. NDMP does a sorta flow-control in one stream and dumps in another (or something like that). My particular questions: 1) Do all implementations of NDMP backup/restore at best only allow choosing directories and NOT files for restore/backup? 2) Does netapp's Dump work such that you can choose to backup/restore particular files? 3) How does netapp's Dump differ from the dump in the NDMP? It's all kinda fuzzy for me.... ----------- Jay Orr Systems Administrator Fujitsu Nexion Inc. St. Louis, MO

4 4

netapp console to terminal server?
by Lyons, Jim 22 Aug '00

22 Aug '00

We are trying to attach our netapp db9 console ports to a cisco as2509-rj async rj45 lines, but are having no luck. The cisco h/w configuration documentation has a diagram for the db9 to rj45 pinout, but it does not work. Has anyone done this? Thanks, Jim

4 3

Re: Removing disks from a volume
by Rick Hulsey 22 Aug '00

22 Aug '00

You've probably already thought about this, but could you just steal a spare from the other filer, or buy another disk to use as a spare? If the spare disk was your last spare in the filer and you can't buy or steal another spare or it forces you to another shelf, then it's worth going through this process. Otherwise you may want to just not mess with it. If you do have to deal with the problem by copying and recreating the volume, it seems like you ought to be able to get that downtime window to be smaller if you use snapmirror to mirror your problem volume to the new volume in the other filer. This at least cuts down on the time it takes to do the first copy. >>> Aaron Sherman <ajs(a)ajs.com> 08/21/00 10:46PM >>> On Mon, Aug 21, 2000 at 10:23:13PM +0100, Mark Simmons wrote: > The real secret to this is re-laying out the filesystem data and altering > and relaying out the metadata, which is why AFAIK, only VxFS can do this > at the moment - it's perceived to be both hard and uncommon (despite > all sysadmin's experiences to the contrary, and the manifest existence > of fs-reorganisers) so most fs authors don't bother. Just in case a) this is what's being thought and b) there's anyone from NetApp listening: THIS WOULD NOT JUST BE A COOL FEATURE... IT WOULD SAVE ME DAYS OF EFFORT. You see, our database is on that volume, so we have to schedule database downtime, copy the data to a second filer (lucky we have one, or this'd be to tape!) and then back. It's probably going to be 1-3 hour process which will suck up our downtime window for a whole week! -- Aaron Sherman Systems Architect HighWired.com -- The global high school community http://www.highwired.com 300 North Beacon Street Watertown, MA 02472 (617) 926-1850 x238 (617) 926-1861 fax asherman(a)highwired-inc.com / ICQ#43677395 / Y!ajstrader "We had some good machines, but they don't work no more." -"Faded Flowers" / Shriekback

1 0

RE: RCS issues with ONTAP 5.4.3R2
by Clawson, Simon 22 Aug '00

22 Aug '00

Sniff is produced by a company called MKS. I dont know if they have a web site, but we get our licenses etc through wind river. Bye Simon -----Original Message----- From: Todd C. Merrill [mailto:tmerrill@mathworks.com] Sent: 21 August 2000 20:29 To: 'Clawson, Simon' Subject: RE: RCS issues with ONTAP 5.4.3R2 On Thu, 17 Aug 2000, Muhlestein, Mark wrote: > This is likely bug #21019, fixed in 5.3.5. Check with NetApp support to get the > exact recommended version, since the fix exists in many releases. Simon, Darn it. If I had read the description of bug 21019, I wouldn't have needed to post my wild-ass guesses. I filed that bug. ;) That bug was a re-introduction of bug 7111, which a former admin of our company filed years ago; it apparently got reintroduced into the code base for ONTAP when another much *larger* customer of NetApp's demanded it work *their* way, not according to the UNIX-style semantics. The option cifs.perm_check_ro_del_ok then got created to fix 21019 (and 7111, *again*) to make it work as it should. So, this product...Sniff, who makes it? We haven't found an RCS tool for pc's that doesn't corrupt our RCS files, but I haven't heard of this one yet. Until next time... The Mathworks, Inc. 508-647-7000 x7792 3 Apple Hill Drive, Natick, MA 01760-2098 508-647-7001 FAX tmerrill(a)mathworks.com http://www.mathworks.com ---

1 0

Re: Removing disks from a volume
by Eyal Traitel 22 Aug '00

22 Aug '00

It surely would. It was down in a shutdown of the company. eT. --- James R Grinter <jrg(a)acm.org> wrote: > On Mon, Aug 21, 2000 at 02:28:46PM -0700, Eyal Traitel wrote: > > - About your specific problem - easy fix - just create new volume > > with two disks. mount it. Use a tool like rsync to copy all the > /etc > > to the new volume. > > Wouldn't that have implications for NFS Clients that have mounted > the file system and/or have files open? I'm thinking here of the > values inside the opaque (to the client) NFS file handles. > > James. ===== Yours, Eyal Traitel eTraitel(a)yahoo.com, Home: 972-3-5290415 (Tel Aviv) *** eTraitel - it's the new eBuzzword ! *** __________________________________________________ Do You Yahoo!? Yahoo! Mail � Free email you can access from anywhere! http://mail.yahoo.com/

1 0

Re: Removing disks from a volume
by Eyal Traitel 21 Aug '00

21 Aug '00

- The only "plex" I can think of in VxFS is "complex"... :) - I believe that this shrinking has very strict demands - you must defrag first, have enough space of course, and it probably takes hours... - A filer tries to distribute data over the spindles, so it makes it hard I believe. Anyway, you have the option to create large volumes, and seperate them logically to easily growing/shrinking qtrees, which are like filesystems. - About your specific problem - easy fix - just create new volume with two disks. mount it. Use a tool like rsync to copy all the /etc to the new volume. Run "rsh toaster0 vol offline myoldroot" - this is for taking it offline during the reboot (NOT NEEDED IN 6.0!!!). Run "rsh toaster0 vol options mynewvolume root" and then after one last rsync reboot. There you have it. It was done on a production system by myself - no problem. After some time you can of course issue: "rsh toaster0 vol destroy myoldroot" to erase volume. eT. --- Aaron Sherman <ajs(a)ajs.com> wrote: > On Mon, Aug 21, 2000 at 12:38:40PM -0700, Eyal Traitel wrote: > > It would be lovely if there was such a RAID-filesystem... > > If anyone have heard of such - share with us... > > As noted by another, Veritas is capable of this. I've included an > excerpt from the docs, below: > > [begin vxassist man-page] > NAME > vxassist - create, mirror, backup, grow, shrink, and move > volumes > [...] > shrinkto and shrinkby > Decrease the length of the named volume to the length > specified by newlength (shrinkto), or by the length > specified by lengthchange (shrinkby). The new length > or change in length is specified as a standard Volume > Manager length [see vxintro(1M)]. The shrinkto opera- > tion fails if the new length is not less than the > current volume length. > [...end] > > Of course, this only shrinks the whole volume, but it is my > understanding that at that point, you can re-arange the plexes so > that > the disk you want to remove no longer has any plexes on it. It's ugly > and complex, but possible. It strikes me as very strange that a > system > that's otherwise so flexible does not allow this. We've really hosed > ourselves because on one Filer (while attempting to set up a volume > that we could volcopy to), we accidentally added disks to the root > volume. So, now we have to do what? Re-install? > > -- > Aaron Sherman > Systems Architect > HighWired.com -- The global high school community > http://www.highwired.com > > 300 North Beacon Street > Watertown, MA 02472 > (617) 926-1850 x238 > (617) 926-1861 fax > asherman(a)highwired-inc.com / ICQ#43677395 / Y!ajstrader > > "We had some good machines, but they don't work no more." > -"Faded Flowers" / Shriekback ===== Yours, Eyal Traitel eTraitel(a)yahoo.com, Home: 972-3-5290415 (Tel Aviv) *** eTraitel - it's the new eBuzzword ! *** __________________________________________________ Do You Yahoo!? Yahoo! Mail � Free email you can access from anywhere! http://mail.yahoo.com/

2 1

RE: Removing disks from a volume
by Francett, Robert D (SAIC) 21 Aug '00

21 Aug '00

Anyone actually done this? I tried once on Veritas V2.5.xx, something like that, and, although the docs indicate shrinkage is possible the s/w didn't allow the operation. I had to offload the data, remove the volume & start over. Now, this was Veritas on a Solaris machine. Bob Francett BP Exploration (Alaska) -----Original Message----- From: Aaron Sherman [mailto:ajs@ajs.com] Sent: Monday, August 21, 2000 12:48 PM To: Eyal Traitel Cc: toasters(a)mathworks.com Subject: Re: Removing disks from a volume On Mon, Aug 21, 2000 at 12:38:40PM -0700, Eyal Traitel wrote: > It would be lovely if there was such a RAID-filesystem... > If anyone have heard of such - share with us... As noted by another, Veritas is capable of this. I've included an excerpt from the docs, below: [begin vxassist man-page] NAME vxassist - create, mirror, backup, grow, shrink, and move volumes [...] shrinkto and shrinkby Decrease the length of the named volume to the length specified by newlength (shrinkto), or by the length specified by lengthchange (shrinkby). The new length or change in length is specified as a standard Volume Manager length [see vxintro(1M)]. The shrinkto opera- tion fails if the new length is not less than the current volume length. [...end] Of course, this only shrinks the whole volume, but it is my understanding that at that point, you can re-arange the plexes so that the disk you want to remove no longer has any plexes on it. It's ugly and complex, but possible. It strikes me as very strange that a system that's otherwise so flexible does not allow this. We've really hosed ourselves because on one Filer (while attempting to set up a volume that we could volcopy to), we accidentally added disks to the root volume. So, now we have to do what? Re-install? -- Aaron Sherman Systems Architect HighWired.com -- The global high school community http://www.highwired.com 300 North Beacon Street Watertown, MA 02472 (617) 926-1850 x238 (617) 926-1861 fax asherman(a)highwired-inc.com / ICQ#43677395 / Y!ajstrader "We had some good machines, but they don't work no more." -"Faded Flowers" / Shriekback

1 0

Re: Removing disks from a volume
by Eyal Traitel 21 Aug '00

21 Aug '00

It would be lovely if there was such a RAID-filesystem... If anyone have heard of such - share with us... eT. --- Aaron Sherman <ajs(a)ajs.com> wrote: > We've accidentally added our spare disk to a volume. Our OEM says > that > this is irrevokable, and that we'll have to copy the volume to > another > disk tray, rebuild the volume and copy back in order to fix this. Is > that true? Is there no way to shrink a filesystem and remove a disk > once it's been added? > > It seem contrary to the ultra-flexible spirit of the Filers.... > > -- > Aaron Sherman > Systems Architect > HighWired.com -- The global high school community > http://www.highwired.com > > 300 North Beacon Street > Watertown, MA 02472 > (617) 926-1850 x238 > (617) 926-1861 fax > asherman(a)highwired-inc.com / ICQ#43677395 / Y!ajstrader > > "We had some good machines, but they don't work no more." > -"Faded Flowers" / Shriekback ===== Yours, Eyal Traitel eTraitel(a)yahoo.com, Home: 972-3-5290415 (Tel Aviv) *** eTraitel - it's the new eBuzzword ! *** __________________________________________________ Do You Yahoo!? Yahoo! Mail � Free email you can access from anywhere! http://mail.yahoo.com/

4 3

Re: Removing disks from a volume
by mds＠gbnet.net 21 Aug '00

21 Aug '00

You can do it with a combination of VxVM and VxFS - and it's relatively simple too. The day the WAFL gets that feature, well, the VRTS solution won't look so simple anymore, of that I'm confident. (IF WAFL gets it, of course..) -- -Mark ... an Englishman in London ...

1 0

Removing disks from a volume
by Aaron Sherman 21 Aug '00

21 Aug '00

We've accidentally added our spare disk to a volume. Our OEM says that this is irrevokable, and that we'll have to copy the volume to another disk tray, rebuild the volume and copy back in order to fix this. Is that true? Is there no way to shrink a filesystem and remove a disk once it's been added? It seem contrary to the ultra-flexible spirit of the Filers.... -- Aaron Sherman Systems Architect HighWired.com -- The global high school community http://www.highwired.com 300 North Beacon Street Watertown, MA 02472 (617) 926-1850 x238 (617) 926-1861 fax asherman(a)highwired-inc.com / ICQ#43677395 / Y!ajstrader "We had some good machines, but they don't work no more." -"Faded Flowers" / Shriekback

2 1

RE: RCS issues with ONTAP 5.4.3R2
by Clawson, Simon 21 Aug '00

21 Aug '00

In answer to Todd's question: We use RCS as a backend to Sniff, on both UNIX & PC. The issue was correctl spotted by Mark. We have found that the bug mentioned did in fact cause our problems (prehaps Mark implemented the fix?) So if you are using source control, watch out! Cheers Mark et al for your advice and help with tis, it was kind of a major problem for us. Simon -----Original Message----- From: Todd C. Merrill [mailto:tmerrill@mathworks.com] Sent: 18 August 2000 21:50 To: Clawson, Simon Cc: toasters(a)mathworks.com Subject: RE: RCS issues with ONTAP 5.4.3R2 On Thu, 17 Aug 2000, Clawson, Simon wrote: > We went up from 5.2.3 to 5.3.4R2. The user working on UNIX boxes are able to > be checkout file with RCS exclusive locks. Users on PC's get "permission > denied" What RCS package are you using on the pc's? To what security mode is the filer set? > from RCS access. User can open and lock files on UNIX boxes OK. However on > PC, users cannot open and lock files that have been created by another user. Though a long-shot, does the output of `cifs sessions *` show any locks on files? Until next time... The Mathworks, Inc. 508-647-7000 x7792 3 Apple Hill Drive, Natick, MA 01760-2098 508-647-7001 FAX tmerrill(a)mathworks.com http://www.mathworks.com ---

1 0

Removal from mailing list
by Jouni Pohjola 21 Aug '00

21 Aug '00

Please remove me from the list. I am getting too much mails, I rather read these through Internet. Jouni Pohjola ProAct Datasystem Oy Sinimäentie 14 (Po.Box 45) 02630 Espoo Finland jouni.pohjola(a)proact.fi GSM +358-40-5641122

1 0

Re: NDMP Backups and restore with NetBackup
by Oye Akintan 19 Aug '00

19 Aug '00

Does Veritas offer a class on Netbackup for NDMP ? if not can you please tell me how to restore an NDMP backup/ browse backup . -Oye Steve Kappel wrote: > >What will be the file path to set in order the backup a filer from / ? I'm > getting a > >manual backup failure error code (99) and I think it's because the file path is > not > >right. I set it to be vol/vol0/*. But I want it to backup the file system > without > >snapshots. How can I set up rules for backup i.e exclude files with .txt > extension > >e.t.c. ? > > NetApp backups never use the .snapshot directories unless you specifically > name them as the backup path. But the act of doing a NDMP backup on > NetApp will ALWAYS generate a new snapshot that is used to do the backup. > > You cannot use wildcards to do NDMP backups. You can use /vol/vol0 or > / which is an alias for /vol/vol0 on NetApp. > > NDMP protocol does not specify any mechanism for doing excludes. NetApp > has a proprietary mechanism by setting the NDMP environment variable > EXCLUDE. See NetApp documentation for exact syntax. I believe the > syntax of your class file list should be something like this: > > SET EXCLUDE=*.txt > /vol/vol0 > > __________________________________________________________________________ > Steve Kappel steve.kappel(a)veritas.com > VERITAS Software steve.kappel(a)iname.com (Personal)

1 0

RE: RCS issues with ONTAP 5.4.3R2
by Clawson, Simon 18 Aug '00

18 Aug '00

Sorry, more clarification suggested.... We have a call open with the support team, who are at a bit of a loss too. I was hoping that there would be a user out there who has seen this too... We went up from 5.2.3 to 5.3.4R2. The user working on UNIX boxes are able to be checkout file with RCS exclusive locks. Users on PC's get "permission denied" The user "eegbuild" owns most of the files in the share where the problem is being experinced , however this has never caused an issue. We have fond that once the users check out files on unix (which changes ownership to them) then they can check out when working on the PC. Likewise, user can check out files owned by users other than eegbuild. The problem appears to be on the CIFS side of things. -----Original Message----- From: Clawson, Simon [mailto:simon_clawson] Sent: 17 August 2000 16:38 To: toasters(a)mathworks.com Subject: RCS issues with ONTAP 5.4.3R2 Hi! We have upgraded (downgraded??) to 5.4.3R2. Everything seems to work apart from RCS access. User can open and lock files on UNIX boxes OK. However on PC, users cannot open and lock files that have been created by another user. This operation work fine up until this upgrade (Previously we were on 5.2.3) ANY ONE? cheers Simon Simon Clawson Renoir Group Systems Administrator Mentor Graphics Uk Rivergate London Road Newbury Berkshire RG14 2QB <<Clawson, Simon.vcf>>

2 1

Re: NDMP Backups and restore with NetBackup
by Eyal Traitel 18 Aug '00

18 Aug '00

If you won't upgrade to 3.4, you can still "trick" NetBackup by entering the IP address for the alternate host in NetBackup machine's /etc/hosts. This is simple, and working too. Eyal. --- Steve Kappel <steve.kappel(a)raistlin.min.ov.com> wrote: > David Lockwood wrote: > >Consider the following scenario: > > > >Data is written to a volume on one NetApp filer, on the hour this > data is > mirrored using snapmirror to a remote filer. NetBackup is used, using > NDMP, to > backup the data from the remote filer (snapmirror copy). Backups work > fine and > are reliable until ..... > > > >.... you want to restore data. The Netbackup restore option for NDMP > types does > not appear to give any option for restoring data to any alternate > location. The > original location is of course an offline volume that is read only. > > > If by 'location' you mean a different NetApp, NetBackup calls this > "alternate client restore". NetBackup NDMP supports this beginning > in version 3.4 which was released recently. > > If you mean a different directory, NetBackup calls this "alternate > path restore" and NetBackup NDMP has supported that at least as far > back as 3.2. > > > If you need help on how to do this, email me privately and I'll > have someone here give you the details (depends on which user > interface you are using). > > > __________________________________________________________________________ > Steve Kappel steve.kappel(a)veritas.com > VERITAS Software steve.kappel(a)iname.com (Personal) > ===== Yours, Eyal Traitel eTraitel(a)yahoo.com, Home: 972-3-5290415 (Tel Aviv) *** eTraitel - it's the new eBuzzword ! *** __________________________________________________ Do You Yahoo!? Send instant messages & get email alerts with Yahoo! Messenger. http://im.yahoo.com/

1 0

Re: NDMP Backups and restore with NetBackup
by Steve Kappel 18 Aug '00

18 Aug '00

Oye Akintan wrote: >Does Veritas offer a class on Netbackup for NDMP ? Not yet. >if not can you please tell me how >to restore an NDMP backup/ browse backup . There is nothing special about NDMP. Standard NetBackup operations are all you need. Don't you have NetBackup manuals? The NetBackup NDMP System Administrator's Guide covers the questions you asked earlier - wildcards and exclude lists. __________________________________________________________________________ Steve Kappel steve.kappel(a)veritas.com VERITAS Software steve.kappel(a)iname.com (Personal)

1 0

Re: restore going nuts!
by Eyal Traitel 18 Aug '00

18 Aug '00

You can try to use "rsync" - basically circumventing the problem. It will also be easier for you to find out on these bad files errors since rsync mentions things like "stat()" errors - easier to diag. Eyal. --- Steve Losen <scl(a)sasha.acc.virginia.edu> wrote: > > Has anyone seen this one? > > I have been having problems copying a volume to another volume > on the same filer. > > I did a level 0 copy with ndmpcopy and that appeared to work OK. > At the end the restore had these errors right before it exited: > > home1.Virginia.EDU: DUMP: HALT: The operation was successful! > Waiting for home1.Virginia.EDU RESTORE to halt too. > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: bad entry: > incomplete operations > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: name: > ./h1/e/en/enh7f/RSTTMP05989666 > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: parent > name ./h1/e/en/enh7f > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: sibling > name: ./h1/e/en/enh7f/Grigory Pechorin as Superflous Psychopath.doc > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: entry > type: LEAF > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: inode > number: 5989666 > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: flags: > TMPNAME > home1.Virginia.EDU: RESTORE: HALT: The operation was successful! > The transfer is complete. > Elapsed time: 12 hours, 13 minutes, 24 seconds. > > I'm not conviced that the restore was indeed 100% successful. > > This filer is production, so I can't do the whole copy during a > downtime. > A few days after the level0 I tried to do a level1 ndmpcopy to pick > up > any changes, and the restore failed with these errors: > > home1.Virginia.EDU: LOG: DUMP: home1.Virginia.EDU: LOG: dumping (Pass > IV) [regular files] > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: Warning: > cannot remove file banner.htm: No such file or directory > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: bad entry: > not marked REMOVED > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: name: > ./lowinum/banner.htm > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: parent > name ./lowinum > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: entry > type: LEAF > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: inode > number: 9024 > home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: flags: > REMOVED|KEEP > home1.Virginia.EDU: RESTORE: HALT: The operation was successful! > Waiting for home1.Virginia.EDU DUMP to halt too. > (If it sits here forever, the transfer was successful, > but the source filer has hung. Press ^C.) > home1.Virginia.EDU: LOG: DUMP: home1.Virginia.EDU: LOG: Error writing > to standard output: Broken pipe > home1.Virginia.EDU: LOG: DUMP: home1.Virginia.EDU: LOG: DUMP IS > ABORTED > home1.Virginia.EDU: Connection halted: HALT: Internal error! > Elapsed time: 0 hours, 21 minutes, 14 seconds. > > > Maybe it didn't like the restore_symboltable file or perhaps it > didn't > like the dump. After a few tries, with different snapshots, I gave > up. > So I decided I would have to use rsh dump | rsh restore and use the > "x" > option on restore rather than "r", which ndmpcopy uses. This would > simply > restore the level 1 dump without trying to remove files deleted on > the > live filesystem between the level0 and level1. I didn't trust the > restore_symboltable file, so I moved it aside, even though "x" isn't > supposed to use it. > > Then I ran this command: > > rsh filer -l root -n 'dump 1uf - /vol/vol0/.snapshot/level1' | \ > rsh filer -l root 'restore xfD - /vol/vol1' > > This seemed to be working fine and the dump finished according > to the output from rsh, but the restore is still running > over an hour later and it's gobbling up 100% of the filer > CPU. Furthermore, it seems to be ZEROING OUT ALL THE FILES > THAT IT RESTORED! > > While the dump was running, I checked my own home directory > on the new volume because I had changed some files after the > level0. Sure enough, some of the new files were there and intact, > so restore had restored them. Now that the dump is done, I > check those same files and they are all 0 length! What's > going on? > > This volume, has 120G used, but the level1 dump was only 3480944 K > according to dump (a bit over 3G). The new volume is twice as big > as the old one. > > The "rsh dump" process has exited, but the "rsh restore" > process is still there and the filer CPU is at 100%. > > I just killed the "rsh restore" and got this error: > > RESTORE: Interrupted > > Now the filer CPU is down to 10% or so. > > We are running DOT 5.3.5R2P2. > > > Steve Losen scl(a)virginia.edu phone: 804-924-0640 > > University of Virginia ITC Unix Support > ===== Yours, Eyal Traitel eTraitel(a)yahoo.com, Home: 972-3-5290415 (Tel Aviv) *** eTraitel - it's the new eBuzzword ! *** __________________________________________________ Do You Yahoo!? Send instant messages & get email alerts with Yahoo! Messenger. http://im.yahoo.com/

1 0

Scheduling
by Edward Hibbert 18 Aug '00

18 Aug '00

I have a question on scheduling which you folks might have had some experience of. It's more of an appeal for help, really. We have a distributed POP/IMAP server which stores its data on a central NFS server. The app uses many (upto 100) pthreads, each of which might be issuing a disk op. Typically the pthreads are bound to an OS thread/LWP. We have acquired a non-exclusive file lock on the files to disable client-side caching. Under heavy load, what we see is that some individual write/read calls take an age to complete (upto several minutes). During this time period many other read/write calls are happening happily enough and fast from other threads. When the load lets up, the long ops complete. This behaviour becomes increasingly common as we increase the number of threads in the application - with 1 thread it doesn't happen, with 10 it's quite common, with 50 it's unbearable. We see this behaviour: - With both NetApp and Solaris as the NFS server. It takes more stress to kick in with NetApp, probably because it's faster. - With various OSs as the NFS client (Solaris, HP, Linux). It's almost as though there is last in first out thread scheduling going on somewhere, but although it feels like a client-side issue we can't tie it down to any one OS. We have some evidence that the behaviour may be better with NFS v2 rather than v3. When this is ocurring, it's not that the total throughput in disk read/write ops is poor - it's a little less than the peak we see - but that the scheduling is unfair. This is a problem for us because some of the disk ops are associated with a locked global resource, so if that disk op is delayed a lot, we get heavy contention on the resource, response times to individual user requests suffer, and so on. Have any of you seen anything like this? Edward Hibbert DCL.

1 0

Re: [cricket-users] Negative SNMP counters (netapp)
by Matthew Stier 17 Aug '00

17 Aug '00

1) NetApp makes a great product. The problem is that their initial MIB was created in the SNMP v1 days; when the concept of counters and gauges did not exist. Hence the use of integers in places were we would expect to see counters. 2) RRDTool, and by extension Cricket, is based upon SNMP v2; where the concept of Counters and Gauges were introduced. 3) Due to historic reasons, the SNMP community does not permit the modification of objects once they are cast in stone. [Made public] OID's can be depreciated, but cannot be modified or eliminated. Note: This is were Network Appliance has fallen short. The INTEGER objects in the mib should have been declared historical long ago, and new objects created with a more appropriate object types. 4) The NetApp MIB is tightly tied to the OS release. Check the mib on the system being monitored. You may find that the SNMP v1 object you want to graph, may have been superseded by a SNMP v2 object. I switched from 'miscNfsOps' to 'tnfsCalls' when I upgraded the OS on my filers earlier this year. (I'm running 5.3.4R3) Benjamin Cooper wrote: > Wow, you people have been busy over the night. I didn't mean to turn > this into such a huge thread. > > Could someone send me a summary of what has been concluded? I have read > all the messages, and as far as I can see this are what has been > decided: > 1. NetApp is stupid and really screwed up. > 2. My graphs should work anyway. > 3. Since they don't I have to resort to using the exec collector, and > munge the data > myself. > > Is that a valid summary? Can someone tell me exactly (technically) why > it won't work the way I have it? > > -- > Benjamin Cooper > UCSA I/S Group > Hal Computer > (408) 341-5135 > > _______________________________________________ > cricket-users mailing list > cricket-users(a)lists.sourceforge.net > http://lists.sourceforge.net/mailman/listinfo/cricket-users -- Matthew Lee Stier * Fujitsu Network Communications Unix Systems Administrator | Two Blue Hill Plaza Ph: 914-731-2097 Fx: 914-731-2011 | Sixth Floor Matthew.Stier(a)fnc.fujitsu.com * Pearl River, NY 10965

1 0

removal from mail list
by Peek_Jeff＠emc.com 17 Aug '00

17 Aug '00

Please remove me from this mail list. Some of this is good reading, but It fills up my mail box too quickly. I do appreciate what participation I had. Regards, Jeff

1 0

restore going nuts!
by Steve Losen 17 Aug '00

17 Aug '00

Has anyone seen this one? I have been having problems copying a volume to another volume on the same filer. I did a level 0 copy with ndmpcopy and that appeared to work OK. At the end the restore had these errors right before it exited: home1.Virginia.EDU: DUMP: HALT: The operation was successful! Waiting for home1.Virginia.EDU RESTORE to halt too. home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: bad entry: incomplete operations home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: name: ./h1/e/en/enh7f/RSTTMP05989666 home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: parent name ./h1/e/en/enh7f home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: sibling name: ./h1/e/en/enh7f/Grigory Pechorin as Superflous Psychopath.doc home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: entry type: LEAF home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: inode number: 5989666 home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: flags: TMPNAME home1.Virginia.EDU: RESTORE: HALT: The operation was successful! The transfer is complete. Elapsed time: 12 hours, 13 minutes, 24 seconds. I'm not conviced that the restore was indeed 100% successful. This filer is production, so I can't do the whole copy during a downtime. A few days after the level0 I tried to do a level1 ndmpcopy to pick up any changes, and the restore failed with these errors: home1.Virginia.EDU: LOG: DUMP: home1.Virginia.EDU: LOG: dumping (Pass IV) [regular files] home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: Warning: cannot remove file banner.htm: No such file or directory home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: bad entry: not marked REMOVED home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: name: ./lowinum/banner.htm home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: parent name ./lowinum home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: entry type: LEAF home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: inode number: 9024 home1.Virginia.EDU: LOG: RESTORE: home1.Virginia.EDU: LOG: flags: REMOVED|KEEP home1.Virginia.EDU: RESTORE: HALT: The operation was successful! Waiting for home1.Virginia.EDU DUMP to halt too. (If it sits here forever, the transfer was successful, but the source filer has hung. Press ^C.) home1.Virginia.EDU: LOG: DUMP: home1.Virginia.EDU: LOG: Error writing to standard output: Broken pipe home1.Virginia.EDU: LOG: DUMP: home1.Virginia.EDU: LOG: DUMP IS ABORTED home1.Virginia.EDU: Connection halted: HALT: Internal error! Elapsed time: 0 hours, 21 minutes, 14 seconds. Maybe it didn't like the restore_symboltable file or perhaps it didn't like the dump. After a few tries, with different snapshots, I gave up. So I decided I would have to use rsh dump | rsh restore and use the "x" option on restore rather than "r", which ndmpcopy uses. This would simply restore the level 1 dump without trying to remove files deleted on the live filesystem between the level0 and level1. I didn't trust the restore_symboltable file, so I moved it aside, even though "x" isn't supposed to use it. Then I ran this command: rsh filer -l root -n 'dump 1uf - /vol/vol0/.snapshot/level1' | \ rsh filer -l root 'restore xfD - /vol/vol1' This seemed to be working fine and the dump finished according to the output from rsh, but the restore is still running over an hour later and it's gobbling up 100% of the filer CPU. Furthermore, it seems to be ZEROING OUT ALL THE FILES THAT IT RESTORED! While the dump was running, I checked my own home directory on the new volume because I had changed some files after the level0. Sure enough, some of the new files were there and intact, so restore had restored them. Now that the dump is done, I check those same files and they are all 0 length! What's going on? This volume, has 120G used, but the level1 dump was only 3480944 K according to dump (a bit over 3G). The new volume is twice as big as the old one. The "rsh dump" process has exited, but the "rsh restore" process is still there and the filer CPU is at 100%. I just killed the "rsh restore" and got this error: RESTORE: Interrupted Now the filer CPU is down to 10% or so. We are running DOT 5.3.5R2P2. Steve Losen scl(a)virginia.edu phone: 804-924-0640 University of Virginia ITC Unix Support

1 0

None
by Lynn Gurske 17 Aug '00

17 Aug '00

Please add me to this mailing list Thanks Lynn

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters