toasters January 1998

toasters@lists.teaparty.net

35 participants
27 discussions

Re: NetApp and amanda
by Jan-Pieter Cornet 13 Jan '98

13 Jan '98

In article <199801131829.MAA18731(a)vortex.more.net>, David Drum <david(a)more.net> wrote: >I was wondering if anyone uses amanda to backup their NetApp(s)? Yup, we do. At least, we used to, until yesterday :) The load on the netapp during phase I of the dump is prohibitively high, and consequently makes our webserver very slow... we're currently rethinking things. There are a few problems to backing up a toaster via amanda, and here are the solutions, roughly: - the toaster doesn't run amandad :) And you can't easily make it do so. Our solution is to have amanda backup /dev/netapp1/path on another machine. To keep the network happy, that "other machine" is also the one that the tape is connected to, and the one that amanda (the master program, or the client, whatever you want to call it) runs on. "dump" on this machine is actually a script that intercepts requests to dump devices of the form /dev/netapp*. If it isn't, it calls the regular dump. If it is, it calls a separate program, which translates some options, and then starts dump on the toaster, via rsh. (Note that the devices that amanda thinks it's backing up need to exist. Just create them and make them symlinks or hardlinks to /dev/null or /dev/zero. Doesn't really matter). Next problem: - amanda does not grok toaster "dump" output. Perl to the rescue again (the dump wrapper is perl, too :). Since we had to start a separate script anyway, we're piping STDERR through the script, and have it do on-the-fly translations so the output of "dump" as produced by the toaster is massaged into something that amanda understands. Additionally, we trap "dump W" and read the /etc/dumpdates file on the toaster too, and generate extra output for it. A few considerations you have to make: - amanda starts by getting estimates for all filesystems it backs up, that is, it makes at least 2 dumps for each filesystem, and terminates the dump once the "estimated" line is in. If the "dump" command on the toaster creates its own snapshot each time you do this, you waste a lot of CPU. We settled on generating a snapshot once each day, and running all backups from that. You have to take extra special care though not to refresh the snapshot while a backup is still running. - amanda doesn't know anything about "oh don't try to backup this so often". At least I can't configure it to do so (without extreme hacks). It knows about priorities, but it will always at least try to make a backup, and if it fits on tape, it will. This generally means that amanda does make a backup of all data on the toaster, at least incrementally. Not strictly necessary with the RAID and all that. If there is interest, I can post the sources we use to the list, or make them available on the web. Note that the sources are very alpha, and most definately not directly usable on other sites, some tweaking will be necessary. Best regards, -- #! ##### Jan-Pieter Cornet ##### <johnpc(a)xs4all.net> ##### perl ++$_;$!=$_+++$_;($:,$,,$/,$*)=$!=~/.(.)...(.)(.).(.)/;$!=$_+$_; ($(a),$\,$~)=$!=~/(.)(.).(.)/; $_="$,$/$:"; $@++; $~="$~$_";($_)= \$$=~/\((.)/;$|=++$_;$_++;$|++;$~="$~ $@$:";`$~$/$\$*$, $|>&$_`

1 0

NetApp and amanda
by David Drum 13 Jan '98

13 Jan '98

Hello, I was wondering if anyone uses amanda to backup their NetApp(s)? Regards, David K. Drum david(a)more.net -- It's hard to be bored when you're as stupid as a line. [1] Reality has a tendency to be so uncomfortably real. [2] You can only measure the size of your head from the inside. [3] When you proceed deliberately, mistakes don't cascade, they instruct. [4] [1] Vernor Vinge [2] Neil Peart [3] Larry Wall [4] Stewart Brand

1 0

Re: Usenet: Crosspost - File Exists error
by Ronan Mullally 13 Jan '98

13 Jan '98

> We've just installed a 540 to provide back-end storage for our news system. > Since going live the INN error log has been full of the following messages: > > crosspost cant link alt/jobs/16941 misc/jobs/offered/24616 : File exists > crosspost cant link talk/politics/misc/2349 alt/feminism/944 : File exists ... > Has anybody come across this before? What is to blame - INN, Linux > or the filer? The answer is "None of the above", I'd lost the '-L' flag for innd in the upgrade. Thanks to Ed Klein of BBN Planet for his speedy diagnosis :) -- Ronan Mullally 'In the Beginning there was Network Manager nothing, which exploded.' Ireland On-Line -- Terry Pratchett.

1 0

Usenet: Crosspost - File Exists error
by Ronan Mullally 13 Jan '98

13 Jan '98

We've just installed a 540 to provide back-end storage for our news system. Since going live the INN error log has been full of the following messages: crosspost cant link alt/jobs/16941 misc/jobs/offered/24616 : File exists crosspost cant link talk/politics/misc/2349 alt/feminism/944 : File exists It appears that the crosspost daemon is generating this error while trying to create the necessary hard links for *every* crossposted article (I have yet to verify this) it encounters. The link *is* successfully made, and the article appears in the directory but the error log contains tens of thousands of error messages per day. Before switching to the filer we encountered no such problems. The INN feeder system is a Pentium running Linux 2.0.33. The filer is a 540 running 4.3R4. I encountered the same problem on a 210, also running 4.3R4. I've tracked the error down to the following code fragment (backends/crosspost.c line 172): /* 2nd try to link */ lnval = link(names[0], names[i]) ; if (lnval < 0 && errno == EXDEV) { #if defined(DONT_HAVE_SYMLINK) ... symlink stuff removed ... #endif /* defined(DONT_HAVE_SYMLINK) */ } else if (lnval < 0) { (void)fprintf(stderr, "crosspost cant link %s % names[0], names[i]); perror(" "); } So it appears that link() is returning an EEXISTS error. The link() man page includes the following: BUGS On NFS file systems, the return code may be wrong in case the NFS server performs the link creation and dies before it can say so. Use stat(2) to find out if the link got created. Has anybody come across this before? What is to blame - INN, Linux or the filer? -- Ronan Mullally 'In the Beginning there was Network Manager nothing, which exploded.' Ireland On-Line -- Terry Pratchett.

1 0

(no subject)
by Ying-Chih Liu 13 Jan '98

13 Jan '98

subscribe toastors

1 0

(no subject)
by Ying-Chih Liu 13 Jan '98

13 Jan '98

1 0

None
by Marc Nicholas 12 Jan '98

12 Jan '98

subscribe --- Marc Nicholas - Hippocampus OSD, Inc. - Eastern Office 416 979 9000 - fax: 416 979 8223 - http://www.hippocampus.net 125 John St. - Suite #100 - Toronto - Ontario - M5V 2E2 - CANADA "Inter/Intra/Extra[net] consulting, corporate access, hardware and software sales"

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters January 1998