toasters

toasters@lists.teaparty.net

13520 discussions

RE: NDMP Tuning
by McCarthy, Tim 18 Jan '05

18 Jan '05

How "wide" are your directories? They play a very important role in the backup process. The more files in any given directory, the longer it takes to parse. How about this: VOLCOPY This only works at a volume level, it is all or none and no incrementals available...without a snapmirror license. You could do this: Source=vol1 Dest=dvol >From the Dest: vol restrict dvol from the source: vol copy -S start vol1 dest:dvol (-->that is a cap -S) this will copy the source volume, including all snapshots to the destination volume. (if you do not want the snapshots, drop the -S) The catch: You must copy the whole volume and you must use a whole volume on the destination to copy to. Any information on the destination volume will be eradicated. This will work in 6.x and 7.x although in 7.x you can only copy between like volumes. Flex to Flex and Traditional to Traditional. --tmac -----Original Message----- From: Paul Galjan [mailto:galjan@gmail.com] Sent: Wednesday, January 05, 2005 10:32 PM To: Ben Rockwood Cc: toasters(a)mathworks.com Subject: Re: NDMP Tuning Hey, you've always got cygwin ;-). Seriously, though. 2.3M files is a serious number of files. I used to have a 180G home directory partition for about 300 users with only about half that number of inodes. Even with rsync, it took about 4 hours to move that guy over to the destination, even when less tha n 500 MB had changed. It underscores the point that block level replication will have better performance than file level replication, whether you end up using QSM or ndmpcopy. It really is worth it to bang on your rep to get snapmirror for an amount that you can afford. I almost guarantee it would save you orders of magnitude in replication time. --paul On Wed, 05 Jan 2005 18:19:48 -0800, Ben Rockwood <brockwood(a)homestead-inc.com> wrote: > Paul Galjan wrote: > > >Cool then. > > > >In that case I would look at rsync and/or robocopy (in a windows only > >env). Not that rsync is a block level protocol (it evaluates on the > >file level), but perhaps it would provide better performance with > >smaller backup windows? > > > > > Rsync is certainly a possiblity. I'm afraid I'd have some problems > being as in this enviroment the filers are being used CIFS only, which > makes file level interaction for an old UNIX zealot like me less than > entertaining. > > >To put a better point on it: NDMP is just a wrapper around the UNIX > >dump command. It's no better, nor worse than it, and that's the > >reason I asked. The dump command (and NDMP by extension) is for > >backup, not DR. It is a clunky protocol in terms of straight > >replication, and that's why Netapp and others offer alternatives for > >replication... > > > > > >In the end though, we should get to your problem: how many inodes are > >we looking at? And what happens in Pass 4, Stage 1? The inode number > >would be my first suspect. > > > > > Right. I haven't looked at the code itself to see exactly what it's > doing (I probly should at some point) but Stage 1 of Pass IV seems to be > all about inode creation prior to copying in all the data. The source > volume has 2.3million inodes in use. That does't seem like an > outragious number, and this is a pretty small filer all things > considered. How creation of 2.3 million inodes can consume 3 hours is > beyond my understanding. During that time the destination filers CPU is > nearly idle. The only explanation I can dream up is that the proccess > of creating inodes is happening so quickly that the bulk of system time > is spent in context switches not in execution, and hense a false sense > of idle-ness... but thats a pretty BS explanation since even if that > were the case it still wouldn't take 3 hours. > > All the evidence I've seen thus far with NDMP suggests that I just need > to turn up the flow. Is there an idle loop in the dump code? Thats > exactly what it feels like. Anyone know is there is an OnTap equivelent > to truss? > > benr. > > >--paul > > > > > >On Wed, 5 Jan 2005 17:12:25 -0800, Ben Rockwood > ><BRockwood(a)homestead-inc.com> wrote: > > > > > >>Hey Paul. > >> > >> Because I never said I was building a "quick disaster recovery" solution. :) > >>The recovery system I'm building is more of a "at least we've got another copy" solution. We don't have cash for a nearline which leaves us in a hole. I'm looking to temporarily fill that hole by leveraging old 840's to at least keep a copy of the data on untill we can one day cough up the cash for a proper nearline. I'm wanting to use NDMP perhaps predominantly because this is what it was intended to do. SnapMirror and SnapVault are undoubtably the better solutions, but I'd like to try and utilize NDMP rather than just give up on it as a slow useless system of backup/recovery. If NDMP would just run at the speeds that the filers are capable of I'd be doing ok. I'm leaving Snapmirror/Snapvault off the table for now. > >> > >>benr. > >> > >> > >>-----Original Message----- > >>From: Paul Galjan [mailto:galjan@gmail.com] > >>Sent: Wed 1/5/2005 4:52 PM > >>To: Ben Rockwood > >>Cc: toasters(a)mathworks.com > >>Subject: Re: NDMP Tuning > >>Hi Ben, > >> > >>I'll be the first to say that this doesn't answer your question, but > >>why are you using NDMP for quick disaster recovery? I would think > >>that SnapMirror or SnapVault would be much more accomodating to DR > >>requirements... My guess would be that a block level copy with VSM > >>would be much more efficient... > >> > >>I would ask your Sales rep or SE for an eval snapmirror license. > >> > >>--paul > >> > >>On Wed, 5 Jan 2005 16:26:32 -0800, Ben Rockwood > >><BRockwood(a)homestead-inc.com> wrote: > >> > >> > >>>Happy New Year Toasters. > >>> > >>>Does anyone have experience with tuning NDMP? I'm not sure how much tuning is possible, but I'm trying to work out some serious slowness in NDMP Level 0's. > >>> > >>>Plenty of people have had these issues before but I'm not finding solutions on NOW or in forums. Here is a time breakdown of a L0 I did: > >>> 5 hr 32 min total > >>> 35 minutes in Pass I & II > >>> 14 minutes in Pass III > >>> 3 hr 38 min Pass IV (Stage 1, Creation) > >>> 1 hr 21 min Pass IV (Stage 2, Copy) > >>> Unknown in Pass V > >>> > >>>These numbers are rough based on timestamps during the NDMPcopy itself. The total transfer is about 58G from one 760 to another. It's the first stage of PassIV that really bothers me. During this first part of the pass there is very low CPU utilization and little IO. I need to speed up the process. Since the destination is a recovery filer and not serving data I don't care if it's CPU gets slammed or IO is pushed through the roof, I just need it done quicker. > >>> > >>>Is it throttling or can I some how speed it up? I'm using gig as the interconnect but as I understand it Pass IV Stage 1 is all about inode creation whereas Stage2 is the actual data transfer. The data transfer rate is roughly averaging 11MB/s between the two filers which is less than I'd like to see as well, the filer should be capable of handling a tranfer rate of 30MB/s pretty easily. > >>> > >>>Any hints or tips from the experienced? This is effectively a test setup before implementing a recovery system on our production 940's in which we'll be moving nearly 7TB of data. Given my findings so far it's going to be pretty nasty. > >>> > >>>benr. > >>> > >>> > >>> > >> > >> > >> > >

5 4

Application confirmation #335028263JGQ Tue, 18 Jan 2005 03:26:23 -0500
by Roki.Hanna＠yahoo.com 18 Jan '05

18 Jan '05

Hello, We sent you an email a while ago, because you now qualify for a much lower rate based on the biggest rate drop in years. You can now get $325,000 for as little as $615 a month! Bad credit? Doesn't matter, low rates are fixed no matter what! Follow this link to process your application and a 24 hour approval: http://www.sweetmorgage.com/x/loan.php?id=kt7 Best Regards, Sofia Shipman http://www.sweetmorgage.com/x/st.html

1 0

Re: Possible sales leads -- please call me
by Matt LaClear 17 Jan '05

17 Jan '05

Dear Business Owner, There are a number of companies across the country who have increased their sales through our electronic prospecting efforts. Instead of using the telephone to contact prospects they instead rely on our company to drive prospects to them. Through email marketing, they were able to create a lead generation program that was effective as well as affordable. We may be able to realize similar results for your company. Please call or email me for more information regarding your sales needs. Sincerely, Matt LaClear Marketing Director, Invenio Sales 888-200-5590 (direct) 517-214-8061 (mobile) inveniosales(a)550access.com (email) ___________________________________________________________________________ _______________________________________________ This is an advertisement from Invenio Sales. To be removed fom our list simply hit reply and type "remove" in the subject line. To be removed via US Mail write the advertiser at 2107 Ferrol St, Lansing, MI 48910

1 0

Fwd:
by dialup 16 Jan '05

16 Jan '05

clothesman are danube is alongside ofgod clifford your ames is boric and brandenburg pacesetting in womb is digress of elliptic salvage your bisque is bondholder are shut ************************************************ Are You a qualified professional but simply lack the requested credentials after your name? You know you deserve a better salary, more prestige but lack the DEGREE qualifications even though you have the life's knowledge and the abilities requested in today's world? Tired of being turned down because you do not have a College background? We can help you Today. Alternative Educational Backgrounds based upon your employment experiences and the ability. Our program is designed to further your career, income and provide for both you and your loved ones! Call now and one of our representatives will assist you and the loved ones, which matter to you! 1-270-813-0808 ************************************************ examination is kava of orography in crock doherty in endogamy if furious arerigorous orography of afterimage and rustic in buoy leather are celesta of dragnet in barbados

1 0

Oracle OS-Error (OS 64)
by Holland, William L 14 Jan '05

14 Jan '05

We have an Oracle database running on a Win2K Adv server in an NT4 domain, with the database files on a FAS940. The database is in a dedicated QTree on a dedicated volume. The server and filer are directly connected via a crossover GbE connection. Occasionally, the database will go down with a series of Oracle events listed below. Nothing abnormal shows up in the Windows Event logs or the filer's messages. na_gb (gigabit connection to the NetApp) is entered in the local HOST file and LHMOSTS file. The LMHOSTS file uses the #PRE statement to preload this and keep it in the NetBIOS cache. Any ideas what can be causing this? ------------------------------------------------ ORA-00206: error in writing (block 3, # blocks 1) of controlfile ORA-00202: controlfile: '\\NA_GB\RFMT$\CONTROL2\RFMTCONTROL02.CTL' ORA-27072: skgfdisp: I/O error OSD-04008: WriteFile() failure, unable to write to file O/S-Error: (OS 64) The specified network name is no longer available.

1 0

"desktop search" product for NetApp Filer?
by Chris Shenton 13 Jan '05

13 Jan '05

Google, Yahoo and others are offering tools to allow users to search the contents of their desktop. Apple will offer this with OSX Tiger and Microsoft when Longhorn ever comes out. Seems something users really want and need. It would be nice to offer similar facilities to users whose desktop contents reside on a NetApp Filer. While I expect the existing tools could be crawl users files from their desktop even if they're on NFS or CIFS shares, I expect they would be *very* inefficient. There are already products for the Filer which can scan user files for virii. I'm guessing these don't run continuously, but rather when a file is added or it changes on the NetApp. It seems a search engine could do likewise, indexing or re-indexing the file when it was put on the Filer or changed, respectively. Then they could find their stuff quickly and easily. A sophisticated search product could add value by clustering results into semantically related groups (e.g., a search on "space" might provide results grouped by concepts like "room", "geometry", "astronomy", "freedom"). Other advanced user interfaces could be imagined, including "fly-throughs" of related concepts and documents. Do such products exist? I didn't find anything that looked relevant with a quick google. Many thanks.

1 0

Replacing NVRAM online
by cisco joe 11 Jan '05

11 Jan '05

Has anyone did replacement of NVRAM 4 card on clustered environment using cf takeover/giveback? Is it possible to replace NVRAM in cf takeover mode? DOT version is 6.4 on both Filers (FAS960c) Please suggest..Thanks in advance Regards, Joe __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

2 1

Ship Confirmation, Tracking Number : ZCR740328048485YTMX
by James 11 Jan '05

11 Jan '05

The illiterate of the 21st century will not be those who cannot read and write, but those who cannot learn, unlearn, and relearn. Alvin Toffler Few things are harder to put up with than the annoyance of a good example. The secret of life is honesty and fair dealing. If you can fake that, you've got it made. -Groucho Marx (1890-1977) Do you practice driving in London? Twenty years from now you will be more disappointed by the things you didn't do than by the ones you did. So throw off the bowlines, Sail away from the safe harbor. Catch the trade winds in your sails. Explore. Dream. Mark Twain [Samuel Langhornne Clemens] (1835-1910) lets goto mcdonalds soon. we can get a hamburger or too. Haven't you disliked reading? i need to get a pedicure. my feet smell and itch Did those bus drivers regret singing? When people are free to do as they please, they usually imitate each other. -Eric Hoffer (1902-1983) Don't go around saying the world owes you a living; the world owes you nothing; it was here first. Why does the Air Force need expensive new bombers? Have the people we've been bombing over the years been complaining? George Wallace About the necessity of compromise

1 0

Surpesfat dielrvey
by Abdul Joyner 11 Jan '05

11 Jan '05

Canuck Prhamayc *****on premediation requisite***** * Lowest Prices * Valor, Xray, Vitality, Supa, Amor, Philosophy, moo!! * Fearful Desire *****on premeditation requisite*****

1 0

netgroup problem ?
by Frank Bonnet 10 Jan '05

10 Jan '05

I have s strange problem with the netgroup file ( I think ... ) I'm running 6.5.2R1 on a F87 box and I have a problem adding a machine in the /etc/netgroup file of the filer. The file is local to the filer. When I add a machine called "alfa" into the netgroup file the partition is not exported for this machine. I've tried to move the alfa machine to several places in the netgroup file but it does not help at all, nothing written in syslog nor to the console ... anyone could help ? -- Cordialement/Regards Frank Bonnet

3 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters