toasters June 1999

toasters@lists.teaparty.net

85 participants
118 discussions

Re: Quick quota question
by Luke Mewburn 10 Jun '99

10 Jun '99

Steve Armijo writes: > and actually, if you are doing quotas by name ( can you do them by uid?) > then the filer would also need to have access to the passwd file. You can do quotas by name, but I recommend to do them by uid. On an F330, it took over 2 minutes to read /etc/quotas which has ~2700 entries (/etc/passwd has ~5800 entries) when we specified user quotas by name. Changing our quota generation script to uids reduced that to 2 seconds!

1 0

Metadata preservation during network file backup
by Itzik (Itzhak) Meirson DSc. 10 Jun '99

10 Jun '99

I would appreciate if someone could clarify the issue of metadata preservation during network backup of filers data. Lets assume that I have a share with NFS/CIFS access. If backing up this share from NFS will the CIFS metadata preserved upon restore? If backing up this share from CIFS will the NFS ACLs be preserved upon restore? Thnaks, Itzik

5 5

Re: Q: lose shelf power supply
by George Kahler 09 Jun '99

09 Jun '99

Greetings... "George Kahler" <george(a)viper.ccs.yorku.ca> writes: Guys, thanks for your replies/comments to my question regarding loosing a shelf power supply. I should have added that the filers in question do not support fail-over and are running only a single volume, DOT 4.3.x. Also, I failed to indicate that all my shelfs have ONLY ONE power supply. I can live with a short ( <5 min ) outage. To summarize, I think that you all agreed that having redundant power supplies in shelfs is a good think to have and that having only one (as in my case, we are a poor University :-) ) will not cause data loss. Thx again, George ------------------------------------------------------------------------------- George Kahler e-mail: george(a)yorku.ca UNIX Systems Administrator humans: (416) 736-5257 x.22699 Computing Services, York University machines: (416) 736-5830 Ontario, Canada, M3J-1P3

1 0

RE: DLT library controls
by Melvin, Grant 08 Jun '99

08 Jun '99

Hi, If you take a close look at the ndmp.org ftp site (ftp.ndmp.org), you'll see a test application built on top of the SDK called ndmptest. This contains code to manipulate a SCSI library via NDMP and has been compiled for use on a Solaris system. The code resides in /pub/version.2/contrib and is *very* interactive, but it provides the next layer on top of the SDK (ndmp_api) to build test applications that you're after. The test application provides a menu of options for each NDMP defined interface: ndmp_test -host filer **************************************** * * * NDMP Test Application * * * **************************************** Received ndmp_notify_connected request: version:2 reason:CONNECTED Connection successful Enter Command > h Help Menu --------- C - Connect Interface Menu CA - Connect Client Authentication CC - Connect Close CO - Connect Open CS - Connect Server Authentication D - Data Interface Menu DA - Data Abort DB - Data Start Backup DE - Data Get Env DG - Data Get State DR - Data Start Recover DS - Data Stop H - This Help Menu I - Config Interface Menu IA - Config Get Authentication Attributes IB - Config Get Backup Type Attributes IH - Config Get Host Info IM - Config Get Mover Type M - Mover Interface Menu MA - Mover Abort MB - Mover Set Record (Block) Size MC - Mover Close MG - Mover Get State ML - Mover Listen MO - Mover Continue MR - Mover Read MS - Mover Stop MW - Mover Set Window S - Scsi Interface Menu SC - Scsi Close SG - Scsi Get State SI - Scsi Inquiry SMM - Scsi Move Medium SMS - Scsi Mode Sense SN - Scsi Initialize Element Status SO - Scsi Open SRB - Scsi Reset Bus SRE - Scsi Read Element Status SRP - Scsi Read Position SRT - Scsi Reset Target SS - Scsi Set Target STP - Toggle DLT PERFMODE STU - Scsi Test Unit Ready T - Tape Interface Menu TC - Tape Close TM - Tape MTIO TO - Tape Open TS - Tape Get State X - Exit Program Enter Command > S Scsi Interface Menu ------------------- SC - Scsi Close SG - Scsi Get State SI - Scsi Inquiry SMM - Scsi Move Medium SMS - Scsi Mode Sense SN - Scsi Initialize Element Status SO - Scsi Open SRB - Scsi Reset Bus SRE - Scsi Read Element Status SRP - Scsi Read Position SRT - Scsi Reset Target SS - Scsi Set Target STP - Toggle DLT PERFMODE STU - Scsi Test Unit Ready Enter Command > The code is presented as reference code and "use at your own risk". Cheers, Grant -----Original Message----- From: cng1(a)cecil.muscat.com [mailto:cng1@cecil.muscat.com] Sent: Tuesday, June 08, 1999 2:45 PM To: toasters(a)mathworks.com Subject: Re: DLT library controls grdodson(a)lexmark.com wrote: > ndmp-probe - a "probe-scsi" like command to find where NDMP devices are > (not as obvious as you would think) > ndmp-index - a program which maps out the robot's state using > SCSI "Read Element Status" commands > ndmp-move - a program that orders the robot to "Move Medium" > Unfortunately I cannot share my work without getting the corporate lawyers >involved Gah, this sounds like exactly the sort of thing I and I imagine many others would like. If anyone does have code to do this and can release it then please do so. If nobody has then I'll have a look at the ndmp sdk and see how far I get (probably nowhere but its worth a go). Chris -- Chris Good - Muscat Ltd. The Westbrook Centre, Milton Rd, Cambridge UK Phone: 01223 715006 Mobile: 07801 788997 http://www.muscat.com

1 0

RE: DLT library controls
by grdodson＠lexmark.com 08 Jun '99

08 Jun '99

I have had a similar problem controlling a StorageTek 9730 robot. (no sequential mode, bummer!) My long term solution is to use the STILL unavailable Legato storage node S/W for the NetApp. My short term solution was to write some NDMP utilities to control the robot. Basically I took the 2.11 version of the NDMP developers kit and modified it. In fact it's not quite that simple, I kept the commo routines (./common) but had to rewrite the NDMP command layer because it was designed for an event driven environment (tk/tcl) and also has limited error handling. With this done, I wrote three utilities: ndmp-probe - a "probe-scsi" like command to find where NDMP devices are (not as obvious as you would think) ndmp-index - a program which maps out the robot's state using SCSI "Read Element Status" commands ndmp-move - a program that orders the robot to "Move Medium" These utilities are then called by perl scripts that know how and when things need to be done. Dumps are done via rsh, not NDMP for simplicity. The perl script forks multiple dumps so the two tape drives are written to in parallel. One drawback of this method is that I cannot easily dump one NetApp to the tape drives on another. (NDMP's dump can do this) All my dumps are for disaster recovery, not archival, so I don't need to keep complicated tape indexes. Unfortunately I cannot share my work without getting the corporate lawyers involved. What I can tell you is that it can be done. All you really need is a time, a bunch of specs, and the "vendor specific" NDMP values from netapp. (available if you ask) Graydon Dodson grdodson(a)lexmark.com Lexmark International Inc. ----- Begin Included Message -----

2 1

Re: directory optimisation.
by jrg＠gbnet.net 08 Jun '99

08 Jun '99

On Tue 8 Jun, 1999, yann.golanski(a)ThePLAnet.net wrote: >/vol/vol1/data/Z/XX/XXXX/<full_usr_name>/files which reminds me - is there any concept akin to 'toolong' in the filer name lookup cache? You probably need to watch out for that at your nfs client too. >where XX and XXXX are the first 2 and first 4 characters of > <full_usr_name> and > Z is a hash spliting the <full_usr_name> between 2 filers -- yes, we > have a rather large system ;) why not just use the hash the username, and then split that up into a suitable number of chunks? James.

1 0

Q: lose shelf power supply
by George Kahler 08 Jun '99

08 Jun '99

Could someone please explain what happens when you loose a single power supply in a shelf? Is the filer smart (dumb) enough to halt? Do I get 'double disk error' and loose the filesystem? There is a discussion going on here as to what happens in a hardware RAID configuration vs a NetApp filer when a power supply fails. The thought is that if I have only one power supply in a shelf and it fails (failing 7 disks) it is like having multiple disks fail and therefore you loose the filesystem. Thanks, George ------------------------------------------------------------------------------- George Kahler e-mail: george(a)yorku.ca UNIX Systems Administrator humans: (416) 736-5257 x.22699 Computing Services, York University machines: (416) 736-5830 Ontario, Canada, M3J-1P3

5 4

Re: directory optimisation.
by Jim McCoy 08 Jun '99

08 Jun '99

>Suppose I have a filer (760) with about 50 million files -- between >1k and 500M. What would be the optimum directory structure to keep them all? We had the same problem at Yahoo when it comes to storing user database entries (e.g. MyYahoo account info) and mailboxes for YahooMail accounts. The biggest win we found was that you should go to great lengths to make sure that your directories can stay in the cache as much as possible. For YahooMail this was a four layer structure (/##/##/####/<hash>/maildir) and for the MyYahoo it was three layers. The WAFL system is pretty good when it comes to doing lookups on big directories, the only thing you need to do to help it out is to load up on system RAM and keep directories small enough that you can keep lots of them in the filers cache so that with a little bit of luck lookups run through the directories in cache and then hit the disk for the actual files. jim mccoy Yahoo! Inc.

1 0

Re: DLT library controls
by Jay Sekora 08 Jun '99

08 Jun '99

> That brings up a related question though -- since ndmp allows SCSI > commands to be sent directly to the device, that would theoretically allow > one to control the robotics over the network via NDMP. > > Do any of the NDMP-based packages support this? (Legato, Budtool, > whatever) BudTool (running, obviously, on a Unix box) does indeed tell our Breece Hill tape library (attached to the NetApp) to load and unload specific tapes, and it talks to the library through the NetApp via NDMP. So I guess this must be how it's doing it. Cheers, Jay Sekora <jay(a)ccs.neu.edu> Unix Systems Administrator Northeastern University College of Computer Science

1 0

DLT library controls
by cng1＠cecil.muscat.com 08 Jun '99

08 Jun '99

I've had a DLT7000 tape library for some time now backing up our ageing 540 but I've never been terribly happy with the controls for loading/unloading the library. In order to backup start a backup on a given tape I have to either go to the loaders console and tell it to load the tape or I need to know what tape I am on and give the correct number of "mt -f urst0a status" commands to cycle through to the correct tape. I believe that I could use something other than dump to do the backups but dump is free and does exactly what I want. The problem is compounded that since upgrading the firmware on the tape drive (to allow autocleaning) the mt -f urst0a status trick hasn't worked. Is there a better way? I would've thought that there should be some better drive robotics control functions - have they crept in between 4.3 and 5.x? FYI I'm running 4.3 connected to a overland dlt7100 drive. Chris -- Chris Good - Muscat Ltd. The Westbrook Centre, Milton Rd, Cambridge UK Phone: 01223 715006 Mobile: 07801 788997 http://www.muscat.com

4 4

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters June 1999