toasters

toasters@lists.teaparty.net

13514 discussions

command line for a filerview output (snapshot used)
by Sto Rage© 07 Mar '05

07 Mar '05

Hi, Using Filerview, one can see the amount of space consumed by each snapshot on any volume, by going to Volume->Snapshots->Manage screen. Is there a command line option that will give me the same output? Volume Name Date Used Total Status vol1 nightly.3 Mar 02 23:26 405.3 MB 1.133 GB normal vol1 nightly.2 Mar 03 23:22 735.1 MB 754.5 MB normal vol1 nightly.1 Mar 04 23:23 13.21 MB 19.47 MB normal vol1 weekly.0 Mar 05 23:19 3.145 MB 6.262 MB normal vol1 nightly.0 Mar 06 23:18 1.691 MB 1.691 MB normal TIA -G

1 0

RE: nis.group_update.enable
by Luke Howard 05 Mar '05

05 Mar '05

>Does anyone have experience using LDAP to obtain group information on >filers using the RFC 2307 compliant options in DOT 6.5 and up, >specifically with Novell eDirectory? I had some success configuring it against XAD (which supports a variant of RFC 2307). More information is at: http://www.padl.com/TechNotes/XADONTAPConfigurationNote.html >I'm also curious about how the ldap.usermap.* options work - the >documentation is a bit vague on what the filer expects to see in the >.attribute.*account options and how/when lookups are performed. Anyone >played this or know what the code does? I think this is to handle the case where a single identity has different user names for UNIX and Windows. eg: options ldap.usermap.attribute.unixaccount uid options ldap.usermap.attribute.windowsaccount sAMAccountName Presumably you can avoid the overhead of an extra lookup if user names are the same in your deployment. -- Luke --

1 0

RE: Oracle DSS on filer
by Frank, Jason 04 Mar '05

04 Mar '05

If all that you require is a R/O database, why not use Oracle's Hot Standby feature? I realize that this doesn't much rely on NetApps (although it's handy for the initial copy...), but it does the job quite well. I've got a Hot Standby that has been up and running for 3 years, and 2 major Oracle Upgrades without problems. Jason -----Original Message----- From: George Kahler [mailto:george@YorkU.CA] Sent: Friday, March 04, 2005 3:26 PM To: toasters(a)mathworks.com Subject: Oracle DSS on filer I'm looking for help with Oracle 9i/Oracle DSS on a filer. Some time ago I set up an environment for my DBAs to allow them to have a DSS version of the University Student Information System database (SIS - about 140 GB + duplex logs) based on the NetApp document "Implementing a DataMart/DSS Oracle Databse [TR3041]." The problem that users are complaining about is that it takes about 1/2 hr for the DBAs to create the DSS. This is created nightly at midnight. The DBAs shutdown the database, take a snapshot of the database volume and a snapshot of the log volume. Then they proceed to copy control file info and about 17 GB of logs and some undo table from the R/W database to the DSS database. They're saying that this is necessary because when the DSS comes up it wants to do a rollback and thus it needs the old logs/undo to do this. Question that everyone is asking: Isn't there a way that you can tell the DSS database to ignore the recovery (since it is a R/O database anyway) and just start up without processing the logs and the undo ? Thx, ------------------------------------------------------------------------ ------- George Kahler e-mail: george(a)yorku.ca Sr. Systems Administrator humans: (416) 736-2100 x.22699 Computing and Network Services machines: (416) 736-5830 Ontario, Canada, M3J-1P3

1 0

Oracle DSS on filer
by George Kahler 04 Mar '05

04 Mar '05

I'm looking for help with Oracle 9i/Oracle DSS on a filer. Some time ago I set up an environment for my DBAs to allow them to have a DSS version of the University Student Information System database (SIS - about 140 GB + duplex logs) based on the NetApp document "Implementing a DataMart/DSS Oracle Databse [TR3041]." The problem that users are complaining about is that it takes about 1/2 hr for the DBAs to create the DSS. This is created nightly at midnight. The DBAs shutdown the database, take a snapshot of the database volume and a snapshot of the log volume. Then they proceed to copy control file info and about 17 GB of logs and some undo table from the R/W database to the DSS database. They're saying that this is necessary because when the DSS comes up it wants to do a rollback and thus it needs the old logs/undo to do this. Question that everyone is asking: Isn't there a way that you can tell the DSS database to ignore the recovery (since it is a R/O database anyway) and just start up without processing the logs and the undo ? Thx, ------------------------------------------------------------------------------- George Kahler e-mail: george(a)yorku.ca Sr. Systems Administrator humans: (416) 736-2100 x.22699 Computing and Network Services machines: (416) 736-5830 Ontario, Canada, M3J-1P3

1 0

Anyone using Netapp filers for SAN or email ?
by Steve Losen 04 Mar '05

04 Mar '05

We have used Netapp filers for 8 years and are very pleased. We currently have a F820c pair for NFS and CIFS access to home directories and web content. I am one of the primary filer admins. We are about to purchase some disk storage to replace a lot of locally attached and SAN RAID arrays (Sun T3s and T4s) for some Solaris servers. Naturally I think we should buy Netapp. One project is our administrative Oracle servers. I realize that Netapp and Oracle both recommend using NFS with Netapp, but we currently have a SAN infrastructure and lots of other inertia to overcome. If we buy Netapp for this, the filers will at least start out serving LUNs on our SAN. I am convinced that Netapp is they way to go for NFS, but I have not seen much about Netapp in a SAN environment. We were looking at EMC Symmetrix, but probably cannot afford it, so it will probably be a choice between EMC Clariion and Netapp. Our "production instance" (I'm not familiar with the particulars) is 500G and growing. We also have a data warehouse instance and other misc. databases. The warehouse is copied fresh from production each night and then a 6 hour job crunches on it before it is made available for querying. Obviously a cloned volume would be nice here. Is anyone running Oracle on Solaris over a SAN to a Netapp? How is the performance? How many filers and what models? How much storage? How many disks? We are familiar with all the nifty snapshot features, volume cloning, etc. We just don't want to find out the hard way that the Netapp SAN solution is a poor performer with Oracle. We also have a University email system on Solaris servers running Communigate Pro. We have over 20,000 users and about 1TB of email on disk. We are using mbox format and most email clients use imap. Our email admins looked into maildir format but found that in our environment it took ten times longer for imap to scan inboxes. This is not a surprise since inboxes usually have a lot of short messages, so it is often faster to just read the whole inbox than open a file for each message and read just the headers. And imap regularly needs to scan all the message headers in an inbox. There are many advantages to the maildir format, but we are afraid that it would crush our current system. However, we are thinking that a Netapp filer would do a better job with maildir than a local Veritas filesystem on Solaris. Is anyone out there running a large email system over NFS to a Netapp filer using maildir format? If you are using Communigate Pro, and/or do a lot of imap, that would be even better. How many email accounts and how much mail do you process? How many filers and what models? How much storage? Do you have any performance issues? Currently our email servers do a lot more reads than writes (we read over 5 bytes for each byte we write). We don't know what the actual disk activity is inside the T3s and T4s, we only know how much we read and write from each LUN. We don't know the actual RAID 5 write overhead, and we don't know how many reads are satisfied from cache internal to the T3s and T4s. Our email admins say that the T3s occasionally get swamped, but that the T4s seem to be doing fine, so they could probably replace the T3s with T4s and be OK for a couple years. But they want to expand storage and triple user quotas and perhaps switch to maildir, and they are afraid that T4s can't handle all that. Plus snapshots would make restoring lost email messages so much easier. Thanks for any information you can give me. I'm going to look at Netapp's white papers, too. Steve Losen scl(a)virginia.edu phone: 434-924-0640 University of Virginia ITC Unix Support

2 1

RE: nis.group_update.enable
by Krueger, Jeffrey 04 Mar '05

04 Mar '05

Does anyone have experience using LDAP to obtain group information on filers using the RFC 2307 compliant options in DOT 6.5 and up, specifically with Novell eDirectory? I'm also curious about how the ldap.usermap.* options work - the documentation is a bit vague on what the filer expects to see in the .attribute.*account options and how/when lookups are performed. Anyone played this or know what the code does? - Jeff -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Steve Losen Sent: Thursday, March 03, 2005 3:32 PM To: Bob Borowicz Cc: toasters(a)mathworks.com Subject: Re: nis.group_update.enable > I read where it was recommended (I think for Oracle RAC) to enable the > following option: > > nis.group_update.enable > > The man page says this enables a local cache of the group data. > > Are calls to the NIS (ypbind) slow in DOT? > > I'm running 6.4.4R1 > The problem is that NIS provides group maps keyed by group name and by group number (gid). It does not, however, provide a map that is keyed by user that lists all the groups that the user belongs to. But this group list is what a filer needs whenever a user logs in to CIFS (to map windows credentials to Unix credentials) In order to discover which groups a user belongs to, the filer must use NIS to fetch each group entry and see if the user is listed in it. If you have a very long group map, then every time a user logs in to CIFS the filer must fetch each group entry, with a separate NIS transaction for each one. By caching the group map, the filer can get the user's group list without NIS. Who knows, the cache may even be organized as group lists keyed by user name. This is not a problem peculiar to netapps. All Unix systems that use NIS have to linearly scan the entire group map every time a user logs in, to find the user's groups. If you are not using CIFS then you don't have a problem. NFS does not cause the netapp to scan the group map because each NFS packet contains the user's uid, gid, and group list. The NFS client obtains this information once when the user logs in. I also wouldn't worry about it if your group map is not large. Anecdote alert: A few years back one of our NIS servers started chewing up tons of CPU. I traced it and discovered that it was almost 100% sequential scans of our very large group map (almost 700 groups). It turned out that most of these scans were coming from the same machine, which was a busy web server. We had a CGI program run via suexec (which runs the CGI as a particular user). Suexec sets the group list for the user, which requires a linear scan of the NIS group map. So every time this CGI was hit (constantly) the web server was shooting almost 700 NIS requests at the NIS server. On our netapps and web servers we are now using local /etc/group files updated periodically by cron jobs that copy the NIS map to the local file -- much much better. Steve Losen scl(a)virginia.edu phone: 434-924-0640 University of Virginia ITC Unix Support

1 0

nis.group_update.enable
by Bob Borowicz 04 Mar '05

04 Mar '05

I read where it was recommended (I think for Oracle RAC) to enable the following option: nis.group_update.enable The man page says this enables a local cache of the group data. Are calls to the NIS (ypbind) slow in DOT? I'm running 6.4.4R1 Thanks -Rob

4 3

RE: Destroying failed disks
by Hill, Aaron 04 Mar '05

04 Mar '05

Until you get a permanent solution; Please rate this solution at bottom of page. Solution ID: ntapcs9168 Solution Status: Publish-Public Title: How does NetApp ensure the integrity of data on returned disks? What happens to RMA disks? - NetApp appliances Problem Environment: NearStore appliance R100 NetApp filer FAS900 series F800 series F700 series F600 series F500 series F300 series F200 series Data ONTAP Disk drives Problem Description How does NetApp ensure the integrity of data on returned disks? What happens to RMA disks? Solution: All disk drives returned to Network Appliance are subjected to a three part failure verification process. The last step involves a "zero disk" command which does a "Write Same Zero" at the sector level overwriting all data on the drive with zeros. Drives are completely wiped of any and all data. In rare cases, the drive does not function sufficiently to overwrite the data. As a part of the normal warranty processing, the drive would be shipped back to the supplier with customer data intact, although not readily accessible. Because of the way RAID 4 works, with striping of data across multiple disks, even if the data becomes readable by the supplier on a restored disk, it would be almost impossible to make the data usable. For more information on how RAID 4 works, refer to 5.2. Eliminating the Parity Disk Bottleneck in NetApp Tech Report 3001. Network Appliance has non-disclosure agreements with all its suppliers to further ensure that your data is protected. However, for customers on secure sites, or who require an additional level of security regarding their data, there is a "No-Return" service agreement available under which it would not be necessary to return drives that have failed. For more information regarding this type of service agreement, please contact your NetApp sales representative. Last updated: 08 JAN 2003 -----Original Message----- From: Chris Thompson [mailto:cet1@cus.cam.ac.uk] Sent: Friday, 4 March 2005 5:25 AM To: galjan(a)gmail.com Cc: toasters(a)mathworks.com Subject: Re: Destroying failed disks Paul Galjan <galjan(a)gmail.com> writes; > For those interested, this article shows what Netapp does with returned disks: > http://now.netapp.com/Knowledgebase/solutionarea.asp?id=ntapcs9168 > --paul I would love to read this page, but for some reason whenever I display it, after a second or less it gets replaced by the much more boring http://now.netapp.com/NOW/Error/bad_gateway.pl Anyone know how I can prevent that happening? -- Chris Thompson Email: cet1(a)cam.ac.uk ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au. If you no longer wish to receive commercial electronic messages from us, please reply to this e-mail by typing Unsubscribe in the subject line. ***************************************************************

1 0

RE: nis.group_update.enable
by Jeff Mohler 03 Mar '05

03 Mar '05

Not really slow, but since a filer is meant to consolidate many other servers worth of data, the amount of calls can be obscene in some cases. Either way, it does increase performance. Now..I dont recall, but I -think- that you can place your group/etc files in /etc on a filer, and it will honor them, however you cant do a push from your NIS master to a filer to update them. :( I argued for that years ago, it makes sense to allow it, but it never got anywhere. -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com]On Behalf Of Bob Borowicz Sent: Thursday, March 03, 2005 5:38 PM To: toasters(a)mathworks.com Subject: nis.group_update.enable I read where it was recommended (I think for Oracle RAC) to enable the following option: nis.group_update.enable The man page says this enables a local cache of the group data. Are calls to the NIS (ypbind) slow in DOT? I'm running 6.4.4R1 Thanks -Rob

1 0

RE: Destroying failed disks
by Jeff Mohler 03 Mar '05

03 Mar '05

It's a calculated trade-off. We assume that NetApp does the right thing and crunches the disks once they have done a failure analysis back in their labs. --- If you assume that, and you really care, I would not assume any vendor of drives or storage material does this. I have NO idea what Netapp does, but I would not ASSUME that they physically destroy disks with your data on them. Right now, I assume youre thinking about upping your service contract to be able to keep your own dead disks so that you can destoy them yourself and remove the assumption of the mitigation of risk. But only you can know for sure.

4 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters