toasters

toasters@lists.teaparty.net

13529 discussions

Re: filesystem and RAID questions
by hitz＠netapp.com 08 Dec '97

08 Dec '97

> > Looks Like it finished rebuilding the disk to me ;) > > I think I've misused the term "degraded mode", but my question is > still the same. What exactly is it going to do if the scrub fails? > I'd rather the filer wasn't stressed until a new spare is in there. I understand your question now. If RAID scrub finds a block it can't read, it reads the corresponding blocks on all the other drives and reconstructs the missing data. Then it re-writes the unreadable block, which remaps the block to a new location. I believe the remapping occurs automatically, because we set an auto-remap flag on the drives, but this may vary from drive to drive. This doesn't require a spare disk. > I guess it still could help with localized media errors, but I've > never seen any reaction to media errors other than a whole disk > failing out. If a WRITE fails, then we do drop the whole disk out. This is because, with auto-reremap, a WRITE should never, ever fail. If it does, there's something seriously wrong. A read failure during normal operation is handled as described above with RAID scrubbing. The block is rebuilt and rewritten so that the drive remaps it. We added RAID scrub because single block failures do occur, and they are nasty. If you've got an undetected bad block, and then a different disk fails entirely, then the stripe with the bad block will be impossible to reconstruct, because it has two missing blocks. In this case we zero both blocks and require the user to run WACK to fix whatever damage that causes. That generally works, unless the lost block is really important, but it's much, much better to find and fix the bad block right away, which is what the scrubbing does. It actually took a year or two before we started seeing this problem in our install base. We figure that it just takes a while before a system sits long enough to have files that never get read, and then for a failure to occur in such a file. Dave

1 0

snooping NFS traffic
by Daniel Quinlan 07 Dec '97

07 Dec '97

Does anyone know of any good tools to snoop NFS traffic? I'm looking for something better than snoop or tcpdump that caches lookups and decodes file names, etc. - Dan

2 1

filesystem and RAID questions
by Daniel Quinlan 07 Dec '97

07 Dec '97

A few questions maybe someone could answer: - Why does a NetApp scrub the disk when it is in degraded mode? - What is the chunk size in NetApp RAID (using the term "chunk" to mean the amount of data written on each disk in each stripe)? - Is the WAFL block size still 4k? I seem to remember that it had grown, but all of the online documentation says 4k. Thanks. Dan

2 1

Re: "netapp" - command-line NetApp remote monitoring
by Ashley Miller 06 Dec '97

06 Dec '97

just fyi, some mib names can be a bit misleading. for example CpuBusyTimePercent is not an instantaneous value of cpu utilization, but rather the percent time the filer has been doing useful work since the last reboot. read the mib carefully. -ashley

1 0

"netapp" - command-line NetApp remote monitoring
by Daniel Quinlan 06 Dec '97

06 Dec '97

This Perl 5 script (I can it "netapp") can be used to remotely monitor a Network Appliance via SNMP. To use it, you need a working version of "snmpwalk" and "snmpget" from the UCD snmp tools distribution in addition to version 1.1 of the NetApp MIB. I might switch it over to using the Perl5 SNMP module eventually. You'll possibly have to change some paths and parsing depending on how different your SNMP tools installation is from ours. I wrote this to allow non-privileged users to get information from the toaster without logging in or running rsh. These are the basic commands supported: partial sysstat -> "netapp -sysstat filer" or "netapp -sysstat=60 filer" df -> "netapp -df filer" df -i -> "netapp -if filer" also -> "netapp -df -if filer" It's pretty intelligent about loading the network too. An earlier version of this script only used snmpwalk, which produces a lot of back-and-forth chatter, even if you walk a very small portion of the SNMP tree. Example output: $ netapp -sysstat myf330 CPU NFS Net kB/s in out 35% 411 675 915 16% 164 230 153 $ netapp -df myf630 Filesystem kbytes used avail capacity Mounted on / 78277988 54447172 23830816 70% / /.snapshot 8697552 19281448 -10583896 222% /.snapshot $ netapp -if myf630 Filesystem iused ifree %iused Mounted on / 694555 2174415 24% / I hope this is useful to someone... Dan ------- start of cut text -------------- #!/usr/local/bin/perl # please do not post this script to Usenet, I do not like spam. # Copyright (C) 1997 Transmeta Corporation # written by Daniel Quinlan <quinlan(a)transmeta.com> # # This program is free software; you can redistribute it and/or modify # it under the terms of the GNU General Public License as published by # the Free Software Foundation; either version 2 of the License, or # (at your option) any later version. # # This program is distributed in the hope that it will be useful, # but WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the # GNU General Public License for more details. # # You should have received a copy of the GNU General Public License # along with this program; if not, write to the Free Software # Foundation, Inc., 675 Mass Ave, Cambridge, MA 02139, USA. $ENV{'PATH'} = "/usr/local/bin:/usr/bin:/bin"; $ENV{'MIBFILE'} = "/usr/local/share/snmp/mibs/netapp.mib"; $prog = $0; $prog =~ s@.*/@@; use Getopt::Long; &GetOptions("help", "dump", "sysstat:i", "df", "if", "quota"); if ($opt_help) { &usage; exit 0; } if ($ARGV[0]) { $host = $ARGV[0]; } else { &usage; exit 1; } sub usage { print <<EOF; usage: $prog [options] filer --help print this help --sysstat=n report filer statistics every n seconds (15 is default) --df summarize free disk space --if summarize inode use --quota (unimplemented) report quotas EOF } if (defined ($opt_sysstat)) { my $interval = 15; my $count = 0; my $first = 1; my $query = join(' ', "cpu.cpuUpTime.0", "cpu.cpuBusyTime.0", "misc.miscNfsOps.0", "misc.miscNfsOps.0", "misc.miscNetRcvdKB.0", "misc.miscNetSentKB.0"); $ENV{'PREFIX'} = ".iso.org.dod.internet.private.enterprises.netapp.netapp1.sysStat"; if ($opt_sysstat) { $interval = $opt_sysstat; if ($interval < 1) { die("$prog: sysstat interval must be greater than 0\n"); } } for (;;) { if ($count-- == 0) { print " CPU NFS Net kB/s\n"; print " in out\n"; $count = 20; } open (SNMPGET, "snmpget -v 1 $host public $query |"); while (<SNMPGET>) { /cpuUpTime\.0 = Timeticks: $(\d+)$/ && ($cpuUpTime2 = $1); /cpuBusyTime\.0 = Timeticks: $(\d+)$/ && ($cpuBusyTime2 = $1); /miscNfsOps\.0 = (\d+)/ && ($miscNfsOps2 = $1); /miscNetRcvdKB\.0 = (\d+)/ && ($miscNetRcvdKB2 = $1); /miscNetSentKB\.0 = (\d+)/ && ($miscNetSentKB2 = $1); } close (SNMPGET); if ($first) { $first = 0; } else { $cpu = int (($cpuBusyTime2 - $cpuBusyTime1) / ($cpuUpTime2 - $cpuUpTime1) * 100); $NfsOps = int (($miscNfsOps2 - $miscNfsOps1) / $interval); # work-around if ($miscNetRcvdKB2 < $miscNetRcvdKB1) { $miscNetRcvdKB1 -= (2**32 / 1024); } if ($miscNetSentKB2 < $miscNetSentKB1) { $miscNetSentKB1 -= (2**32 / 1024); } $NetIn = int (($miscNetRcvdKB2 - $miscNetRcvdKB1) / $interval); $NetOut = int (($miscNetSentKB2 - $miscNetSentKB1) / $interval); printf "%3d%% %6d %5d %5d\n", $cpu, $NfsOps, $NetIn, $NetOut; } $cpuBusyTime1 = $cpuBusyTime2; $cpuUpTime1 = $cpuUpTime2; $miscNfsOps1 = $miscNfsOps2; $miscNetRcvdKB1 = $miscNetRcvdKB2; $miscNetSentKB1 = $miscNetSentKB2; sleep $interval; } } if ($opt_dump) { open (SNMPWALK, "snmpwalk -v 1 $host public netapp |"); while (<SNMPWALK>) { print $_; } close (SNMPWALK); } if ($opt_df || $opt_if) { my $min, $max, $i; my $query = ""; $ENV{'PREFIX'} = ".iso.org.dod.internet.private.enterprises.netapp.netapp1.filesys.dfTable.dfEntry"; open (SNMPWALK, "snmpwalk -v 1 $host public dfIndex |"); while (<SNMPWALK>) { /dfTable.dfEntry.dfIndex.(\d+) = (\d+)/ && do { $dfIndex[$1] = $2; if (!defined($min)) { $min = $1; } $max = $1; }; } close (SNMPWALK); for ($i = $min; $i <= $max; $i++) { $query .= join(' ', "dfEntry.dfFileSys.$i", "dfEntry.dfKBytesTotal.$i", "dfEntry.dfKBytesUsed.$i", "dfEntry.dfKBytesAvail.$i", "dfEntry.dfPerCentKBytesCapacity.$i", "dfEntry.dfInodesUsed.$i", "dfEntry.dfInodesFree.$i", "dfEntry.dfPerCentInodeCapacity.$i", "dfEntry.dfMountedOn.$i "); } $query =~ s/ $//; $ENV{'PREFIX'} = ".iso.org.dod.internet.private.enterprises.netapp.netapp1.filesys.dfTable"; open (SNMPGET, "snmpget -v 1 $host public $query |"); while (<SNMPGET>) { /dfFileSys.(\d+) = "(\S+)"/ && ($dfFileSys[$1] = $2); /dfKBytesTotal.(\d+) = (\d+)/ && ($dfKBytesTotal[$1] = $2); /dfKBytesUsed.(\d+) = (\d+)/ && ($dfKBytesUsed[$1] = $2); /dfKBytesAvail.(\d+) = (-?\d+)/ && ($dfKBytesAvail[$1] = $2); /dfPerCentKBytesCapacity.(\d+) = (\d+)/ && ($dfPerCentKBytesCapacity[$1] = $2); /dfInodesUsed.(\d+) = (\d+)/ && ($dfInodesUsed[$1] = $2); /dfInodesFree.(\d+) = (\d+)/ && ($dfInodesFree[$1] = $2); /dfPerCentInodeCapacity.(\d+) = (\d+)/ && ($dfPerCentInodeCapacity[$1] = $2); /dfMountedOn.(\d+) = "(\S+)"/ && ($dfMountedOn[$1] = $2); } close (SNMPGET); if ($opt_df) { print "Filesystem kbytes used avail capacity Mounted on\n"; for ($i = $min; $i <= $max; $i++) { printf "%-10s %10d %10d %10d %3d%% %s\n", $dfFileSys[$i], $dfKBytesTotal[$i], $dfKBytesUsed[$i], $dfKBytesAvail[$i], $dfPerCentKBytesCapacity[$i], $dfMountedOn[$i]; } } if ($opt_if) { print "Filesystem iused ifree %iused Mounted on\n"; printf "%-10s %10d %10d %3d%% %s\n", $dfFileSys[1], $dfInodesUsed[1], $dfInodesFree[1], $dfPerCentInodeCapacity[1], $dfMountedOn[1]; } } ------- end ----------------------------

3 4

Re: Maximum number of quota entries?
by Ketil Kirkerud Elgethun 04 Dec '97

04 Dec '97

Daniel Quinlan <quinlan(a)transmeta.com> writes: > Brian Tao <taob(a)nbc.netcom.ca> writes: > > > How many lines can I have in /etc/quotas? Is it limited by memory > > or CPU? Is there a performance hit the more quotas I apply? I may > > have need for 2000+ user quota entries on an F210 with 256MB read > > cache. > > It must take some memory, but if the data structures are compact, it > shouldn't be too much. Using default quotas (see below) makes > maintaining /etc/quotas easier, but I doubt it does much to reduce > memory usage. > > # Quota Target type disk files > # ------------- ----- ---- ----- > /home tree 80G > * user@home 10G I'm doing some experimenting on this right now - on a loaded 630 i've got a line like this in /etc/quotas : * user@mail 100M 50 (this is a copy of our mailspool - I will _not_ experiment on a production machine) - a 'quota report' returns approx. 56000 lines - does anybody know what (if any) the limits are ? -- ---Ketil Kirkerud Elgethun, Scandinavia Online

2 1

Re: Maximum number of quota entries?
by Daniel Quinlan 04 Dec '97

04 Dec '97

Brian Tao <taob(a)nbc.netcom.ca> writes: > How many lines can I have in /etc/quotas? Is it limited by memory > or CPU? Is there a performance hit the more quotas I apply? I may > have need for 2000+ user quota entries on an F210 with 256MB read > cache. It must take some memory, but if the data structures are compact, it shouldn't be too much. Using default quotas (see below) makes maintaining /etc/quotas easier, but I doubt it does much to reduce memory usage. # Quota Target type disk files # ------------- ----- ---- ----- /home tree 80G * user@home 10G Dan

1 0

Maximum number of quota entries?
by Brian Tao 04 Dec '97

04 Dec '97

How many lines can I have in /etc/quotas? Is it limited by memory or CPU? Is there a performance hit the more quotas I apply? I may have need for 2000+ user quota entries on an F210 with 256MB read cache. -- Brian Tao (BT300, taob(a)netcom.ca) "Though this be madness, yet there is method in't"

1 0

Quad Ethernet Card Support
by John F. Kane 02 Dec '97

02 Dec '97

The Data ONTAP Software Release 4.3R3 field alert and "4.3 Configuration Guild" have left me with the following questions: 1.) Is the quad-port 10/100Base-T card supported on the F330? 2.) If so, can I have three dual-attached FDDI cards active at the same time as the quad-port 10/100Base-T card on the same F330? This is necessary to support our backbone migration from FDDI to ATM. 3.) Is the quad-port 10/100Base-T card supported on the F230? 4.) What support for quad-port 10/100Base-T cards does ONTAP 4.3 provide? Does any previous release support the card? Any help is appreciated. -- John F. Kane Lead Staff, G052 Joint Analysis Center, EUCOM The MITRE Corporation

2 2

"quota resize" wish
by Steve Losen 01 Dec '97

01 Dec '97

We're running 4.2a on a F630. It would be nice if "quota resize" would work when you add a new entry to the /etc/quotas file when you have a default quota. In other words, if /etc/quotas has a default quota entry and a user has no entry in /etc/quotas, he gets the default quota. The netapp keeps track of his disk consumption and even "quota report" lists the user. But if I add a new entry to /etc/quotas to give this user a new quota, "quota resize" ignores it. I don't think it would be very hard for "quota resize" to work in this case. Would it? I can see a problem if the netapp does not keep track of the disk consumption of users who have no quota. Then adding a new entry to /etc/quotas would require the netapp to compute the user's disk usage on the fly. This would be about as expensive as a complete "quota on". But when you have a default quota, every user has a quota, so this isn't a problem. At the very least, I think "quota resize" should work for every user whose disk consumption is currently limited by a quota, even those with the default quota. Likewise, it would be nice to be able to delete a line from the file and have the user revert to the default quota after a "quota resize". (The latter may already work; I haven't tested it.) Steve Losen scl(a)virginia.edu phone: 804-924-0640 University of Virginia ITC Unix Support

2 1

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters