toasters

toasters@lists.teaparty.net

13520 discussions

Re: Network Appliance makes the news...
by sirbruce＠ix.netcom.com 17 May '99

17 May '99

On 05/14/99 23:13:56 you wrote: > >On Fri, May 14, 1999 at 10:28:43PM +0000, Richard L. Rhodes wrote: >> Our EMC sales rep sent this to me. Any thoughts or comments, >> on what might have happened? >> >Sure. I know exactly what happened. > >Your EMC rep peed his pants when he saw a competitor having trouble >in public, and made sure you were aware of it. Pretty typical of EMC >reps, AFAICT. They also went and posted it on the NTAP Yahoo message board. As to what happened, the most *likely* scenario for any signficant downtime of the Netapp is double disk failure. That is, one disk failed, and during reconstruction they lost another. However, the description of events (moving mailboxes) may or may not support this. It's hard to rely on such technical details in a media report. It's not clear whether or not data was actually lost. It's also possible that the had a crash due to a bug and this left the filesystem is an inconsitent state and/or a state that caused repeated crashes. In both this and the double-disk failure case, they would have to run wack to make sure the filesystem was okay before returning it to service. This sounds like the "cleaning" they are talking about. If they were running a cluster, most likely there would have been no interruption in service. You get what you pay for. I'm sure their Apache (or whatever) web servers have crashed more than their filers have. There doesn't seem to be much of a story here. Bruce

3 2

Network Appliance makes the news...
by Richard L. Rhodes 15 May '99

15 May '99

Our EMC sales rep sent this to me. Any thoughts or comments, on what might have happened? THanks rick ======================================================================== Failure hits Critical Path email By John Borland <mailto:jborland@cnet.com> Staff Writer, CNET News.com May 11, 1999, 6:05 p.m. PT An equipment failure at email outsourcing company Critical Path has kept potentially tens of thousands of email and Web hosting customers out of their mailboxes since yesterday morning. San Francisco-based Critical Path <http://www.cp.net>, which provides Web-based email services for companies such as America Online <http://www.aol.com>, US West <http://www.uswest.com>, and Sprint <http://www.sprint.com>, said one of its three core mail storage devices failed yesterday morning. The company would not comment on how many customers or email addresses were left inaccessible. One of the company's clients, Verio.com's <http://www.verio.com> TABNet Web hosting subsidiary, has between 15,000 and 20,000 customers, most of which rely on the Critical Path systems, a Verio spokesman said. According to Critical Path, the outage was sparked by the failure of a Network Appliance mail storage system. All the mailboxes affected were moved to another machine, but the data on the failed machine had to be "cleaned" before service could be restored, a spokeswoman said. Network Appliance is doing the equipment repair and data recovery work, and the companies hope to have the mailboxes back online by 10 p.m. today, the spokeswoman said. Critical Path said any email sent to one of the affected addresses is being kept in storage and will be delivered to the unavailable mailboxes as soon as service is restored. In an apparently unrelated outage, many Netcom ISP subscribers also found themselves without access to email beginning early yesterday. The company, which was recently acquired by MindSpring <http://www.mindspring.com>, said that one of its mail servers failed, largely affecting customers with last names beginning with "D," according to MindSpring spokesman Ed Hansen. Other customers also were stuck with slower or temporarily unavailable service as the volume of mail traffic outpaced Netcom's remaining server capacity, he added. The company said it expects to have service restored by the end of the business day today, Hansen said. Customers with affected mailboxes will likely see a deluge of mail, followed by a slower trickle of backlogged messages as they are re-created from the failed server, he added. ---------------------------------------------------------------------- Richard L. Rhodes e: rhodesr(a)firstenergycorp.com Ohio Edison Co. p: 330-384-4904 f: 330-384-2514

2 1

Re: 100% Cpu using quotas under 5.x
by sirbruce＠ix.netcom.com 14 May '99

14 May '99

On 05/14/99 01:10:13 you wrote: > It's the [de0|de1|hipri|lopri]-bit that puzzles me a bit - > can anyone explain ? I can't address your general problem (as you've said in another post, it appears to be SNMP-related) but as to this I've been told that this is just the particular thread the software happened to be in when the quota was to be exceeded. Seeing this in the wafl layers makes sense; I'm not exactly sure how this can occur in the network (de) modules but I've seen it before and been told there's no problem here. I agree, it is a little confusing, but I suppose it's better than not getting the information at all. :) Bruce

2 1

Stale NFS errors
by Jay Orr 14 May '99

14 May '99

HI I'm sure this is a frequently asked question, but I'm stumped... Running an F330 (4.2a) on some sun 2.5.1 systems. /var/adm/messages gives : May 12 23:51:52 cleats unix: NFS write error on host hardrock: Stale NFS file handle. May 12 23:51:52 cleats unix: (file handle: 939e1400 577cd30c 0 856f1000 49ee7326 0 2ae0500 51356400) May 13 00:07:24 cleats unix: NFS write error on host hardrock: Stale NFS file handle. May 13 00:07:24 cleats unix: (file handle: 939e1400 577cd30c 0 816f1000 3fda490e 0 2ae0500 51356400) May 13 03:13:35 birdland unix: NFS write error on host hardrock: Stale NFS file handle. May 13 03:13:35 birdland unix: (file handle: 939e1400 577cd30c 0 856f1000 d1f07326 0 2ae0500 51356400) May 13 03:24:07 therat unix: NFS write error on host hardrock: Stale NFS file handle. May 13 03:24:07 therat unix: (file handle: 939e1400 577cd30c 0 866f1000 9b927326 0 2ae0500 51356400) May 13 11:38:28 mcbutts unix: NFS write error on host hardrock: Stale NFS file handle. May 13 11:38:28 mcbutts unix: (file handle: 939e1400 577cd30c 0 866f1000 df967326 0 2ae0500 51356400) Now, I'm trying to figure out WHAT file(s) are doing this. I've read NetApps "Troubleshooting NFS Stale File Handles on Sun Clients (Series of FAQs)" doc, and SunWorld's "Errno Libretto" which discuss tracing these things, but nothing is what it should be. **1) "use showfh". That's not in 2.5.1. I got a copy of fhfind, but that doesn't work either. 1a) First, it looks in /etc/mnttab for the device id to decide where to search. NO DEVICE ID MATCHES!!!! 1b) it uses the 4th number for the inode number. WRONG -- that translates into a 10 digit INODE number. All the inode numbers are 5-7 digits. **2) NetApp's doc states that the second number is the device number of the file system, and the third number is the inode number. NO, the 3rd number is "0". My guess is that the filer uses a 64bit INODE number, while solaris is using a 32bit inode. How can I figure out what is going on?? ----------- Fujitsu - Nexion, St. Louis, MO Jay Orr (314) 579-6517

3 8

RE: Multiple subnets, NT and Netapp
by Mankovsky, Mike 14 May '99

14 May '99

Give this a try this. Use -wins option with the ifconfig command on filer to suppers the registration of both filer IP addresses with WINS. Use OPTIONS CIFS.NETBIOS_ALIASES to add a second netbios name for each filer that corresponds to the filer's second NIC. Add a static entry to WINS that maps the first netbios name to the ip address of the first NIC. Do not make this a multihomed entry. Add a second static entry to WINS that maps the netbios alias name to the ip address of the second NIC. Do not make this a multihomed entry. >From the IIS machine use UNC path to connect to the filer's alias name. Mike Mankovsky Network Appliance -----Original Message----- From: Sam Schorr [mailto:sschorr@homestead.com] Sent: Friday, May 14, 1999 8:47 AM To: 'toasters(a)mathworks.com' Subject: Multiple subnets, NT and Netapp Folks, I hoping someone out there can help us understand how we can setup a network "backchannel" in an NT domain environment. Here's the situation: One NT domain that has approximately 20 servers in it. Of those, 8 are IIS servers. The HTML content, dynamically created and accessed by anonymous web users, is stored on 2 F740's. Right now, all the servers, domain controllers, SQL servers, and the filers are on one subnet. The filers are accessed by dlls on the IIS systems using UNC - \\filername\dir1\dir2\websitename. The filername part of that path conforms to the hostname given the filer in the NT domain; the websitename part if dynamically created when the anonymous web user creates a web site. What I want to do is have the filers connect to the IIS systems, and only the IIS systems, on a second subnet to maximize bandwidth and isolate the file access traffic from other traffic. However, I cannot seem to get around the fact that NT wants to take the UNC pathing and do a name resolution through WINS; and WINS does not like 2 network addresses for the same host. NT does not seem to handle the idea that allows name resolution by NIC, something easy to setup on the filer and in UNIX. When we have tried this, the IIS systems seem to ignore lmhost files where we have put the second filer NIC name and address, routes a call to WINS, then finally seems to find the second subnet when WINS fails to. We have tried putting the IP address of the second NIC in the UNC call, but NT treats it as a string, so no go. BTW, the IIS servers do have a second NIC card on the backchannel switch that we connect the second filer NIC to. Help? Sam Schorr Homestead Technologies ph: (650) 549-3152 fax: (650) 364-7329 sschorr(a)homestead.com Don't just build a home page...build a Homestead!! http://www.homestead.com

1 0

Multiple subnets, NT and Netapp
by Sam Schorr 14 May '99

14 May '99

Folks, I hoping someone out there can help us understand how we can setup a network "backchannel" in an NT domain environment. Here's the situation: One NT domain that has approximately 20 servers in it. Of those, 8 are IIS servers. The HTML content, dynamically created and accessed by anonymous web users, is stored on 2 F740's. Right now, all the servers, domain controllers, SQL servers, and the filers are on one subnet. The filers are accessed by dlls on the IIS systems using UNC - \\filername\dir1\dir2\websitename. The filername part of that path conforms to the hostname given the filer in the NT domain; the websitename part if dynamically created when the anonymous web user creates a web site. What I want to do is have the filers connect to the IIS systems, and only the IIS systems, on a second subnet to maximize bandwidth and isolate the file access traffic from other traffic. However, I cannot seem to get around the fact that NT wants to take the UNC pathing and do a name resolution through WINS; and WINS does not like 2 network addresses for the same host. NT does not seem to handle the idea that allows name resolution by NIC, something easy to setup on the filer and in UNIX. When we have tried this, the IIS systems seem to ignore lmhost files where we have put the second filer NIC name and address, routes a call to WINS, then finally seems to find the second subnet when WINS fails to. We have tried putting the IP address of the second NIC in the UNC call, but NT treats it as a string, so no go. BTW, the IIS servers do have a second NIC card on the backchannel switch that we connect the second filer NIC to. Help? Sam Schorr Homestead Technologies ph: (650) 549-3152 fax: (650) 364-7329 sschorr(a)homestead.com Don't just build a home page...build a Homestead!! http://www.homestead.com

1 0

Re: 100% Cpu using quotas under 5.x
by Ketil Kirkerud Elgethun 14 May '99

14 May '99

Following up on my own posting: It looks a _lot_ like SNMP is the culprit - we have a script, run daily, that extracts information (via SNMP) from the filer about qtrees. Running this scipt by hand made the filer go bananas (CPU pegged at 100%, until i did a 'quota off;quota on'. The interesting bit of the script is as follows : for $host (ListService("netapp-server", "ALL")) { mkdir($host, 02775) unless (-d $host); # netapp.netapp1.quota.quotaState.0 ($state) = snmpget ($host, $cmty, '1.3.6.1.4.1.789.1.4.1.0'); if ($state != 2) { warn "$host does not have quotas initialized (state = $state)"; next; } $id=0; while (1) { $id++; # netapp.netapp1.quota.qrTable.qrEntry.qrIndex # netapp.netapp1.quota.qrTable.qrEntry.qrType @ret = snmpget ($host, $cmty, '1.3.6.1.4.1.789.1.4.3.1.1.'.$id, '1.3.6.1.4.1.789.1.4.3.1.2.'.$id, '1.3.6.1.4.1.789.1.4.3.1.8.'.$id, ); last if $ret[0] < 0; next if $ret[1] != 3; # Only qrTypeTree $ret[2] =~ y/A-Z/a-z/; ($fs = $ret[2]) =~ s%/%-%g; print CFG <<EOF; << print to mrtg.cfg-file >> EOF; } } So. This works fine on 4.x - and it looks like it works fine on a F330 running 5.1pre (but this box does not have 160K users on it). Anyone have any ideas ? -- ---Ketil Kirkerud Elgethun, SOL System

1 0

100% Cpu using quotas under 5.x
by Ketil Kirkerud Elgethun 13 May '99

13 May '99

I have an interesting problem with one of my F540s (maxed out on memory and disk controllers, approx 40 disks) : It used to run 4.3.1D3 - on recommendation from my vendor (there was a bug in the release we were running that bit us), I upgraded to 5.2.1P2D4 - the NetApp is serving the home directories of approx. 160.000 users (largest UID approx 161000)- and we use default quotas. A few (less than 500) of the users have specific quotas. This worked very well under 4.x - it still works, but after having been up and running for 20 hours or so, the NetApp becomes _very_ sluggish, with 100% CPU consumed - it still serves nfs requests, but very slowly. Doing 'quota off; quota on' gets the box going again - but this is hardly ideal. I can imagine some mechanisms that would cause this: 1) Bugs have crept into the quota software in OnTap 2) Bugs have crept into syslog - we run with the default syslog config, and we get a _lot_ of messages about exceeded quotas. The messages differ slightly : Thu May 13 21:26:12 MES [wafl_hipri]: uid 75355 tid 15: disk quota exceeded on volume vol0 Thu May 13 21:27:31 MES [de1]: uid 75355 tid 15: disk quota exceeded on volume vol0 Thu May 13 22:26:44 MES [de0]: uid 18002 tid 16: disk quota exceeded on volume vol0 Thu May 13 22:26:44 MES [wafl_lopri]: uid 18002 tid 16: disk quota exceeded on voume vol0 (these are just excerpts, we get a _lot_ of them as well as quite a few "Thu May 13 21:40:59 MES last message repeated 7 times" related to the aforementioned messages) It's the [de0|de1|hipri|lopri]-bit that puzzles me a bit - can anyone explain ? I couldn't care less about users exceeding their quotas - and wouldn't mind being able to turn off the reporting. (I would still like to be able to know about qtrees exceeding their quotas, however). My gut feeling is that this is the root of the problem. (too many 'quota exceeded' messages overloading syslogd somehow, that is) 3) The quota mechanisms can't take the load (but then, why did it work so well in 4.x ?) Has anyone else seen tha same problem ? (It's being escalated through our vendor - my experience with them and NetApp is good, but I'd like to find out if anyone else has seen anything like this problem) -- ---Ketil Kirkerud Elgethun, SOL System

1 0

RE: Netapp filers & MS Exchange
by Jonas Jonsson 13 May '99

13 May '99

I've tried to do some "brain work" on this and come to the following conclution: 1. How can I create a "Exchange consistent" snapshots to provide for the backup of Exchange (snapshot) with of the shelf software like Legato Networker (no Exchange API - just files). Snapshtos will do for this. Just remember Exchange might be running for a while in a non-consistant mode before it decides to do a halt. 3. In case of a need for partial data recovery - is there a Filer local copy, the convert a part of a snapshot from RO to RW mode besides a through the host copy can can always be done but consumes a lot of bandwidth, time and resources. Would appreciate any thoughts/suggestions/enlightnings/pointers to the above subjects. Partial recovery I think might be a problem which ever solution you chose. Exchenge, as far as I know, is working on a information blob. The best solution is to use snapshots and recover to a stable point in time, preferably some hours back in time. If anyone has information on the workings/non-workings of Exchange and how it stores/not stores information. Pleas comment or I'll go further on my darkend path ;) /// Regards, Jonas

1 0

Re: Netapp filers & MS Exchange
by sirbruce＠ix.netcom.com 13 May '99

13 May '99

On 05/13/99 07:30:54 you wrote: > >I am willing to implement Exchange on NetApp. I have two exchange >servers with each holding about 20GB of data. I have seen the document >on NOW. It is imperative to have close to 24*7 service from the Exchange >servers. You can't, because you've already chosen Exchange. There's nothing wrong with Netapp in this case, but Exchange is a crappy piece of software that may give you 24*6 service at best. Bruce

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters