I do not believe the volume was full, I believe it was around 90% usage. I have tried upgrading all of the disks firmware, it says they are all already up to date. How can I take the filer down to run HW diags?

-----Original Message----- From: Simon Probert [mailto:Simon.Probert@gen-i.co.nz] Sent: Monday, February 03, 2003 6:13 PM To: 'Daniel Finn' Subject: RE: Netapp crashed, back up now but it thinks a bunch of disks ar e "o ut-of-date"

OK. If the disk count in the sysconfig -d matches your physical number of disks you have installed, and it looks like it has, then you have a single volume failure. Ontap writes label information to each disk, hence the ability to plug the disks in anywhere and the filer will find the disks and form the volume. You are using an FC card in slot 4 (not the onboard FC) which if it can see all the disks is pointing to a volume corruption problem and not a hardware problem.

To be sure you could take the filer down and run HW diagnostics?? Was the volume full??

Have you tried upgrading all the disk firmware??

I have found the following bug reports on the NOW site. Do you have access to NOW??

Take a look at these articles to see if ah apply??

-----Original Message----- From: Daniel Finn [mailto:DFinn@studentadvantage.com] Sent: Tuesday, 4 February 2003 12:02 p.m. To: 'Simon Probert'; 'toasters@mathworks.com' Subject: RE: Netapp crashed, back up now but it thinks a bunch of disks ar e "o ut-of-date"

all the lights appear to be fine.

slot 0: System Board (NetApp System Board V N4) Model Name: F760 Serial Number: 230349 Firmware release: 2.8_a2 Processors: 1 Memory Size: 1024 MB

na3m-be> version NetApp Release 6.1.2R2: Thu Mar 21 02:30:01 PST 2002 na3m-be> sysconfig -d HA.ID HA SHELF BAY CHAN Disk Vital Product Information ----- ------------ ----- ------------------------------ 4.0 4 0 0 FC:A LKJ776580000101934DX 4.1 4 0 1 FC:A LKG5741100001018J2UA 4.2 4 0 2 FC:A LKJ762100000294605VU 4.3 4 0 3 FC:A LKJ777610000101937YA 4.4 4 0 4 FC:A LKJ76717000010160N6D 4.5 4 0 5 FC:A 3EL090FJ00007127KQXA 4.6 4 0 6 FC:A 3EL08X6K00007127KR2U 4.8 4 1 0 FC:A LKJ766660000101939NA 4.9 4 1 1 FC:A LR84217700007023HWY5 4.10 4 1 2 FC:A LKJ78361000010193802 4.11 4 1 3 FC:A LK779515000020060LVT 4.12 4 1 4 FC:A LK191771000020060SUJ 4.14 4 1 6 FC:A 3EL02WCJ0000V1060MRC 4.16 4 2 0 FC:A LR85728800007023J7Y8 4.17 4 2 1 FC:A LKJ778250000101934FW 4.18 4 2 2 FC:A LKJ783510000101803UW 4.19 4 2 3 FC:A LKJ781640000101937T4 4.20 4 2 4 FC:A LKJ78362000010180Y7L 4.21 4 2 5 FC:A LKJ7682600001017H3H8 4.22 4 2 6 FC:A LRF80892000070394QF7 4.24 4 3 0 FC:A LKJ7815800002943HF67 4.25 4 3 1 FC:A LKJ76648000010182BDA 4.26 4 3 2 FC:A LKJ76437000010163C85 4.27 4 3 3 FC:A LKJ76386000010182CHR 4.28 4 3 4 FC:A LKJ783090000101939QJ 4.29 4 3 5 FC:A LK1974720000101934D2 4.30 4 3 6 FC:A LKJ797290000101939UB 4.32 4 4 0 FC:A LKJ759310000601738J8 4.33 4 4 1 FC:A LKJ77604000010172SG5 4.34 4 4 2 FC:A 3EL02VMC0000V1050D1R 4.35 4 4 3 FC:A LR8068580000102132FB 4.36 4 4 4 FC:A LKJ781720000101939HC 4.37 4 4 5 FC:A LKJ776940000101937NK 4.38 4 4 6 FC:A LKJ779400000101807H2 4.40 4 5 0 FC:A LKJ772680000101807JS 4.41 4 5 1 FC:A LKJ77941000010180LUD 4.42 4 5 2 FC:A LKJ78257000010091VD9 4.43 4 5 3 FC:A LKJ766030000101937X7 4.44 4 5 4 FC:A LKJ79601000010200C27 4.45 4 5 5 FC:A LKJ778470000101937Q5 4.46 4 5 6 FC:A LKJ76768000010151624 4.48 4 6 0 FC:A LKJ77630000010180LUQ 4.49 4 6 1 FC:A LKJ78226000010180DFS 4.50 4 6 2 FC:A LKJ6753800001018HJBL 4.51 4 6 3 FC:A LKJ77933000010200249 4.52 4 6 4 FC:A LKJ76738000020070JN2 4.54 4 6 6 FC:A LKJ0904400002008HEW1

-----Original Message----- From: Simon Probert [mailto:Simon.Probert@gen-i.co.nz] Sent: Monday, February 03, 2003 6:02 PM To: 'Daniel Finn' Subject: RE: Netapp crashed, back up now but it thinks a bunch of disks ar e "o ut-of-date"

Have you check you have power and lights on the PSU's and checked the status of the LED lights on the LRC's. What filer head? What shelf type? What disk type and size? What DOT Version. Send output sysconfig -d.

-----Original Message----- From: Daniel Finn [mailto:DFinn@studentadvantage.com] Sent: Tuesday, 4 February 2003 11:58 a.m. To: 'Simon Probert' Subject: RE: Netapp crashed, back up now but it thinks a bunch of disks ar e "o ut-of-date"

there are 7 in a shelf though? I don't understand how I could have 5 disk missing, I only see one failure in the messages file.

-----Original Message----- From: Simon Probert [mailto:Simon.Probert@gen-i.co.nz] Sent: Monday, February 03, 2003 5:58 PM To: 'Daniel Finn' Subject: RE: Netapp crashed, back up now but it thinks a bunch of disks ar e "o ut-of-date"

You have got 5 disks missing. Are you sure you don't have a shelf powered off??

-----Original Message----- From: Daniel Finn [mailto:DFinn@studentadvantage.com] Sent: Tuesday, 4 February 2003 11:31 a.m. To: 'toasters@mathworks.net' Subject: Netapp crashed, back up now but it thinks a bunch of disks are "o ut-of-date" Importance: High

What does this mean?

na3m-be> vol status Volume State Status Options vol0 online normal root vol1 offline partial na3m-be> vol status vol1 Volume State Status Options vol1 offline partial raid group 0: partial

from the log file:

Mon Feb 3 17:26:52 EST [kern.syslog.msg:CRITICAL]: Volume vol1 is missing 5 disks from RAID group 0 and is being taken offline for this boot. Mon Feb 3 17:26:53 EST [raid.assim.outofdateNdisks:ALERT]: More than one disk in RAID group 0 of volume vol1 has a valid label not consistent with all the others. These disks are assumed to be out of date; their contents cannot be restored. Mon Feb 3 17:26:53 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.32 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:53 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.37 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:53 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.6 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:53 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.24 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:54 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.25 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:54 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.30 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:54 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.11 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:54 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.33 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:54 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.27 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:54 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.3 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:54 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.16 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:54 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.29 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:55 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.35 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:55 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.28 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:55 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.36 originally belonging to volume vol1, RAID group 2 Mon Feb 3 17:26:55 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.9 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:55 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.18 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:55 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.2 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:55 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.5 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:55 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.10 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:56 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.14 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:56 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.17 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:56 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.0 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:56 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.1 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:56 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.19 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:56 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.54 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:56 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.20 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:56 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.12 originally belonging to volume vol1, RAID group 1 Mon Feb 3 17:26:57 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.52 originally belonging to volume vol1, RAID group 0 Mon Feb 3 17:26:57 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.4 originally belonging to volume vol1, RAID group 0 Mon Feb 3 17:26:57 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.44 originally belonging to volume vol1, RAID group 0 Mon Feb 3 17:26:57 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.45 originally belonging to volume vol1, RAID group 0 Mon Feb 3 17:26:57 EST [kern.syslog.msg:error]: There is an out-of-date disk 4.38 originally belonging to volume vol1, RAID group 0

Any help would be really appreciated.

Thanks Dan

____________________________________________________________________ CAUTION - This message may contain privileged and confidential information intended only for the use of the addressee named above. If you are not the intended recipient of this message you are hereby notified that any use, dissemination, distribution or reproduction of this message is prohibited. If you have received this message in error please notify Air New Zealand immediately. Any views expressed in this message are those of the individual sender and may not necessarily reflect the views of Air New Zealand. _____________________________________________________________________ For more information on the Air New Zealand Group, visit us online at http://www.airnewzealand.com _____________________________________________________________________

================================================================ This e-mail message has been scanned and cleared by MailMarshal at gen-i limited - http://www.gen-i.co.nz ================================================================

================================================================ This e-mail message has been scanned and cleared by MailMarshal at gen-i limited - http://www.gen-i.co.nz ================================================================

================================================================ This e-mail message has been scanned and cleared by MailMarshal at gen-i limited - http://www.gen-i.co.nz ================================================================