toasters

toasters@lists.teaparty.net

13520 discussions

Not explicitly NetApp, but this seems like the right crowd to ask: Linux (RHEL4.4), iSCSI & NetApp connectivity problems...
by Demaagd, Dave 04 May '07

04 May '07

Some information on the physical layout: 3 subnets in question - a general server VLAN, a '3rd party developer' server VLAN that is heavily firewalled off from everything else, a dedicated unmanaged switch LAN that is intended to segregate iSCSI traffic from the rest of the network. The first two run on the same switch fabric. 4 initiators in question - All RHEL4.4, all current packages and errata applied, all have confirmed connectivity (ping and telnet to port 3260). The NetApp is an IBM N5200 (rebadged NetApp 3020) running DOT 7.1. Interface layout looks like this: e0a is connected to the general server VLAN, e0b is connected to the iSCSI LAN, e0c and e0d are used as crossover cable connections (which I am trying to eliminate by implementing the iSCSI LAN). The e0a interface has iSCSI targeting disabled, it is enabled (the default setting) on b c and d. HostA - on the 3rd party VLAN (eth0) and the iSCSI LAN (eth1) HostB - on the general server VLAN (eth0) and the iSCSI LAN (eth1) HostC - on the general server VLAN (eth0) and connected to the NetApp via a crossover (eth1) NetApp - on the general server VLAN, the iSCSI LAN, and using 2 ports for crossover (interface layout given above) The story/problem (as I see it): Was trying to hook HostA up to the NetApp to get some extra disk space for it. Software installed clean, no special settings - just set the DiscoveryAddress to the NetApp iSCSI LAN address in iscsi.conf, set the initiator name, mapped the initiator name/group to a LUN, and figured that would be it (that config worked great with the crossover connections). Fired up the daemon, saw the connection on both ends, iscsi-ls shows the LUN on the initiator. But, if I try to do anything that actially looks at it from a device level (fdisk -l, cat /proc/scsi/scsi, etc), I get a mess of 'ping timeout, failed command, session dropped, session established' loops before it finally gives up a few minutes later (usually gives up, sometimes it locks so hard I may as well reboot the box). After messing with additional parameters that looked promising (particularly the PingTimeout option) in iscsi.conf without success, I came up with the hypothesis that maybe there was some strange interaction because the primary network interface for this machine is on is heavily firewalled (no outbound, period; only inbound is on port 80 and 22). To test this hypothesis, I set up HostB, identical packages/network layout as HostA, and it worked great. Figured that kinda added weight to my hypothesis above. Would deal with that later, I was happy. The problem came in last night when I attempted to change HostC from the crossover connection to the iSCSI LAN. Stopped services, unmounted drives, changes network and iSCSI parameters, started things back up again. Lo and behold, the same thing that happened to HostA was happening to HostC. Fortunately, was able to roll this back very easily, so nobody but myself was irritated. Been searching around today to see if I can find information about similar problems on the web, found a couple things that didn't help (but were interesting reading, and I did manage to get some performance boosts out of them), and I thought it was time that I should ask someone who might have experience in this kind of thing before I pull out too much hair. I really hope that this is something simple that I'm overlooking. Log files/packet traces/general details available if needed (don't want to spam too many people with info that may not be applicable)... -- Dave DeMaagd, DOL QA Engineering dave.demaagd(a)dig.com | (818) 623-3755 | (818) 262-7958

1 0

Solaris Oracle NFS mount options
by Carl Howell 02 May '07

02 May '07

In TR-3322 it says that the mount point for the redo logs should have the forcedirectio option on and the mount point for the data files should have it off. KB7518, which appears to be more recent, doesn't say anything about mount options for redo log volumes, but I assume you should have either forcedirectio or llock on both the mount points for your redo logs and data files. Is this correct? Thanks, - Carl

2 2

RE: Data migration
by Suresh Rajagopalan 27 Apr '07

27 Apr '07

I did try clearing the snapmirror snapshot but that did not work for me. Setting snapmirror.enable to be off worked. Suresh _____ From: Leeds, Daniel [mailto:dleeds@edmunds.com] Sent: Friday, April 27, 2007 1:06 PM To: Kleinbrahm, Robert; Suresh Rajagopalan; toasters(a)mathworks.com Subject: RE: Data migration or you can clear the snapmirror snapshot within the volume to remove the relationship. -- Daniel Leeds Senior Systems Administrator Edmunds.com -----Original Message----- From: Kleinbrahm, Robert [mailto:rkleinbrahm@firstrepublic.com] Sent: Fri 4/27/2007 1:03 PM To: Suresh Rajagopalan; Leeds, Daniel; toasters(a)mathworks.com Subject: RE: Data migration I had the same thing happen to me. Solution is to turn snapmirror off on both the source and destination before mounting the lun. Netapps response on this. 1. Turn off SnapMirror on source filers 2. Turn off SanpMirror on destination filers. Snapmirror no longer detects a previously SnapMirrored relationship. When connecting to that LUN, the mounting process takes very little time. This worked for me and is quite fast. Bob K. ________________________________ From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Suresh Rajagopalan Sent: Friday, April 27, 2007 12:05 PM To: Leeds, Daniel; toasters(a)mathworks.com Subject: RE: Data migration OK I tried these steps with a small 20g volume. Unmount the source lun, do final snapmirror update, break mirror, set fs_size_fixed on. Now When I try to connect the new lun via snapdrive on the destination, I get (after the prompt for SFSR) the following error message: Unable to connect disk Failure in checking policies Error: unable to find a snapshot containing a consistent virtual disk to restore This happens on both snapdrive 4.1 and 3.1.1R1. What am I missing? Thanks Suresh ________________________________ From: Leeds, Daniel [mailto:dleeds@edmunds.com] Sent: Thursday, April 26, 2007 3:26 PM To: Suresh Rajagopalan; toasters(a)mathworks.com Subject: RE: Data migration snapmirror is what you want. you can set it up anytime prior to the migration and let it run on a schedule or manually to build the initial baseline. after that you just do a snapmirror update to keep it in sync. we have done this so many times it's second nature. quite simply: 1) create target volume and initialize snapmirror relationship to source while lun is live and serving data 2) setup maintenance window and take filesystem/lun offline 3) perform final snapmirror update 4) break snapmirror relationship and bring new lun/volume online 5) mount new lun/filesystem and serve up data snapmirror is a really handy product :) -- Daniel Leeds Senior Systems Administrator Edmunds.com -----Original Message----- From: owner-toasters(a)mathworks.com on behalf of Suresh Rajagopalan Sent: Thu 4/26/2007 3:02 PM To: toasters(a)mathworks.com Subject: Data migration I need to migrate a 1.4Tb lun from one filer to another with minimal downtime (< 30 mins). So clearly some copying of data has to be done prior to the actual move. Would snapmirror or flexclone be the most appropriate for this? I'm not sure how I would get a consistent copy of the lun over to the other filer. This is not a database, the lun contains flat files on NTFS. Thanks Suresh The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. First Republic Bank and its subsidiaries do not take responsibility for, or accept time-sensitive instructions sent by email including orders, funds transfer instructions or stop payments on checks. All instructions of this nature must be handled by direct communication, not email. We reserve the right to monitor and review the content of all email communications sent or received. Emails sent to or from this address may be stored in accordance with regulatory requirements.

1 0

RE: Data migration
by Suresh Rajagopalan 27 Apr '07

27 Apr '07

OK I tried these steps with a small 20g volume. Unmount the source lun, do final snapmirror update, break mirror, set fs_size_fixed on. Now When I try to connect the new lun via snapdrive on the destination, I get (after the prompt for SFSR) the following error message: Unable to connect disk Failure in checking policies Error: unable to find a snapshot containing a consistent virtual disk to restore This happens on both snapdrive 4.1 and 3.1.1R1. What am I missing? Thanks Suresh _____ From: Leeds, Daniel [mailto:dleeds@edmunds.com] Sent: Thursday, April 26, 2007 3:26 PM To: Suresh Rajagopalan; toasters(a)mathworks.com Subject: RE: Data migration snapmirror is what you want. you can set it up anytime prior to the migration and let it run on a schedule or manually to build the initial baseline. after that you just do a snapmirror update to keep it in sync. we have done this so many times it's second nature. quite simply: 1) create target volume and initialize snapmirror relationship to source while lun is live and serving data 2) setup maintenance window and take filesystem/lun offline 3) perform final snapmirror update 4) break snapmirror relationship and bring new lun/volume online 5) mount new lun/filesystem and serve up data snapmirror is a really handy product :) -- Daniel Leeds Senior Systems Administrator Edmunds.com -----Original Message----- From: owner-toasters(a)mathworks.com on behalf of Suresh Rajagopalan Sent: Thu 4/26/2007 3:02 PM To: toasters(a)mathworks.com Subject: Data migration I need to migrate a 1.4Tb lun from one filer to another with minimal downtime (< 30 mins). So clearly some copying of data has to be done prior to the actual move. Would snapmirror or flexclone be the most appropriate for this? I'm not sure how I would get a consistent copy of the lun over to the other filer. This is not a database, the lun contains flat files on NTFS. Thanks Suresh

3 2

Data migration
by Suresh Rajagopalan 27 Apr '07

27 Apr '07

I need to migrate a 1.4Tb lun from one filer to another with minimal downtime (< 30 mins). So clearly some copying of data has to be done prior to the actual move. Would snapmirror or flexclone be the most appropriate for this? I'm not sure how I would get a consistent copy of the lun over to the other filer. This is not a database, the lun contains flat files on NTFS. Thanks Suresh

8 8

Hot-remove loop B
by Suresh Rajagopalan 26 Apr '07

26 Apr '07

We are running a 3020 cluster and need to do maintenance on one side of the cluster (filer head and disk shelves). Can we unplug loop B from the other cluster member while it is running? We only need it to service its loop A during the maintenance window. Thanks Suresh

2 1

Hot add first shelf to loop?
by Stephen C. Losen 26 Apr '07

26 Apr '07

We are going to start a new FC disk loop. The new shelf is DS14mk2 with ESH2 modules and we will connect it to a X2050B-R5 adapter. This is a FAS960c clustered pair running DOT 7.1.1.1 so we will connect the shelf to both heads. We want to do the same thing with a second shelf on the other head. Can this be done without taking down the filers? I checked NOW and only found instructions for hot adding a shelf to an existing loop, A little more info... We have a downtime scheduled to install the new FC adapters in the heads. We have two new shelves in a new cabinet for which we do not have power yet. If the circuits have been run before the downtime, then we are OK. If not, then we will install the adapters in the heads and connect the shelves later when we have power, but we want to avoid a second downtime for that. If we must power down the head to add the first shelf, then we can't use cf takeover and giveback because the shelf is connected to both heads. Another possibility would be to run extension cords to the new shelves and when we get power to the cabinet, switch the power plugs one at a time so the shelves don't lose power. The netapp cabinet is powered by 220V circuits, and I suppose the outlets in the cabinet are also 220V. Can we run extension cords from 110V circuits to power the shelves temporarily? Steve Losen scl(a)virginia.edu phone: 434-924-0640 University of Virginia ITC Unix Support

5 6

Phantom LUN
by Theo Dijkstra 26 Apr '07

26 Apr '07

Hi there, I got a phantom lun showing up in my messages file when starting the iSCSI service: -------- [root@blue snapdrive]# sanlun lun show no filer LUNs available -------- snap1> lun show snap1> version NetApp Release 7.2.1: Sun Dec 10 00:23:08 PST 2006 -------- iscsi service start: Apr 26 09:22:24 blue iscsi: iscsi config check succeeded Apr 26 09:22:24 blue kernel: iscsi-sfnet: Loading iscsi_sfnet version 4:0.1.11-3 Apr 26 09:22:24 blue kernel: iscsi-sfnet: Control device major number 254 Apr 26 09:22:24 blue iscsi: Loading iscsi driver: succeeded Apr 26 09:22:29 blue iscsid[4950]: version 4:0.1.11-3 variant (02-May-2006) Apr 26 09:22:29 blue iscsi: iscsid startup succeeded Apr 26 09:22:29 blue iscsid[4954]: Connected to Discovery Address 192.168.1.81 Apr 26 09:22:29 blue kernel: iscsi-sfnet:host4: Session established Apr 26 09:22:29 blue kernel: scsi4 : SFNet iSCSI driver Apr 26 09:22:29 blue kernel: scsi: unknown device type 31 Apr 26 09:22:29 blue kernel: Vendor: NETAPP Model: LUN Rev: 0.2 Apr 26 09:22:29 blue kernel: Type: Unknown ANSI SCSI revision: 04 Apr 26 09:24:59 blue ntpd[3373]: kernel time sync enabled 0001 --- Where does it get it from? This happened after a crash of the linux box while I was testing some multipathing. This in hindering other operations like mounting new luns etc. -Theo

2 3

network troubleshooting
by Pazder, Steve B 25 Apr '07

25 Apr '07

Hello World! Our Network admin has been working with Cisco to troubleshoot some issues (limited to 1 switch on 1 particular floor). While our Filers are not involved in this issue, fingers are generally pointed in that direction just because they exist....on the network. Our network admin is looking for information from the Filers that would be akin to a TCP dump. Ifstat, netstat and statit output are not providing the information being looked for (handshake info, etc). I haven't run across this particular issue before and don't recall ever seeing it presented to Toasters. Does anyone know of a way to get the actual communication dumps (again, a TCP dump) from a Filer? Thanks! Steve

9 10

NetApp ESX Host Utilities?
by John Sellens 24 Apr '07

24 Apr '07

There was a recent mention of "NetApp ESX Host Utilities" on the list, and (apparently) a config_mpath command included therein. I've looked on the net and on now.netapp.com and I'm having no luck in locating these tools. If someone could provide a pointer, I would be much obliged. Thanks! John jsellens(a)generalconcepts.com

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters