toasters August 2008

toasters@lists.teaparty.net

54 participants
34 discussions

Netapp and VMware... It's all so confusing!
by Timothy Hollingworth 01 Apr '10

01 Apr '10

So, say for example, I want to virtualize an Exchange server. Lets also say that I want to manage it via Snapdrive and SME. Lets also say, just for the heck of it, that I want both the new front-engined Acura NSX as well as the Porsche RC3. The cars aside, I would have to run iSCSI from within the VM, install and use Snapdrive from within the VM to provision LUNs, install Exchange and then use SME? It seems kind of silly to use iSCSI from within a VM if the ESX box were fiber attached to the Filer, just to be able to use Snapdrive and SME, no? I would love to be able to use the features of SD and SME within a completely virtual environment and am wondering what some real world implementations other VMware/Netapp customers are running. Do you run storage for the databases and logs in VMDK's and manage snapshots and backups from a VMware virtual machine perspective or do you manage them as iSCSI LUNs and use SD and SME? Or am I completely blind and missing something? Timothy L. Hollingworth Sr. Network Engineer, ePlus Technology Inc. 678.462.6698 (cell) AIM: HollingworthTim YIM: t_holling

11 15

issues with 10G Ethernet.
by James Beal 29 Sep '08

29 Sep '08

I have a call open with netapp about this however I thought I would ask the list if anyone else has had similar issues. We have a cluster which is connected to our core via TOE-10G Ethernet (T320E-XFP). The problem we see is that the sometimes the netapp appears stop receiving any packets. I haven't done a packet trace while the problem is in effect as I have been a bit of a Muppet when I have noticed the problem as I had forgotten the rlm user name but I have made notes so next time it happens I will do a trace.. This has happened on both units in our cluster. We have replaced one of the 10gig cards and that has made no difference. Our networking people show no errors on the line cards. Power cycling the units brings the network card back. We have turned toe off on the cards and that appears not to make any difference to the reliability of the system. This has so far occurred 3 times which is really very poor. sysconfig -v 4 slot 4: Dual TOE-10G Ethernet Controller (T320E-XFP) Device Type: CT-31-1 Version Number: T3-SRAM1.1.0-BR1040-20-C0-FW4.6.0-DR03 Serial Number: PT3807035 e4a MAC Address: 00:07:43:05:13:ac (auto-10g_sr-fd-up) e4b MAC Address: 00:07:43:05:13:ad (auto-10g_sr-fd-cfg_down) ifconfig e4a e4a: flags=948043<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500 inet 172.17.66.26 netmask 0xffffff00 broadcast 172.17.66.255 partner inet 172.17.66.27 (not in use) ether 00:07:43:05:13:ac (auto-10g_sr-fd-up) flowcontrol full

4 7

Monitor volume space via Nagios?
by Page, Jeremy 25 Sep '08

25 Sep '08

Is anyone doing this? I'm trying to figure out how to get notified if one of my volumes gets below a certain % of free space. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

9 9

Linkedin group
by Nicholas Bernstein 05 Sep '08

05 Sep '08

Hi all, I didn't happen to see a toasters group on linkedin (the professional networking site) so I made one. Thought it might be of interest to some folks on the list. http://www.linkedin.com/groups?gid=751357 If this is objectionable to the group, I will, of course, remove it. Linkedin, oddly, requires manual approval, so if you don't get approved right away, it's just because I haven't gotten to it... I'll approve all comers, unless list admin's care to take over the management of the linked in group, in which case, I'll happily hand it over to someone else. Cheers, Nick -- Nicholas Bernstein Technologist, Consultant, Instructor http://nicholasbernstein.com

3 2

Re: Oddball SnapMirror issue - Fixed
by Raj Patel 31 Aug '08

31 Aug '08

Old issue I know, but in case anyone else was interested - * Upgrading from 7.06 to 7.2.5.1 fixed it. So I'm unsure if there was a bug in 7.06 SnapMirror or if 7.2.5.1 just has a more robust SnapMirror but upgrading destination and source certainly fixed it. Cheers, Raj. On Sat, May 3, 2008 at 8:59 PM, Raj Patel <phigmov(a)gmail.com> wrote: > We've got two FAS 270's in different cities. They're connected by a > 10mb pipe with routers (running ipsec) & firewalls (checkpoint splat) > seperating each datacenter. > > The primary san is fine and runs all our prod volumes (7.0.5) which > are mirrored to our secondary san (7.0.6). > > Recently I had to recreate the mirror relationship for some volumes as > they'd fallen far out of sync due to some firewall work. > > What I am seeing is one volume is syncing fine, one has a small lag > and two are stuck with a status of 'Pending with restart checkpoint' > after I re-initialised the transfer. > > snapmirror status -l shows this for one of the two that just don't get > properly initialised > > Source: 10.1.45.7:sqlprod01 > Destination: adcsan1:sqlprod01_mirror > Status: Pending with restart checkpoint > Progress: 38376 KB > State: Unknown > Lag: - > Mirror Timestamp: - > Base Snapshot: - > Current Transfer Type: Retry > Current Transfer Error: volume is not online; cannot execute operation > Contents: - > Last Transfer Type: - > Last Transfer Size: - > Last Transfer Duration: - > Last Transfer From: - > > Our firewalls rules have been relaxed to allow free-flow between these > devices (instead of just the SnapMirror ports) and the routers and > circuit haven't changed at all between it working fine and not working > now. The volume that is mirroring OK seems fine and still syncs fine - > granted the updates are small whereas the three non-working volumes > have to sync quite a lot of data. > > I've tried deleting the mirrored volumes, recreating them, setting up > the mirror relationship again (with a variety of scheduling and > bandwidth throttling options) and doing a destination SAN reboot. > > What are the best options to troubleshoot this or insuring a > successful mirror ? Has anyone had issues with dropped or stalled > SnapMirror baseline transfers via an IPSec tunnel or Firewall ? > > Thanks in advance, > Raj. > > PS As an addendum it looks like it starts a transfer, stalls and from > then on subsequent mirrors fail because its not online (ie the > initialisation fails ?) > > What I don't understand is why it just can't carry on with the > initialisation regardless of the interruption by resuming the mirror > operation ? >

1 0

RE: issues with 10G Ethernet.
by Page, Jeremy 28 Aug '08

28 Aug '08

Hi. Wow you're down the street. I have about 250 VMs on 5 servers (IBM x3850m2 with 4 quadcore processors and 64 gig of RAM. We are using Etherchannel to bind two gigE connections to a pair of stacked Cisco 3750 G switches. Then the switches are connected via a 10gig Etherchannel connection to each filer head. So about 50 VMs per server or 25 per gig port. Here's the results from esxtop's network information. It's got 8:26:08am up 97 days 19:20, 297 worlds; CPU load average: 0.29, 0.31, 0.37 PORT ID UPLINK USED BY DTYP DNAME PKTTX/s MbTX/s PKTRX/s MbRX/s %DRPTX %DRPRX 83886083 Y vmnic6 H vSwitch1 156.40 4.55 0.57 0.00 0.00 0.00 83886085 N 0:vmk-tcpip-172.1.2. H vSwitch1 156.40 4.55 117.49 0.40 0.00 0.00 50331651 Y vmnic5 H vSwitch3 819.40 0.78 854.49 1.45 0.00 0.00 50331746 N 1438:gsovmfmspoll05 H vSwitch3 596.24 0.58 606.16 1.14 0.00 0.00 50331649 Y vmnic1 H vSwitch3 302.31 0.37 388.53 0.29 0.00 0.00 50331690 N 1271:GSOVMFMSPOLL02 H vSwitch3 179.10 0.15 196.46 0.16 0.00 0.00 50331679 N 1249:GSOVMFMSPOLL01 H vSwitch3 129.51 0.14 166.70 0.11 0.00 0.00 50332486 N 1385:gsovmwebsense01 H vSwitch3 120.35 0.13 115.59 0.12 0.00 0.00 50331691 N 1276:GSOVMFMSPOLL03 H vSwitch3 44.06 0.04 57.03 0.05 0.00 0.00 50332424 N 1573:pcresource H vSwitch3 8.77 0.04 11.83 0.01 0.00 0.00 50331747 N 1446:GSOVMFMSPOLL04 H vSwitch3 21.55 0.03 25.56 0.04 0.00 0.00 50332308 N 1470:gsovmdproc1 H vSwitch3 21.17 0.02 24.22 0.09 0.00 0.00 16777217 Y vmnic0 H vSwitch0 10.68 0.02 59.32 0.05 0.00 0.00 16777220 N 0:vswif0 H vSwitch0 10.68 0.02 8.77 0.03 0.00 0.00 50332389 N 1295:gsovmgpprod01 H vSwitch3 3.62 0.01 6.48 0.03 0.00 0.00 33554433 Y vmnic2 H vSwitch2 7.25 0.00 13.73 0.01 0.00 0.00 50331738 N 1414:gsovmdhrdc01 H vSwitch3 2.29 0.00 6.10 0.03 0.00 0.00 33554487 N 1216:gsovmdns01 H vSwitch2 2.48 0.00 8.58 0.00 0.00 0.00 50332382 N 1687:gsovmsoftpdc H vSwitch3 1.53 0.00 2.29 0.00 0.00 0.00 50332455 N 1702:gsovmsmcctst H vSwitch3 2.67 0.00 6.29 0.02 0.00 0.00 50332301 N 1390:gsovmhyp01 H vSwitch3 0.95 0.00 4.20 0.02 0.00 0.00 33554489 N 1290:GSOVM-IK-DMZXP H vSwitch2 0.95 0.00 7.25 0.00 0.00 0.00 33554485 N 1694:gsovmwwwstg H vSwitch2 0.76 0.00 7.06 0.00 0.00 0.00 -----Original Message----- From: clane(a)co.durham.nc.us [mailto:clane@co.durham.nc.us] Sent: Wednesday, August 27, 2008 3:30 PM To: Page, Jeremy; toasters(a)mathworks.com Subject: RE: issues with 10G Ethernet. What sort of ratio are you getting with VM on NFS on those 10gbE cards? (i.e. vm sessions per port and/or esx hosts per port) -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Page, Jeremy Sent: Wednesday, August 27, 2008 9:26 AM To: toasters(a)mathworks.com Subject: RE: issues with 10G Ethernet. We are doing the same for our NFS mounted VMs (a couple of hundred) with no real issues. It would be nice of the TOE functionality worked with VIFs though. 7.2.4 here. Are the bugs significant enough to warrant an upgrade if we've been stable for months? -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Glenn Walker Sent: Wednesday, August 27, 2008 8:48 AM To: James Beal; toasters(a)mathworks.com Subject: RE: issues with 10G Ethernet. We're using the dual-port 10GbE TOE cards with no issues - that said, TOE is not enabled because we're using VIF (Filer turns TOE off with VIF - not desired by us, but no choice right now as we cannot have SPOF). Perhaps disabling TOE would get you more reliability? -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of James Beal Sent: Tuesday, August 26, 2008 8:02 AM To: toasters(a)mathworks.com Subject: issues with 10G Ethernet. I have a call open with netapp about this however I thought I would ask the list if anyone else has had similar issues. We have a cluster which is connected to our core via TOE-10G Ethernet (T320E-XFP). The problem we see is that the sometimes the netapp appears stop receiving any packets. I haven't done a packet trace while the problem is in effect as I have been a bit of a Muppet when I have noticed the problem as I had forgotten the rlm user name but I have made notes so next time it happens I will do a trace.. This has happened on both units in our cluster. We have replaced one of the 10gig cards and that has made no difference. Our networking people show no errors on the line cards. Power cycling the units brings the network card back. We have turned toe off on the cards and that appears not to make any difference to the reliability of the system. This has so far occurred 3 times which is really very poor. sysconfig -v 4 slot 4: Dual TOE-10G Ethernet Controller (T320E-XFP) Device Type: CT-31-1 Version Number: T3-SRAM1.1.0-BR1040-20-C0-FW4.6.0-DR03 Serial Number: PT3807035 e4a MAC Address: 00:07:43:05:13:ac (auto-10g_sr-fd-up) e4b MAC Address: 00:07:43:05:13:ad (auto-10g_sr-fd-cfg_down) ifconfig e4a e4a: flags=948043<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500 inet 172.17.66.26 netmask 0xffffff00 broadcast 172.17.66.255 partner inet 172.17.66.27 (not in use) ether 00:07:43:05:13:ac (auto-10g_sr-fd-up) flowcontrol full This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

1 0

RE: issues with 10G Ethernet.
by Glenn Walker 28 Aug '08

28 Aug '08

Negotiated failover is something I'd rather not invoke: we have a network team here that I'm not a part of and my experience with EVERY network admin has been "the problem is not the network, it must be you" even with all the proof in the world of the network issue - including telling them how to fix their own problems. It's not quite that bad here, but we've had issues where ports have dropped unexpectedly and I really don't want a cluster failover to have to deal with as part of the overall issue. That said, it's a great option, but it doesn't work for my environment due to the split nature of the teams (and even if it wasn't I'd still be hesitant). -----Original Message----- From: Kevin Graham [mailto:kgraham@industrial-marshmallow.com] Sent: Wednesday, August 27, 2008 3:29 PM To: Glenn Walker; James Beal; toasters(a)mathworks.com Subject: Re: issues with 10G Ethernet. > We're using the dual-port 10GbE TOE cards with no issues - that said, > TOE is not enabled because we're using VIF (Filer turns TOE off with VIF > - not desired by us, but no choice right now as we cannot have SPOF). We've addressed this instead by using negotiated failover, both for 10GbE's and to convert failover 2x1gb's to single 4x1gb's; losing the switch the filer's uplinked to is rare enough of an event that (IMHO) a failover is acceptable. > Perhaps disabling TOE would get you more reliability? I'm still waiting for jumbos on the TOE to be stable...

1 0

Snapvault -- destination was 100%
by Willeke, Jochen 26 Aug '08

26 Aug '08

Hi toasters, we have seen several times where a snapvault destination gets filled up to 100% while an update on the sv-relation was running. Afterwards we see the snapvault relation in a quiescing mode. Doing some slow transfer: source:/vol/exvs13_db/mb1_3_sg1 destination:/vol/pdbnab5_v002/mb2_3_sg1 Snapvaulted 82:41:00 Quiescing (27 GB done) In the logs i see this: snapvault: vol=pdbnab5_v002 snapshot= op=2, giving up on update of /vol/pdbnab5_v002/mb2_3_sg1: could not read from socket When i abort the snapvault relation i see this: nstore1> snapvault abort nstore1:/vol/pdbnab5_v002/mb2_3_sg1 nstore1> Tue Aug 26 09:31:50 CEST [worker_thread_729:notice]: snapmirror: Network communication error And snapvault status shows the qtree in normal quiescing again, but it starts soon again to do a transfer. Has anybody ever come across this and has a solution? Regards and thanks in advance Jochen -- WINCOR NIXDORF International GmbH Sitz der Gesellschaft: Paderborn Registergericht Paderborn HRB 3507 Gesch�ftsf�hrer: Eckard Heidloff (Vorsitzender), Stefan Auerbach, Dr. J�rgen Wunram Vorsitzender des Aufsichtsrats: Karl-Heinz Stiller Steuernummer: 339/5884/0020 - Ust-ID Nr.: DE812927716 - WEEE-Reg.-Nr. DE44477193 Diese E-Mail enth�lt vertrauliche Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrt�mlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese E-Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser E-Mail ist nicht gestattet. This e-mail may contain confidential information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorised copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

1 1

Adding drives to specific raid groups
by Page, Jeremy 25 Aug '08

25 Aug '08

I know this is possible but I cannot for the life of me find the document detailing how to add a drive to a raid group explicitly. I have 2 aggrs with 3 raid groups each and 8 spare drives. I'd like to add one drive to each raid group but cannot find the syntax, can anyone link the correct NOW URL? This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

4 3

Anyone using snapmanager for virtual infrastructure ?
by Raj Patel 25 Aug '08

25 Aug '08

Hi, Looks like its finally out - I haven't seen much list-traffic concerning its release http://www.netapp.com/us/products/management-software/snapmanager-virtual.h… Anyone using this yet ? Whats the feedback - good, bad, ambivalent ? Can anyone comment on improvements or experiences with the beta ? Cheers, Raj.

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters August 2008