toasters

toasters@lists.teaparty.net

3 participants
13514 discussions

RE: issues with 10G Ethernet.
by Page, Jeremy 28 Aug '08

28 Aug '08

Hi. Wow you're down the street. I have about 250 VMs on 5 servers (IBM x3850m2 with 4 quadcore processors and 64 gig of RAM. We are using Etherchannel to bind two gigE connections to a pair of stacked Cisco 3750 G switches. Then the switches are connected via a 10gig Etherchannel connection to each filer head. So about 50 VMs per server or 25 per gig port. Here's the results from esxtop's network information. It's got 8:26:08am up 97 days 19:20, 297 worlds; CPU load average: 0.29, 0.31, 0.37 PORT ID UPLINK USED BY DTYP DNAME PKTTX/s MbTX/s PKTRX/s MbRX/s %DRPTX %DRPRX 83886083 Y vmnic6 H vSwitch1 156.40 4.55 0.57 0.00 0.00 0.00 83886085 N 0:vmk-tcpip-172.1.2. H vSwitch1 156.40 4.55 117.49 0.40 0.00 0.00 50331651 Y vmnic5 H vSwitch3 819.40 0.78 854.49 1.45 0.00 0.00 50331746 N 1438:gsovmfmspoll05 H vSwitch3 596.24 0.58 606.16 1.14 0.00 0.00 50331649 Y vmnic1 H vSwitch3 302.31 0.37 388.53 0.29 0.00 0.00 50331690 N 1271:GSOVMFMSPOLL02 H vSwitch3 179.10 0.15 196.46 0.16 0.00 0.00 50331679 N 1249:GSOVMFMSPOLL01 H vSwitch3 129.51 0.14 166.70 0.11 0.00 0.00 50332486 N 1385:gsovmwebsense01 H vSwitch3 120.35 0.13 115.59 0.12 0.00 0.00 50331691 N 1276:GSOVMFMSPOLL03 H vSwitch3 44.06 0.04 57.03 0.05 0.00 0.00 50332424 N 1573:pcresource H vSwitch3 8.77 0.04 11.83 0.01 0.00 0.00 50331747 N 1446:GSOVMFMSPOLL04 H vSwitch3 21.55 0.03 25.56 0.04 0.00 0.00 50332308 N 1470:gsovmdproc1 H vSwitch3 21.17 0.02 24.22 0.09 0.00 0.00 16777217 Y vmnic0 H vSwitch0 10.68 0.02 59.32 0.05 0.00 0.00 16777220 N 0:vswif0 H vSwitch0 10.68 0.02 8.77 0.03 0.00 0.00 50332389 N 1295:gsovmgpprod01 H vSwitch3 3.62 0.01 6.48 0.03 0.00 0.00 33554433 Y vmnic2 H vSwitch2 7.25 0.00 13.73 0.01 0.00 0.00 50331738 N 1414:gsovmdhrdc01 H vSwitch3 2.29 0.00 6.10 0.03 0.00 0.00 33554487 N 1216:gsovmdns01 H vSwitch2 2.48 0.00 8.58 0.00 0.00 0.00 50332382 N 1687:gsovmsoftpdc H vSwitch3 1.53 0.00 2.29 0.00 0.00 0.00 50332455 N 1702:gsovmsmcctst H vSwitch3 2.67 0.00 6.29 0.02 0.00 0.00 50332301 N 1390:gsovmhyp01 H vSwitch3 0.95 0.00 4.20 0.02 0.00 0.00 33554489 N 1290:GSOVM-IK-DMZXP H vSwitch2 0.95 0.00 7.25 0.00 0.00 0.00 33554485 N 1694:gsovmwwwstg H vSwitch2 0.76 0.00 7.06 0.00 0.00 0.00 -----Original Message----- From: clane(a)co.durham.nc.us [mailto:clane@co.durham.nc.us] Sent: Wednesday, August 27, 2008 3:30 PM To: Page, Jeremy; toasters(a)mathworks.com Subject: RE: issues with 10G Ethernet. What sort of ratio are you getting with VM on NFS on those 10gbE cards? (i.e. vm sessions per port and/or esx hosts per port) -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Page, Jeremy Sent: Wednesday, August 27, 2008 9:26 AM To: toasters(a)mathworks.com Subject: RE: issues with 10G Ethernet. We are doing the same for our NFS mounted VMs (a couple of hundred) with no real issues. It would be nice of the TOE functionality worked with VIFs though. 7.2.4 here. Are the bugs significant enough to warrant an upgrade if we've been stable for months? -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Glenn Walker Sent: Wednesday, August 27, 2008 8:48 AM To: James Beal; toasters(a)mathworks.com Subject: RE: issues with 10G Ethernet. We're using the dual-port 10GbE TOE cards with no issues - that said, TOE is not enabled because we're using VIF (Filer turns TOE off with VIF - not desired by us, but no choice right now as we cannot have SPOF). Perhaps disabling TOE would get you more reliability? -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of James Beal Sent: Tuesday, August 26, 2008 8:02 AM To: toasters(a)mathworks.com Subject: issues with 10G Ethernet. I have a call open with netapp about this however I thought I would ask the list if anyone else has had similar issues. We have a cluster which is connected to our core via TOE-10G Ethernet (T320E-XFP). The problem we see is that the sometimes the netapp appears stop receiving any packets. I haven't done a packet trace while the problem is in effect as I have been a bit of a Muppet when I have noticed the problem as I had forgotten the rlm user name but I have made notes so next time it happens I will do a trace.. This has happened on both units in our cluster. We have replaced one of the 10gig cards and that has made no difference. Our networking people show no errors on the line cards. Power cycling the units brings the network card back. We have turned toe off on the cards and that appears not to make any difference to the reliability of the system. This has so far occurred 3 times which is really very poor. sysconfig -v 4 slot 4: Dual TOE-10G Ethernet Controller (T320E-XFP) Device Type: CT-31-1 Version Number: T3-SRAM1.1.0-BR1040-20-C0-FW4.6.0-DR03 Serial Number: PT3807035 e4a MAC Address: 00:07:43:05:13:ac (auto-10g_sr-fd-up) e4b MAC Address: 00:07:43:05:13:ad (auto-10g_sr-fd-cfg_down) ifconfig e4a e4a: flags=948043<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500 inet 172.17.66.26 netmask 0xffffff00 broadcast 172.17.66.255 partner inet 172.17.66.27 (not in use) ether 00:07:43:05:13:ac (auto-10g_sr-fd-up) flowcontrol full This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

1 0

RE: issues with 10G Ethernet.
by Glenn Walker 28 Aug '08

28 Aug '08

Negotiated failover is something I'd rather not invoke: we have a network team here that I'm not a part of and my experience with EVERY network admin has been "the problem is not the network, it must be you" even with all the proof in the world of the network issue - including telling them how to fix their own problems. It's not quite that bad here, but we've had issues where ports have dropped unexpectedly and I really don't want a cluster failover to have to deal with as part of the overall issue. That said, it's a great option, but it doesn't work for my environment due to the split nature of the teams (and even if it wasn't I'd still be hesitant). -----Original Message----- From: Kevin Graham [mailto:kgraham@industrial-marshmallow.com] Sent: Wednesday, August 27, 2008 3:29 PM To: Glenn Walker; James Beal; toasters(a)mathworks.com Subject: Re: issues with 10G Ethernet. > We're using the dual-port 10GbE TOE cards with no issues - that said, > TOE is not enabled because we're using VIF (Filer turns TOE off with VIF > - not desired by us, but no choice right now as we cannot have SPOF). We've addressed this instead by using negotiated failover, both for 10GbE's and to convert failover 2x1gb's to single 4x1gb's; losing the switch the filer's uplinked to is rare enough of an event that (IMHO) a failover is acceptable. > Perhaps disabling TOE would get you more reliability? I'm still waiting for jumbos on the TOE to be stable...

1 0

Snapvault -- destination was 100%
by Willeke, Jochen 26 Aug '08

26 Aug '08

Hi toasters, we have seen several times where a snapvault destination gets filled up to 100% while an update on the sv-relation was running. Afterwards we see the snapvault relation in a quiescing mode. Doing some slow transfer: source:/vol/exvs13_db/mb1_3_sg1 destination:/vol/pdbnab5_v002/mb2_3_sg1 Snapvaulted 82:41:00 Quiescing (27 GB done) In the logs i see this: snapvault: vol=pdbnab5_v002 snapshot= op=2, giving up on update of /vol/pdbnab5_v002/mb2_3_sg1: could not read from socket When i abort the snapvault relation i see this: nstore1> snapvault abort nstore1:/vol/pdbnab5_v002/mb2_3_sg1 nstore1> Tue Aug 26 09:31:50 CEST [worker_thread_729:notice]: snapmirror: Network communication error And snapvault status shows the qtree in normal quiescing again, but it starts soon again to do a transfer. Has anybody ever come across this and has a solution? Regards and thanks in advance Jochen -- WINCOR NIXDORF International GmbH Sitz der Gesellschaft: Paderborn Registergericht Paderborn HRB 3507 Gesch�ftsf�hrer: Eckard Heidloff (Vorsitzender), Stefan Auerbach, Dr. J�rgen Wunram Vorsitzender des Aufsichtsrats: Karl-Heinz Stiller Steuernummer: 339/5884/0020 - Ust-ID Nr.: DE812927716 - WEEE-Reg.-Nr. DE44477193 Diese E-Mail enth�lt vertrauliche Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrt�mlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese E-Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser E-Mail ist nicht gestattet. This e-mail may contain confidential information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorised copying, disclosure or distribution of the material in this e-mail is strictly forbidden.

1 1

Adding drives to specific raid groups
by Page, Jeremy 25 Aug '08

25 Aug '08

I know this is possible but I cannot for the life of me find the document detailing how to add a drive to a raid group explicitly. I have 2 aggrs with 3 raid groups each and 8 spare drives. I'd like to add one drive to each raid group but cannot find the syntax, can anyone link the correct NOW URL? This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

4 3

Anyone using snapmanager for virtual infrastructure ?
by Raj Patel 25 Aug '08

25 Aug '08

Hi, Looks like its finally out - I haven't seen much list-traffic concerning its release http://www.netapp.com/us/products/management-software/snapmanager-virtual.h… Anyone using this yet ? Whats the feedback - good, bad, ambivalent ? Can anyone comment on improvements or experiences with the beta ? Cheers, Raj.

2 1

Ndmpcopy v vol copy
by David McWilliams 20 Aug '08

20 Aug '08

We are adding a shelf of faster disks onto our existing FAS270C. We want to copy our Oracle database volume from the existing disk to the new shelf. We have considered usig either ndmpcopy or vol copy. Is there a performance Enhancement of one over the other, or is there a better method? Thanks, David -- Sent from Gmail for mobile | mobile.google.com Sláinte, David Give a man a fire and he's warm for the day. But set fire to him and he's warm for the rest of his life. - Terry Pratchett, Discworld

3 2

Fwd: Quota Management
by Jody Martin 20 Aug '08

20 Aug '08

Hi all, Is it possible to have quota soft limit warning mailed to the respective user or administrator from a filer when they are reached? If not, is there any tool available for doing this? The user only gets an error when he/she exceeds the hard limit. Any assistance would be greatly appreciated. Regards, Jody

4 3

NDMP speed measured in the field
by Van Eyken Michiel 20 Aug '08

20 Aug '08

All, Just curious if the people here in this distribution list who are using NDMP backups can give me their NetApp config (filer type & number of disks) and their actual backup throughput. If it's possible also the number and drive types connected and used backup software. Thanks in advance With kindest regards, [cid:image001.gif@01C902A4.ADD10AA0]<http://www.uptime.be> email-disclaimer<http://www.uptime.be/disclaimer.html> "Computers are like air conditioners - They stop working properly when you open Windows"

2 1

Hidden Secret Ninja Commands
by Darragh, Stephen J (US SSA) 19 Aug '08

19 Aug '08

Does any have a list of the hidden options and the hidden commands on teh 1-5 menu? Thank you Stephen Darragh

2 1

how to "move" an existing snapmirror to new network interfaces?
by Todd C. Merrill 18 Aug '08

18 Aug '08

I have lots of existing q-tree snapmirrrors of the form: srcfiler:/vol/volM/qtreeX destfiler:/vol/volN/qtreeY "srcfiler" (DNS name) is the e11 interface on srcfiler "destfiler" (DNS name) is the e9a interface on destfiler We just built a "dedicated snapmirror/backup" network and added the following: "srcfiler-backup" (DNS name) is the e0 inteface on srcfiler "destfiler-backup" (DNS name) is the e11a interface on destfiler Subsequent 'snapmirror update -S ...' commands (we don't use snapmirror.conf) still use the non "-backup" network links. I'm not seeing the counters on the "-backup" links increment via the `ifstat` command. The $64,000 question: --------------------- How do I "move" these snapmirrors to the "-backup" network links...without, of course, re-initializing them? I'm expecting, in the end, to see `snapmirror status` give back to me: srcfiler-backup:/vol/volM/qtreeX destfiler-backup:/vol/volN/qtreeY and see the counters on e0 on srcfiler and e11a on destfiler increment. Until next time... The MathWorks, Inc. 508-647-7000 x7792 3 Apple Hill Drive, Natick, MA 01760-2098 508-647-7001 FAX tmerrill(a)mathworks.com http://www.mathworks.com ---

5 7

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters