toasters September 2008

toasters@lists.teaparty.net

52 participants
35 discussions

Netapp and VMware... It's all so confusing!
by Timothy Hollingworth 01 Apr '10

01 Apr '10

So, say for example, I want to virtualize an Exchange server. Lets also say that I want to manage it via Snapdrive and SME. Lets also say, just for the heck of it, that I want both the new front-engined Acura NSX as well as the Porsche RC3. The cars aside, I would have to run iSCSI from within the VM, install and use Snapdrive from within the VM to provision LUNs, install Exchange and then use SME? It seems kind of silly to use iSCSI from within a VM if the ESX box were fiber attached to the Filer, just to be able to use Snapdrive and SME, no? I would love to be able to use the features of SD and SME within a completely virtual environment and am wondering what some real world implementations other VMware/Netapp customers are running. Do you run storage for the databases and logs in VMDK's and manage snapshots and backups from a VMware virtual machine perspective or do you manage them as iSCSI LUNs and use SD and SME? Or am I completely blind and missing something? Timothy L. Hollingworth Sr. Network Engineer, ePlus Technology Inc. 678.462.6698 (cell) AIM: HollingworthTim YIM: t_holling

11 15

do toaster need a day off? (WAFL scans)
by Todd C. Merrill 13 Dec '08

13 Dec '08

Two scenarios: 1. R200, 7.2.2, two 12 TB aggregates, 85 volumes of various sizes, 70-80% full snapvault secondary, ALWAYS receiving snapvaults and nearly ALWAYS spinning to tape. 2. 6070, 7.2.4, two 8 TB aggregates, 27 volumes between 150 and 700 GB, 60-70% full recent migration (via volume snapmirrors) from 980's, serves home directories to NFS and CIFS clients. We stopped all snapmirrors/snapvaults to the R200, terminated CIFS, and shut off NFS. CPU utilization remained 90%+ and disk reads remained high for the next 6-7-8 hours until it finally quieted down. After volume snapmirroring the home dirs from the 980's to the 6070, we re-pointed the snapvaults (modify; start -r) and allowed NFS and CIFS access. 5 days later, file server performance still blows (worse than the 980's -- D'oh! Egg, meet Face; Face, meet Egg), with moderate CPU load 30-40-50% but high disk reads. In both cases, we determined that lots of WAFL scans were going on: container block reclamation volume deswizzling active bitmap rearrangement (of course...this NEVER seems to stop) and a few other types that have already scrolled out of my buffer. So, we figure--eventually--the WAFL scans will catch up and performance will go back to normal on the 6070. The performance of the R200 always blows. So...here finally is the question: do toasters need a day off? Said another way, to maintain acceptable performance and low/fast response times, do toasters need a goodly amount of (relatively) idle time in order for these WAFL scans to complete? Could the sub-optimal performance of another group of six 6070's that we have, that we *pound on* 7x24, be explained in part by always having at least the container block reclamation scan going on? Until next time... The MathWorks, Inc. 508-647-7000 x7792 3 Apple Hill Drive, Natick, MA 01760-2098 508-647-7001 FAX tmerrill(a)mathworks.com http://www.mathworks.com ---

5 7

RE: issues with 10G Ethernet.
by Learmonth, Peter 30 Sep '08

30 Sep '08

Sure thing, Jeremy. I talked to NetApp engineering (the networking group). I was doing my homework prepping for my VMWorld breakout session,ran across that note and said "That can't be right"...so I checked with engineering. They said the docs wil be fixed. Share and enjoy! Peter -----Original Message----- From: Page, Jeremy <jeremy.page(a)gilbarco.com> Sent: Tuesday, September 30, 2008 9:27 AM To: Timothy Hollingworth <thollingsworth(a)EPLUS.com>; toasters(a)mathworks.com <toasters(a)mathworks.com> Subject: RE: issues with 10G Ethernet. I'd expect lower latency doing the TCP stuff with the cards ASIC then having to wait for a general purpose processor to take care of it. I am using Etherchannel (instead of LACP), I was also under the impression that LACP is not supported with 10gE VIFs, Peter can you tell us where you heard otherwise? Jeremy M. Page____________________ Systems Architect * email:Jeremy.Page@gilbarco.com - * phone: 336.547.5399 - 6 fax: 336.547.5163 - * cell: 336.601.7274 ________________________________ From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Timothy Hollingworth Sent: Monday, September 29, 2008 6:22 PM To: toasters(a)mathworks.com Subject: RE: issues with 10G Ethernet. Page 121 of the Network Management Guide for DataONTAP 7.3 states... The 10GbE TOE NIC cards have a number of limitations when used with vifs. They include: * Multimode vif limited to two (2) 10GbE TOE NICs * LACP not supported with 10GbE TOE NICs * TOE functionality disabled on 10GbE NIC in vif In a multimode vif, DataONTAP controls only outbound packets. The link used for inbound packets is decided upon by the device at the other end of the vif. I'm not an expert in this area but assume that TOE won't work because each TOE card wouldn't know what packets the other has processed in terms of inbound traffic. If the processor on the filer is not being maxed out, wouldn't it make sense to turn off TOE anyway and just let the filer do the processing? -Tim Hollingworth- -ePlus Technology Inc.- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of James Beal Sent: Monday, September 29, 2008 12:16 PM To: Ed Wilts Cc: Page, Jeremy; toasters(a)mathworks.com Subject: Re: issues with 10G Ethernet. On 29 Sep 2008, at 16:36, Ed Wilts wrote: >From what I've heard, you can use TOE but only in an active/passive configuration. So if you have 2 10GigE ports on your card with each going to a separate switch, as long as you only use 1 active path at a time, you'll be fine. You'll have full failover and TOE, but you won't have 20GigE of bandwidth available. On Mon, Sep 29, 2008 at 9:34 AM, Page, Jeremy <jeremy.page(a)gilbarco.com> wrote: What an unfortunate fix :( I'd very much like to use TOE on my 10gig VIF, does anyone know if this is ever going to be supported, or is there an architectual reason why it won't work? Just for clarification if I have TOE turned on with 10G ethernet my units stop serving data with no cluster failover occurring. At least with 7.2.5.1 with TOE turned off the units appear to be stable previously they where unstable whether TOE was active or not. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

1 0

Re: issues with 10G Ethernet.
by James Beal 30 Sep '08

30 Sep '08

On 29 Sep 2008, at 16:36, Ed Wilts wrote: > From what I've heard, you can use TOE but only in an active/passive > configuration. So if you have 2 10GigE ports on your card with each > going to a separate switch, as long as you only use 1 active path at > a time, you'll be fine. You'll have full failover and TOE, but you > won't have 20GigE of bandwidth available. > > On Mon, Sep 29, 2008 at 9:34 AM, Page, Jeremy <jeremy.page(a)gilbarco.com > > wrote: > What an unfortunate fix :( > > I'd very much like to use TOE on my 10gig VIF, does anyone know if > this > is ever going to be supported, or is there an architectual reason > why it > won't work? > Just for clarification if I have TOE turned on with 10G ethernet my units stop serving data with no cluster failover occurring. At least with 7.2.5.1 with TOE turned off the units appear to be stable previously they where unstable whether TOE was active or not.

3 2

RE: issues with 10G Ethernet.
by Learmonth, Peter 30 Sep '08

30 Sep '08

Hi I had previously checked on this and the second bullet is incorrect. LACP _is_ supported with 10GbE TOE cards. Share and enjoy! Peter -----Original Message----- From: Timothy Hollingworth <thollingsworth(a)EPLUS.com> Sent: Monday, September 29, 2008 3:44 PM To: toasters(a)mathworks.com <toasters(a)mathworks.com> Subject: RE: issues with 10G Ethernet. Page 121 of the Network Management Guide for DataONTAP 7.3 states... The 10GbE TOE NIC cards have a number of limitations when used with vifs. They include: * Multimode vif limited to two (2) 10GbE TOE NICs * LACP not supported with 10GbE TOE NICs * TOE functionality disabled on 10GbE NIC in vif In a multimode vif, DataONTAP controls only outbound packets. The link used for inbound packets is decided upon by the device at the other end of the vif. I'm not an expert in this area but assume that TOE won't work because each TOE card wouldn't know what packets the other has processed in terms of inbound traffic. If the processor on the filer is not being maxed out, wouldn't it make sense to turn off TOE anyway and just let the filer do the processing? -Tim Hollingworth- -ePlus Technology Inc.- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of James Beal Sent: Monday, September 29, 2008 12:16 PM To: Ed Wilts Cc: Page, Jeremy; toasters(a)mathworks.com Subject: Re: issues with 10G Ethernet. On 29 Sep 2008, at 16:36, Ed Wilts wrote: >From what I've heard, you can use TOE but only in an active/passive configuration. So if you have 2 10GigE ports on your card with each going to a separate switch, as long as you only use 1 active path at a time, you'll be fine. You'll have full failover and TOE, but you won't have 20GigE of bandwidth available. On Mon, Sep 29, 2008 at 9:34 AM, Page, Jeremy <jeremy.page(a)gilbarco.com<mailto:jeremy.page@gilbarco.com>> wrote: What an unfortunate fix :( I'd very much like to use TOE on my 10gig VIF, does anyone know if this is ever going to be supported, or is there an architectual reason why it won't work? Just for clarification if I have TOE turned on with 10G ethernet my units stop serving data with no cluster failover occurring. At least with 7.2.5.1 with TOE turned off the units appear to be stable previously they where unstable whether TOE was active or not.

1 0

DECRU Encryption Devices
by Zeeshan 30 Sep '08

30 Sep '08

Hi all... i dont know whether its the right forum to ask...but has anyone worked with DECRU FC-series integration with FAS6040... I have configured two FC-520 as a cluster...and added FAS6040 LUNs to the cluster storage... but when i try to present cryptainers to Solaris10 hosts...the host is unable to format the cryptainers (LUNs)...after partioning once i try to label the disk...it says...'CURRENT DISK IS UNNFORMATTED'.... Non-cryptainer LUNs on the same host work perfect.... Any ideas...suggessions...solutions...documentation reference???? thanx...

3 2

issues with 10G Ethernet.
by James Beal 29 Sep '08

29 Sep '08

I have a call open with netapp about this however I thought I would ask the list if anyone else has had similar issues. We have a cluster which is connected to our core via TOE-10G Ethernet (T320E-XFP). The problem we see is that the sometimes the netapp appears stop receiving any packets. I haven't done a packet trace while the problem is in effect as I have been a bit of a Muppet when I have noticed the problem as I had forgotten the rlm user name but I have made notes so next time it happens I will do a trace.. This has happened on both units in our cluster. We have replaced one of the 10gig cards and that has made no difference. Our networking people show no errors on the line cards. Power cycling the units brings the network card back. We have turned toe off on the cards and that appears not to make any difference to the reliability of the system. This has so far occurred 3 times which is really very poor. sysconfig -v 4 slot 4: Dual TOE-10G Ethernet Controller (T320E-XFP) Device Type: CT-31-1 Version Number: T3-SRAM1.1.0-BR1040-20-C0-FW4.6.0-DR03 Serial Number: PT3807035 e4a MAC Address: 00:07:43:05:13:ac (auto-10g_sr-fd-up) e4b MAC Address: 00:07:43:05:13:ad (auto-10g_sr-fd-cfg_down) ifconfig e4a e4a: flags=948043<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500 inet 172.17.66.26 netmask 0xffffff00 broadcast 172.17.66.255 partner inet 172.17.66.27 (not in use) ether 00:07:43:05:13:ac (auto-10g_sr-fd-up) flowcontrol full

4 7

network is slooooow on new 2020 model (ceiving an excessive number of packets receiving an excessive number of packets or protocols not supported this system
by Linux Admin 26 Sep '08

26 Sep '08

Just unwrapped it and connected it 2020 to switch: telnet and http is very very slow following message from netdiag l2s-na01> netdiag Performing physical layer diagnostics..... The interface e0a seems to be receiving an excessive number of packets for protocols not supported this system. If this problem persists, please contact your network administrator. Press enter to continue The interface e0b seems to be receiving an excessive number of packets for protocols not supported this system. If this problem persists, please contact your network administrator. Press enter to continue Performing network layer diagnostics.....OK Performing transport layer diagnostics.....OK l2s-na01> netdiag

3 2

AIX Power/VIOS Flex clones
by Ken Williams 25 Sep '08

25 Sep '08

Anyone doing flex clones on IBM power5/6 PowerVM platform? I've created a clone of a LUN and presented it to the VIOS servers. The system doesn't see the new device. From my understanding its because they share the same PVID. My question is how can I use flexclone technology without taking down the LPAR to make a clone. __________________________________________________________ Ken Williams Storage Administrator, Business Technology Operations Sacramento Municipal Utility District E-Mail: kwillia(a)smud.org Phone: (916) 732-6744 Cell: (916) 240-4213

1 0

Monitor volume space via Nagios?
by Page, Jeremy 25 Sep '08

25 Sep '08

Is anyone doing this? I'm trying to figure out how to get notified if one of my volumes gets below a certain % of free space. This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

9 9

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters September 2008