toasters

toasters@lists.teaparty.net

3 participants
13514 discussions

Re: limit i/o for lun or volume
by Alon Zeltser 06 Dec '11

06 Dec '11

I run sysstat perfstat cmpg and other performance tools the problem here is not in the writes but in the reads while the user run his stuff I get 1500 iops most of them read which is kind of awsome for only 5 data disks and 2 parity disks so back to back cp is not the issue here But I will try to set the priority for this volume to low maybe it will help Any other ideas on how to limit io ? Fred Grieco <fredgrieco(a)yahoo.com> wrote: Have you run sysstat on the command line of the filer? (sysstat -x 1) Are you getting a lot of "b" deferred back to back type CPs? My understanding is that the filer starts rejecting new scsi requests when there are back-to-back deferred CPs (because there's no where to put them in memory locally). That's when you get resets and errors on the hosts. Flexshare will limit the IOs to that volume and will reduce the deferred CPs, which may prevent the resets and errors. The host itself may not like that though-- there may be a timeout or some other tuning in iscsi that will help with this. ________________________________ From: Alon Zeltser <alonz(a)emet.co.il> To: Fred Grieco <fredgrieco(a)yahoo.com>; "toasters(a)teaparty.net" <toasters(a)teaparty.net> Sent: Tuesday, December 6, 2011 9:43 AM Subject: Re: limit i/o for lun or volume Thank you for replay but as I wrote im aware of flexshare but I don't think it will help since this system is not impacting other systems and not compeating with other vms on resources Its only hurting itself it doing so much iops and getting such bad latency that after few minutes its doing lun reset and the vm freezes and the user procces exit abnormally I'm trying to limit the iops from this system so it wont load the Netapp so much and get better latency I don't care if it will take much longer to run Thanks again Fred Grieco <fredgrieco(a)yahoo.com> wrote: Do you mean that there is a performance issue with that particular VM, or with other systems on the filer that are caused by I/O on that VM? You should be able to use flex share to set a lower priority for a "cache-hogging" and reduce its impact on the other volumes. On the command line, run "priority on." Then run "priority set volume $volumename level=Low" for the problem volume. This will give less priority to that volume in the write cache, free up the cache for other things, and (hopefully) reduce latency on those other volumes. In your case, you'll need to have that RDM in its own volume. ________________________________ From: Alon Zeltser <alonz(a)emet.co.il> To: toasters(a)teaparty.net Sent: Tuesday, December 6, 2011 6:00 AM Subject: limit i/o for lun or volume Hi all i have a situation of a virtual machine running on esx 4.0 over iscsi this machine (while the user is running his stuff) is using a lot of i/o on a very small netapp controller (2020) with only 5 data disks aggr and getting very bad latency and eventually getting a lun reset errors and the machine freeze for a few minutes i have increased the timeouts from the windows side but it doesn't seems to help this application don't need so much i/o and can be run a 5.4k disk on an old laptop but given the resources of netapp it uses them to the fullest it is important to mention that this application is running over MSSQL db and the i/o problem goes to rdm lun my question: is there a way to limit the i/o of this machine from either netapp side /vmware side / windows side / network side i'm aweare of vmware storage i/o control but this is only supported in vsphere 4.1 and an upgrade is not an options right now i'm also aware of flexshare from the netapp side but i don't think giving low priority to this volume will help in this case is there other way you can think of to limit the i/o goes from vmware virtual machine through iscsi to an rdm lun or his hosting volume? thank you _______________________________________________ Toasters mailing list Toasters(a)teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

1 0

Re: limit i/o for lun or volume
by Fred Grieco 06 Dec '11

06 Dec '11

Have you run sysstat on the command line of the filer? (sysstat -x 1) Are you getting a lot of "b" deferred back to back type CPs? My understanding is that the filer starts rejecting new scsi requests when there are back-to-back deferred CPs (because there's no where to put them in memory locally). That's when you get resets and errors on the hosts. Flexshare will limit the IOs to that volume and will reduce the deferred CPs, which may prevent the resets and errors. The host itself may not like that though-- there may be a timeout or some other tuning in iscsi that will help with this. ________________________________ From: Alon Zeltser <alonz(a)emet.co.il> To: Fred Grieco <fredgrieco(a)yahoo.com>; "toasters(a)teaparty.net" <toasters(a)teaparty.net> Sent: Tuesday, December 6, 2011 9:43 AM Subject: Re: limit i/o for lun or volume Thank you for replay but as I wrote im aware of flexshare but I don't think it will help since this system is not impacting other systems and not compeating with other vms on resources Its only hurting itself it doing so much iops and getting such bad latency that after few minutes its doing lun reset and the vm freezes and the user procces exit abnormally I'm trying to limit the iops from this system so it wont load the Netapp so much and get better latency I don't care if it will take much longer to run Thanks again Fred Grieco <fredgrieco(a)yahoo.com> wrote: Do you mean that there is a performance issue with that particular VM, or with other systems on the filer that are caused by I/O on that VM? You should be able to use flex share to set a lower priority for a "cache-hogging" and reduce its impact on the other volumes. On the command line, run "priority on." Then run "priority set volume $volumename level=Low" for the problem volume. This will give less priority to that volume in the write cache, free up the cache for other things, and (hopefully) reduce latency on those other volumes. In your case, you'll need to have that RDM in its own volume. ________________________________ From: Alon Zeltser <alonz(a)emet.co.il> To: toasters(a)teaparty.net Sent: Tuesday, December 6, 2011 6:00 AM Subject: limit i/o for lun or volume Hi all i have a situation of a virtual machine running on esx 4.0 over iscsi this machine (while the user is running his stuff) is using a lot of i/o on a very small netapp controller (2020) with only 5 data disks aggr and getting very bad latency and eventually getting a lun reset errors and the machine freeze for a few minutes i have increased the timeouts from the windows side but it doesn't seems to help this application don't need so much i/o and can be run a 5.4k disk on an old laptop but given the resources of netapp it uses them to the fullest it is important to mention that this application is running over MSSQL db and the i/o problem goes to rdm lun my question: is there a way to limit the i/o of this machine from either netapp side /vmware side / windows side / network side i'm aweare of vmware storage i/o control but this is only supported in vsphere 4.1 and an upgrade is not an options right now i'm also aware of flexshare from the netapp side but i don't think giving low priority to this volume will help in this case is there other way you can think of to limit the i/o goes from vmware virtual machine through iscsi to an rdm lun or his hosting volume? thank you _______________________________________________ Toasters mailing list Toasters(a)teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

1 0

Re: limit i/o for lun or volume
by Alon Zeltser 06 Dec '11

06 Dec '11

Thank you for replay but as I wrote im aware of flexshare but I don't think it will help since this system is not impacting other systems and not compeating with other vms on resources Its only hurting itself it doing so much iops and getting such bad latency that after few minutes its doing lun reset and the vm freezes and the user procces exit abnormally I'm trying to limit the iops from this system so it wont load the Netapp so much and get better latency I don't care if it will take much longer to run Thanks again Fred Grieco <fredgrieco(a)yahoo.com> wrote: Do you mean that there is a performance issue with that particular VM, or with other systems on the filer that are caused by I/O on that VM? You should be able to use flex share to set a lower priority for a "cache-hogging" and reduce its impact on the other volumes. On the command line, run "priority on." Then run "priority set volume $volumename level=Low" for the problem volume. This will give less priority to that volume in the write cache, free up the cache for other things, and (hopefully) reduce latency on those other volumes. In your case, you'll need to have that RDM in its own volume. ________________________________ From: Alon Zeltser <alonz(a)emet.co.il> To: toasters(a)teaparty.net Sent: Tuesday, December 6, 2011 6:00 AM Subject: limit i/o for lun or volume Hi all i have a situation of a virtual machine running on esx 4.0 over iscsi this machine (while the user is running his stuff) is using a lot of i/o on a very small netapp controller (2020) with only 5 data disks aggr and getting very bad latency and eventually getting a lun reset errors and the machine freeze for a few minutes i have increased the timeouts from the windows side but it doesn't seems to help this application don't need so much i/o and can be run a 5.4k disk on an old laptop but given the resources of netapp it uses them to the fullest it is important to mention that this application is running over MSSQL db and the i/o problem goes to rdm lun my question: is there a way to limit the i/o of this machine from either netapp side /vmware side / windows side / network side i'm aweare of vmware storage i/o control but this is only supported in vsphere 4.1 and an upgrade is not an options right now i'm also aware of flexshare from the netapp side but i don't think giving low priority to this volume will help in this case is there other way you can think of to limit the i/o goes from vmware virtual machine through iscsi to an rdm lun or his hosting volume? thank you _______________________________________________ Toasters mailing list Toasters(a)teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

1 0

limit i/o for lun or volume
by Alon Zeltser 06 Dec '11

06 Dec '11

Hi all i have a situation of a virtual machine running on esx 4.0 over iscsi this machine (while the user is running his stuff) is using a lot of i/o on a very small netapp controller (2020) with only 5 data disks aggr and getting very bad latency and eventually getting a lun reset errors and the machine freeze for a few minutes i have increased the timeouts from the windows side but it doesn't seems to help this application don't need so much i/o and can be run a 5.4k disk on an old laptop but given the resources of netapp it uses them to the fullest it is important to mention that this application is running over MSSQL db and the i/o problem goes to rdm lun my question: is there a way to limit the i/o of this machine from either netapp side /vmware side / windows side / network side i'm aweare of vmware storage i/o control but this is only supported in vsphere 4.1 and an upgrade is not an options right now i'm also aware of flexshare from the netapp side but i don't think giving low priority to this volume will help in this case is there other way you can think of to limit the i/o goes from vmware virtual machine through iscsi to an rdm lun or his hosting volume? thank you

3 3

3170 NFS weirdness
by Randy Rue 01 Dec '11

01 Dec '11

Hello All, We run a VMWare farm that mounts its datastores via NFS on two different NetApp clusters, one a 3020 HA pair running 7.2.4 and the other a 3170 running 7.3.5P5. We also mount those datastore exports to two linux (CentOS 5.x) hosts, which have the CommVault/Simpana backup agents installed. We effectively back up a snapshot of those datastores. We've been testing restores of files back to the datastores on the 3170 and they've been failing. We get a linux Error 13, basically "permission denied," in spite of the fact that the exports are configured for root access to both the ESX hosts and the backup hosts. We've confirmed that the backup hosts are mounting as root. This works on the 3020 pair. Can't spot any meaningful differences in "options NFS" between the two NetApp systems, or in any other setting. Thought it might be a posix permissions issue as a CV restore runs under the local linux group "simpana." The files are written with ownership of root:simpana and then permissions are changed when the data is all there. But if we try to rsync any test data to the 3170 datastores we get the same error, even if we're logged in as root and copying from a local directory on the backup host. Weirder, we CAN write to the datastore folder using cp, rm, mkdir, rmdir, but NOT using rsync. Help?

4 3

8.1 32->64bit volume convert
by Fletcher Cocquyt 30 Nov '11

30 Nov '11

Hi, We're testing out Ontap 8.1RC2 Can someone point out/describe the procedure for converting volumes from 32bit to 64bit? thanks Fletcher

11 23

moving vol0 from one aggregate to another with zero downtime using failover?
by Cotton, Randall 28 Nov '11

28 Nov '11

On an N3400 active/active w/DOT 7.3.5.1P1: I need to move vol0 from aggr0 to aggr1 on node A (so I can nuke its aggr0). I've done this kind of thing on a single independent node - it's fairly well-documented in the "Storage Management Guide". Basically: 1. Create a newvol0 on the destination aggregate of adequate size 2. ndmpcopy /vol/vol0/etc over to newvol0 3. vol options newvol0 root 4. reboot But in this situation, there's stuff on aggr1 I'd like to keep serving during this transition. I'd like it very much if I could use failover to do that. Is it possible to pull this off with a takeover/giveback? It seems it might be problematic what with the takeover node presumably using /vol/vol0 as the root vol and the other node booting up using /vol/newvol0 as the root vol. Would the giveback work OK? It seems there's room here to really hose things up. Any advice? Anyone seen documentation on such a procedure? R

5 4

tracking pBLKs
by Jon Hill 28 Nov '11

28 Nov '11

Is there any way to monitor and alert on pblock utilization via DFM or another monitoring tool? We had an issue recently where CIFS operations ground to a halt that was not resolved until we disabled fpolicy. We believe the entire pblock pool wound up in use and CIFS operations ground to a halt. We're considering running something like this to ensure that CIFS never runs out of pBLKs in the future: setflag fp_maxcifsreqs_pblkpercent X But we want to determine what the current range is before we make any changes. Cifs stat shows the value under Max pBLKs = xxx, but XXX is a number without context, like 1700, and doesn't help much. This e-mail, including any attachment(s), is intended solely for use by the named addressee(s). If you are not the intended recipient, you are not authorized to disclose, copy, distribute or retain this message, without written authorization from Jennison Associates LLC ("Jennison"). This e-mail may contain proprietary, confidential or privileged information. If you have received this message in error, please notify the sender immediately. If you have requested Jennison to e-mail any account information to you or your designee, you are deemed to have consented to electronic delivery of information from Jennison. E-mail messages are not secure and may contain computer viruses or other defects, may not be accurately replicated on other systems, or may be intercepted, deleted or interfered with without the knowledge of the sender or the intended recipient.

2 1

Cifs user name mapping.
by Jeff Cleverley 22 Nov '11

22 Nov '11

Greetings, We have a cifs share that gets worked on by various people in the company in different countries and business groups. We have access opened up to users with a valid Windows 2003 Server domain authentication. Since we don't know everyone who will have access to this, we don't have unix accounts for them, or entries in the usermap.cfg file. This share is also nfs accessed and has unix security style. The problem is when we look in the messages files these users seem to show up with their workstation name followed by the $ sign. It's difficult to track who owns the machine and who logged into it. Here is an trimmed example entry: auth.trace.authenticateUser.loginAccepted:info]: AUTH: Login by dwc46q1$ from xx.xx.xx.xx accepted. I'd like a better way to figure out who logged in from dwc46q1$ . The cifs.trace_login is on. Thanks, Jeff -- Jeff Cleverley Unix Systems Administrator 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611

2 2

shelf id mismatch
by Chaim Rieger 19 Nov '11

19 Nov '11

I have a shelf that displays ID 4 however when i do show disk they come up as belonging to ID 0. This probably happened because the ID was changed, then powered off, then connected to the loop, then powered on. Just a guess... I am not comfortable with removing a full shelf from a loop (even though all these disks are marked as spares currently) Therefore my question is, if i remove one disk at a time, and reseat it. will it come up as ID 4, or ID 0 ?

3 6

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters