toasters

toasters@lists.teaparty.net

1 participants
13532 discussions

high CP_reads/writes ratio
by Fred Grieco 13 Sep '13

13 Sep '13

What kinds of things can cause a high CP_reads/writes ratio? And what can I do about it? I have an Oracle system with ASM that doing writes in a 15 minute cycle, and it causes a lot of writes with CP reads. The oracle ASM luns are basically the only thing on the aggregate. Disk alignment is fine (which is the first thing I thought of). I've attached a screenshot of the Oncommand graph for one of the disks in this aggr-- not sure if that will come through. The filer is a 3220 with 8.1.2 7-mode. Fibre channel attach, and there are about 20 luns under two volumes. TIA, Fred

6 12

RE: high CP_reads/writes ratioA
by Jordan Slingerland 13 Sep '13

13 Sep '13

At 87% it is certainly possible that wafl doesn't have enough contagious free space to write a chain in a single pass...slowing things down substantially. Are your volumes thick provisioned? That could cloud the equation. --JMS From: Fred Grieco [mailto:fredgrieco@yahoo.com] Sent: Friday, September 13, 2013 3:16 PM To: Jordan Slingerland; Jeff Mohler Cc: Toasters(a)teaparty.net Subject: Re: high CP_reads/writes ratio The prod one is 87%. The replication one is 71% but it was much higher during disaster recovery testing. I'll run a reallocate measure on the DR side this weekend and see what comes back. ________________________________ From: Jordan Slingerland <Jordan.Slingerland(a)independenthealth.com<mailto:Jordan.Slingerland@independenthealth.com>> To: Jeff Mohler <speedtoys.racing(a)gmail.com<mailto:speedtoys.racing@gmail.com>>; Fred Grieco <fredgrieco(a)yahoo.com<mailto:fredgrieco@yahoo.com>> Cc: "Toasters(a)teaparty.net<mailto:Toasters@teaparty.net>" <Toasters(a)teaparty.net<mailto:Toasters@teaparty.net>> Sent: Friday, September 13, 2013 3:12 PM Subject: RE: high CP_reads/writes ratio Are your aggregates more then 65-85% full? From: toasters-bounces(a)teaparty.net<mailto:toasters-bounces@teaparty.net> [mailto:toasters-bounces@teaparty.net] On Behalf Of Jeff Mohler Sent: Friday, September 13, 2013 3:09 PM To: Fred Grieco Cc: Toasters(a)teaparty.net<mailto:Toasters@teaparty.net> Subject: Re: high CP_reads/writes ratio Wafl free space fragmentation most likely. Reallocate all volumes in the affected aggregate. Do not reallocate the _aggregate_. Sent from my iPhone On Sep 13, 2013, at 1:06 PM, Fred Grieco <fredgrieco(a)yahoo.com<mailto:fredgrieco@yahoo.com>> wrote: What kinds of things can cause a high CP_reads/writes ratio? And what can I do about it? I have an Oracle system with ASM that doing writes in a 15 minute cycle, and it causes a lot of writes with CP reads. The oracle ASM luns are basically the only thing on the aggregate. Disk alignment is fine (which is the first thing I thought of). I've attached a screenshot of the Oncommand graph for one of the disks in this aggr-- not sure if that will come through. The filer is a 3220 with 8.1.2 7-mode. Fibre channel attach, and there are about 20 luns under two volumes. TIA, Fred _______________________________________________ Toasters mailing list Toasters(a)teaparty.net<mailto:Toasters@teaparty.net> http://www.teaparty.net/mailman/listinfo/toasters

3 2

was there a thread after this ?
by Uddhav Regmi 12 Sep '13

12 Sep '13

Was there a thread after this ? Just making sure, I'm getting them all.. From: toasters-bounces(a)teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Jeff Cleverley Sent: Tuesday, September 03, 2013 5:29 PM To: tmac Cc: &lt,Toasters(a)teaparty.net&gtt&gt, Subject: Re: Third party LR 10G networking. It sounds like someone else may be working that already. If they get one approved we may be able to piggy back on that. Thanks, Jeff On Tue, Sep 3, 2013 at 2:04 PM, tmac <tmacmd(a)gmail.com <mailto:tmacmd@gmail.com> > wrote: Ask for a PVR from NetApp. The card with removable optics should support the LRs, NetApp would just needed to support the driver. On Sep 3, 2013 3:56 PM, "Jeff Cleverley" <jeff.cleverley(a)avagotech.com <mailto:jeff.cleverley@avagotech.com> > wrote: We're looking at having multiple connections per filer going to a switch in each room to remove the switch as a single point of failure. The single mode cabling will most likely be more compatible with 40G and 100G networking in the next few years. Jeff On Tue, Sep 3, 2013 at 1:05 PM, tmac <tmacmd(a)gmail.com <mailto:tmacmd@gmail.com> > wrote: Why not use SR optics from the NetApp to the switch (supported by netapp) And then LR optics between switches? --tmac Tim McCarthy Principal Consultant <http://dl.dropbox.com/u/6874230/na_cert_dma_2c.jpg> <http://dl.dropbox.com/u/6874230/rhce.jpeg> <http://dl.dropbox.com/u/6874230/na_cert_ie-san_2c.jpg> Clustered ONTAP Clustered ONTAP NCDA ID: XK7R3GEKC1QQ2LVD RHCE6 110-107-141 <https://www.redhat.com/wapps/training/certification/verify.html?certNumber= 110-107-141&isSearch=False&verify=Verify> NCSIE ID: C14QPHE21FR4YWD4 Expires: 08 November 2014 Current until Aug 02, 2016 Expires: 08 November 2014 On Tue, Sep 3, 2013 at 2:57 PM, Jeff Cleverley <jeff.cleverley(a)avagotech.com <mailto:jeff.cleverley@avagotech.com> > wrote: Greetings, We are looking at upgrading and changing our network architecture. One option would be to use LR GBIC with single mode fibre. This appears to require non-NetApp GBIC which I'm sure makes it unsupported. Is anyone doing this, and if so, which parts are you using and what issues have you run into? Thanks, Jeff -- Jeff Cleverley Unix Systems Administrator 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611 <tel:970-288-4611> _______________________________________________ Toasters mailing list Toasters(a)teaparty.net <mailto:Toasters@teaparty.net> http://www.teaparty.net/mailman/listinfo/toasters -- Jeff Cleverley Unix Systems Administrator 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611 <tel:970-288-4611> -- Jeff Cleverley Unix Systems Administrator 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611

2 2

NetApp Simulator - Using different interfaces for each node of cluster?
by Paul Letta 11 Sep '13

11 Sep '13

Hello, I've got a 3240 HA pair running 7.3.5. We are looking to enable cluster failover for network interface failures. I want to test this with 7.3.5 line of the simulator. I can create a HA cluster with the simulator. The problem is that both nodes of the sim use the same interface on the underlying OS. I would like node1 of the sim to use eth1 and node2 of the sim to use eth2. That way I can simulate a network failure of just one of the nodes of the sim. I have not found a way to achieve this yet. I tried creating 2 separate sim nodes (without clustering) on different interfaces, but after they are both up, the cluster interconnect is missing -- so enabling cf does nothing. Any ideas on how I can do this with the sim? I tried just doing an "ifconfig ns0 down" on one of the nodes of the cluster-- that disconnected the network from that node, but it didn't trigger the cluster failover, so I'm guessing that an ifdown is not the same as a nic failure (at least as far as triggering a takeover is concerned). Thanks. Paul

3 4

Third party LR 10G networking.
by Jeff Cleverley 03 Sep '13

03 Sep '13

Greetings, We are looking at upgrading and changing our network architecture. One option would be to use LR GBIC with single mode fibre. This appears to require non-NetApp GBIC which I'm sure makes it unsupported. Is anyone doing this, and if so, which parts are you using and what issues have you run into? Thanks, Jeff -- Jeff Cleverley Unix Systems Administrator 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611

2 4

SAN vs Software defined storage
by Chris Picton 28 Aug '13

28 Aug '13

Hi all I am currently successfully using a fas3210 as 10g NFS storage for a vmware cluster I have in production. I am currently dedicating 2 shelves of 300Gb drives to vmware, and am getting very good response times. In my test environment, I am using KVM sitting on top of a moosefs cluster (6 machines with 5x 1Tb SATA drives each, and 1Gb network). Disk performance in the VMs is obviously not as good as 10g NFS, but is is definitely acceptable for my database/app servers/etc in test. I am considering my long term storage strategy (both capacity and speed),and I have two roads to go down in order to scale my storage to be able to handle 100s/1000s of vms. The first is to use netapp with large SATA drives for slow storage, and use high speed SAS drives for fast storage, choosing the storage type according to purpose, or I can use something like Moosefs (or more likely, Ceph) to provide a scalable storage cluster off "commodity" hardware, with SSD caching/journalling, and SATA drives for actual storage. Does anyone have experience with both traditional SAN storage, as well as Ceph/Gluster/Moosefs and is willing to share any thoughts/ideas they may have? Regards Chris

5 6

Flash Pool experiences with VDI?
by Sami Kapanen 28 Aug '13

28 Aug '13

Hey all, Who has experiences of using FlashPools for VDI storage? We are currently running approx. 150 VDI machines, using VMware View5. (..numbers will grow) Now we use EMC CX4 with FastCache and have managed with it. We deploy new VDI machines in advance to avoid boot storms, mainly using non-persistent machines. We are looking for new storage now and FAS3220 with FlashPools is one option. If you have some examples of your FlashPool configs and amounts of VDI machines running? So far we haven't used NetApp with VDI at all, just have one FAS2040 as CIFS filer for desktops, Sk

1 0

Metrics!
by Ray Van Dolson 27 Aug '13

27 Aug '13

We have a growing deployment with ~25 filers and about 750TB of usable space. Most of it is VMware datastore space exposed via NFS, but some is general purpose NAS file sharing. We've been using OnCommand Core (formerly DFM) to handle reporting and such, and for the most part it's worked pretty well. I need to start pulling together some metrics for the environment as a whole, both to benefit the Storage Team who manages the devices, but also to be able to pass along to my bosses so they can get a basic grasp of how things are going. I'm curious how those of you with deployments similar to mine or larger hvae dealt with this? What sort of things are you reporting on, and how do you handle the "roll-ups" to summarize many (in our case 200+) volumes into something meaningful? Are you generating reports natively from OnCommand Core, or pulling the data out into another tool? Do you find the OnCommand DataSets feature useful? We haven't really leveraged it properly I think. My thought is to present a sort of physical view of our environment showing roll-ups of storage capacity and performance (probably CPU, IOPS and latency). How to give a snapshot overview of the whole environment is what I'm not sure on. I'm thinking using the DataSets will help me organize our various types of data and then I can report on that. I'm not sure, however, if I should spend my time trying to get the right reports out of OnCommand Core directly or if I should just start extracting the data to another tool (which?) or into a database where I can home-brew up what I'm after. Thoughts/experiences? Thanks, Ray

9 15

Mapping CIFS user to Unix user
by Iluhes 22 Aug '13

22 Aug '13

I have a very strange issue. The share are exported via CIFS and NFS. System is connect to AD domain and NIS Sometime Windows user creates a file with correct UNIX id, sometime it create a file that is owned by nobody4:x:65534:65534:SunOS 4.x NFS Anonymous Access User:/: I see where it is coming from, first it is matched to correct Unix ID and the right away it is matched to pcuser.... On filer /etc/password pcuser::65534:65534::/: This is waht I see in the messegaes file... Thu Aug 22 13:47:11 CDT [netapp1:auth.trace.authenticateUser.loginTraceMsg:info]: AUTH: User from 1.1.1.8 authenticated by DC. Thu Aug 22 13:47:11 CDT [netapp1:auth.trace.mapNTToUnix:info]: AUTH: Mapping Windows user test_user to Unix user test_user. Thu Aug 22 13:47:11 CDT [netapp1:auth.trace.mapNTToUnix:info]: AUTH: Mapping Windows user test_user to Unix user pcuser. I dont get why it first matches it to correct it and then to pcuser

2 2

configAdvisor question for CM
by Klise, Steve 22 Aug '13

22 Aug '13

* 6250's * DOT 8.2p2 CM; 2 node <FCP> * 3 stacks Is there a way to determine the port a stack is plugged into on the IO modules on the back of the shelves? I know I can trace them, but that's not so sexy. I have the in and out on the node side, but wanted to identify the other side of the stack. This is what I tried from each node, but the output was the same. FILER001::> run -node FILER001C1 -command acpadmin list_all IP MAC Reset Last Contact Protocol Assigner Shelf Current Inband IOM Address Address Cnt (seconds ago) Version ACPA ID S/N State ID Type ---------------------------------------------------------------------------------------------------------------------- 192.168.0.27 00:a0:98:41:ec:1a 000 303 1.2.2.6 1874380650 6000626000 0x5 5b.13.A IOM6 192.168.0.63 00:50:cc:74:18:3e 000 393 1.1.1.31 1874380650 SHJ00000000A4D7 0x5 3d.35.A IOM3 192.168.0.85 00:a0:98:41:ec:54 000 448 1.2.2.6 1874380650 6000625991 0x5 5b.14.A IOM6 192.168.0.141 00:50:cc:74:30:8c 000 237 1.1.1.31 1874380650 SHJ00000000A4B0 0x5 3d.34.B IOM3 192.168.0.165 00:50:cc:74:34:a5 000 447 1.1.1.31 1874380650 SHJ00000000A518 0x5 3d.32.A IOM3 192.168.0.213 00:50:cc:74:34:d5 000 369 1.1.1.31 1874380650 SHJ00000000A518 0x5 3d.32.B IOM3 192.168.1.25 00:50:cc:74:35:18 000 446 1.1.1.31 1874380650 SHJ00000000A514 0x5 3d.30.A IOM3 192.168.1.29 00:50:cc:74:31:1c 000 432 1.1.1.31 1874380650 SHJ00000000A4D7 0x5 3d.35.B IOM3 192.168.1.30 00:50:cc:74:35:1d 000 450 1.1.1.31 1874380650 SHJ00000000A514 0x5 3d.30.B IOM3 192.168.1.41 00:50:cc:74:35:28 000 410 1.1.1.31 1874380650 SHJ00000000A510 0x5 3d.31.B IOM3 192.168.1.69 00:a0:98:41:69:44 000 545 1.2.2.6 1874380650 6000587242 0x5 5b.10.B IOM6 192.168.1.109 00:50:cc:74:35:6d 000 357 1.1.1.31 1874380650 SHJ00000000A4FA 0x5 3d.33.B IOM3 192.168.1.141 00:a0:98:41:dd:8c 000 469 1.2.2.6 1874380650 SHJ000000017644 0x5 5a.20.B IOM6 192.168.1.157 00:a0:98:41:4d:9c 000 320 1.2.2.6 1874380650 6000584783 0x5 5b.12.B IOM6 192.168.1.179 00:a0:98:41:35:b2 000 498 1.2.2.6 1874380650 6000584783 0x5 5b.12.A IOM6 192.168.1.197 00:a0:98:41:dd:c4 000 370 1.2.2.6 1874380650 SHJ000000017644 0x5 5a.20.A IOM6 192.168.2.103 00:50:cc:74:2a:67 000 386 1.1.1.31 1874380650 SHJ00000000A510 0x5 3d.31.A IOM3 192.168.3.67 00:a0:98:42:17:42 000 350 1.2.2.6 1874380650 6000625991 0x5 5b.14.B IOM6 192.168.3.113 00:50:cc:74:33:70 000 440 1.1.1.31 1874380650 SHJ00000000A4FA 0x5 3d.33.A IOM3 192.168.3.175 00:50:cc:74:2f:af 000 406 1.1.1.31 1874380650 SHJ00000000A4B0 0x5 3d.34.A IOM3 192.168.3.197 00:a0:98:41:6b:c4 000 294 1.2.2.6 1874380650 6000587357 0x5 5b.11.A IOM6 192.168.3.223 00:a0:98:41:6b:de 000 147 1.2.2.6 1874380650 6000587357 0x5 5b.11.B IOM6 192.168.3.227 00:a0:98:41:6b:e2 000 319 1.2.2.6 1874380650 6000587242 0x5 5b.10.A IOM6 192.168.3.237 00:a0:98:42:17:ec 000 194 1.2.2.6 1874380650 6000626000 0x5 5b.13.B IOM6 FILER001::> run -node FILER001C2 -command acpadmin list_all IP MAC Reset Last Contact Protocol Assigner Shelf Current Inband IOM Address Address Cnt (seconds ago) Version ACPA ID S/N State ID Type ---------------------------------------------------------------------------------------------------------------------- 192.168.0.27 00:a0:98:41:ec:1a 000 370 1.2.2.6 1874380650 6000626000 0x5 5b.13.A IOM6 192.168.0.63 00:50:cc:74:18:3e 000 417 1.1.1.31 1874380650 SHJ00000000A4D7 0x5 3d.35.A IOM3 192.168.0.85 00:a0:98:41:ec:54 000 511 1.2.2.6 1874380650 6000625991 0x5 5b.14.A IOM6 192.168.0.141 00:50:cc:74:30:8c 000 327 1.1.1.31 1874380650 SHJ00000000A4B0 0x5 3d.34.B IOM3 192.168.0.165 00:50:cc:74:34:a5 000 523 1.1.1.31 1874380650 SHJ00000000A518 0x5 3d.32.A IOM3 192.168.0.213 00:50:cc:74:34:d5 000 453 1.1.1.31 1874380650 SHJ00000000A518 0x5 3d.32.B IOM3 192.168.1.25 00:50:cc:74:35:18 000 515 1.1.1.31 1874380650 SHJ00000000A514 0x5 3d.30.A IOM3 192.168.1.29 00:50:cc:74:31:1c 000 511 1.1.1.31 1874380650 SHJ00000000A4D7 0x5 3d.35.B IOM3 192.168.1.30 00:50:cc:74:35:1d 000 509 1.1.1.31 1874380650 SHJ00000000A514 0x5 3d.30.B IOM3 192.168.1.41 00:50:cc:74:35:28 000 432 1.1.1.31 1874380650 SHJ00000000A510 0x5 3d.31.B IOM3 192.168.1.69 00:a0:98:41:69:44 000 9 1.2.2.6 1874380650 6000587242 0x5 5b.10.B IOM6 192.168.1.109 00:50:cc:74:35:6d 000 423 1.1.1.31 1874380650 SHJ00000000A4FA 0x5 3d.33.B IOM3 192.168.1.141 00:a0:98:41:dd:8c 000 492 1.2.2.6 1874380650 SHJ000000017644 0x5 5a.20.B IOM6 192.168.1.157 00:a0:98:41:4d:9c 000 379 1.2.2.6 1874380650 6000584783 0x5 5b.12.B IOM6 192.168.1.179 00:a0:98:41:35:b2 000 599 1.2.2.6 1874380650 6000584783 0x5 5b.12.A IOM6 192.168.1.197 00:a0:98:41:dd:c4 000 471 1.2.2.6 1874380650 SHJ000000017644 0x5 5a.20.A IOM6 192.168.2.103 00:50:cc:74:2a:67 000 421 1.1.1.31 1874380650 SHJ00000000A510 0x5 3d.31.A IOM3 192.168.3.67 00:a0:98:42:17:42 000 432 1.2.2.6 1874380650 6000625991 0x5 5b.14.B IOM6 192.168.3.113 00:50:cc:74:33:70 000 512 1.1.1.31 1874380650 SHJ00000000A4FA 0x5 3d.33.A IOM3 192.168.3.175 00:50:cc:74:2f:af 000 476 1.1.1.31 1874380650 SHJ00000000A4B0 0x5 3d.34.A IOM3 192.168.3.197 00:a0:98:41:6b:c4 000 395 1.2.2.6 1874380650 6000587357 0x5 5b.11.A IOM6 192.168.3.223 00:a0:98:41:6b:de 000 200 1.2.2.6 1874380650 6000587357 0x5 5b.11.B IOM6 192.168.3.227 00:a0:98:41:6b:e2 000 408 1.2.2.6 1874380650 6000587242 0x5 5b.10.A IOM6 192.168.3.237 00:a0:98:42:17:ec 000 241 1.2.2.6 1874380650 6000626000 0x5 5b.13.B IOM6 Any help is appreciated..

3 7

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters