toasters April 2015

toasters@lists.teaparty.net

45 participants
27 discussions

Adding DS2246 to FAS2240-2 with existing DS4243
by Aaron Lewis 27 Apr '15

27 Apr '15

Hi all, I have a FAS2240-2 with the following configuration: Existing Stack: 1. DS2246 disk shelf (internal) 2. DS2246 disk shelf (external) 3. DS4243 disk shelf I need to add a new DS2246 to this system and want to maintain the single transition between 6G and 3G so it looks like this: Existing Stack: 1. DS2246 disk shelf (internal) 2. DS2246 disk shelf (external) 3. NEW DS2246 4. DS4243 disk shelf Is it possible to hot-add the DS2246 into the existing stack? The Installation Guide gives the process for adding it to the bottom of the stack, but doesn't explicitly prohibit inserting the shelf and it seems like you could with Multipath HA. Thanks, Aaron

3 3

cDOT provisioning strategy
by Momonth 24 Apr '15

24 Apr '15

Hi, We are (finally) getting close to go live with cDOT clusters. I know some of you guys are already "happy customers" and I would like to hear your thoughts on the following: 1. SAN: Create one SVM per physical node? Or multiple SVMs per node and then combine LUNs, that belong to a certain application, on a single SVM? 2. NAS: pretty much the same questions, pros and cons of having multiple SVMs. What are your criteria when you decide to spin up a new SVM? SVM conception seems to give quite some flexibility, but I can't get my head around as to when / how to apply this flexibility. I've never used vfilers in 7-Mode world. Cheers, Vladimir

5 4

Extra Protection for Certain Datasets
by Ray Van Dolson 23 Apr '15

23 Apr '15

Hi everyone; Thinking about how to protect certain datasets (NAS shares) with additional authentication requirements -- probably two-factor authentication. Am thinking this could be achieved via a "second" Active Directory domain which requires the two factor auth (tokens, etc.) and then a vFiler which attaches to this domain and houses the data. I'm fairly certain there's no clever way to stick with a single domain and configure only certain datasets to require additional auth? Thinking CIFS, but presumably kerberized NFSv4 could also work here. Ray

2 1

what in the world happend to performance (dfm) advisor with CDOT
by Iluhes 23 Apr '15

23 Apr '15

What happened? Where are all the performance graphs, they are all gone.Did the tool get killed? The performance manager is almost empty

5 11

Encryption Questions
by Ray Van Dolson 17 Apr '15

17 Apr '15

Hi all -- for those of you doing encryption (on NetApp or another platform): What are you using for Key Management? SafeNet? IBM's KMS? Something else? Do you find yourselves purchasing self-encrypting drives *only* for datasets you're sure need it vs. creating a catch-all location where mixed data lives but at lesat you can say that it's "all encrypted at rest"? The approach here can obviously impact costs... Thanks, Ray

3 4

Excessive Flow Control Frames?
by Philbert Rupkins 17 Apr '15

17 Apr '15

Toasters, We have ethernet flow control set to full on our NetApp's 10g interfaces. The FEX ports to which our 10g interfaces are connected also have flow control TX/RX enabled. I realize enabling flow control is against best practices. I am trying to determine if we are seeing an excessive number of flow control frames. We received over 12,000 PAUSE frames from the FEX within a 10 minute period which sounds excessive to me. Can anybody confirm that 12,000 is an excessive number of PAUSE frames that would likely result in connectivity issues? Here are statistics for one of our 10g interfaces during a recent 10 minute interval. Notice that the NetApp is receiving PAUSE frames (RECEIVE-Xoff) from the FEX and never transmitting (TRANSMIT-Xoff). RECEIVE Jabber: 0 | Bus overruns: 0 | Xon: 12412 Xoff: 12412 | Jumbo: 0 TRANSMIT Queue overflows: 0 | No buffers: 0 | Xon: 0 Xoff: 0 | Jumbo: 0 | TSO non-TCP drop: 0 What I see is the FEX telling the NetApp to slow down. I just dont know if the FEX is slowing down the NetApp enough that it would cause problems. Have a great day, Phil

7 8

Firing up an old F760...
by Jeffrey Mohler 15 Apr '15

15 Apr '15

This could be fun...and old F760 with say, 4 shelves of 36G drives.. Replace the NVRAM battery, check power supplies for leaking capacitor oil...reseat cards and DIMMS... What're the odds it'll work, and any other fire-prevention steps to take? :) -Cheers _________________________________Jeff MohlerTech Yahoo, Storage Architect, Principal(831)454-6712TW: @PrincipalYahooYM: Supra89ta

12 18

Odd Kahuna behaviour W/Pam
by Jeffrey Mohler 15 Apr '15

15 Apr '15

I have an HA pair, both with pam. One does NOT have PAM enabled. We have some uniquely bursty workloads at the top of every hour, and they are unusually high peaks 3 or 4 hours every day in the AM. The PAM enabled system suffers VERY High concurrency & latency on these few peaks, but the non PAM system does not. PAM hit rate is about 60%. I'm wondering if this is because these sudden user-based spike workloads are almost 0% cachable, that Kahuna takes a hit evicting an unusually high amount of blocks from PAM..and updating the in-ram hash of what's actually in PAM. When I enable PAM on controller 2, this odd concurrency/latency spike then also shows up on that head too. Thoughts? _________________________________Jeff MohlerTech Yahoo, Storage Architect, Principal(831)454-6712TW: @PrincipalYahooYM: Supra89ta

3 2

Re: Firing up an old F760...
by Jeffrey Mohler 15 Apr '15

15 Apr '15

700s done have one of those. 600's do. Ever do an NVRAM swap on one? It's surgery. :) _________________________________Jeff MohlerTech Yahoo, Storage Architect, Principal(831)454-6712TW: @PrincipalYahooYM: Supra89ta On Wednesday, April 15, 2015 10:31 AM, "Hughes, Patrick" <Patrick.Hughes(a)netapp.com> wrote: Don't forget to check the flux capacitor. ;-) Sent from my iPhone using two clumsy thumbs and sometimes my nose On Apr 15, 2015, at 11:24 AM, Steiner, Jeffrey <Jeffrey.Steiner(a)netapp.com> wrote: #yiv7465649218 #yiv7465649218 -- _filtered #yiv7465649218 {panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7465649218 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7465649218 {font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;} _filtered #yiv7465649218 {}#yiv7465649218 #yiv7465649218 p.yiv7465649218MsoNormal, #yiv7465649218 li.yiv7465649218MsoNormal, #yiv7465649218 div.yiv7465649218MsoNormal {margin:0in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv7465649218 a:link, #yiv7465649218 span.yiv7465649218MsoHyperlink {color:blue;text-decoration:underline;}#yiv7465649218 a:visited, #yiv7465649218 span.yiv7465649218MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv7465649218 span.yiv7465649218EmailStyle17 {color:#1F497D;}#yiv7465649218 .yiv7465649218MsoChpDefault {font-size:10.0pt;} _filtered #yiv7465649218 {margin:1.0in 1.0in 1.0in 1.0in;}#yiv7465649218 div.yiv7465649218WordSection1 {}#yiv7465649218 I was once at a customer doing an upgrade on a massively parallel database environment. It was about 5 racks of little 1U servers with FCP connectivity. The timeouts for FCP were set to 0, meaning if you lose one single SCSI command, just reboot. That was legit for local disk, but not SAN. Ever seen 200 servers reboot in perfect synchronization? I have. I was in the hot aisle, sandwiched between the servers and the storage system. As soon as the controller rebooted, it got very, very bright as all the LED’s on the backs of the servers lit up during self-test. Then it got very hot and loud as all the self-test progressed and all the fans spun up to maximum speed. From:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net]On Behalf Of Jeffrey Mohler Sent: Wednesday, April 15, 2015 7:03 PM To: Steve Rikli Cc: toasters(a)teaparty.net Subject: Re: Firing up an old F760... Ive seen that, but at scale. Was in PS at Netapp, and I was asked to sit-in on a customer moving racks of 500s, 600s, and a few 700s from telco racks to cabinets. At the time the cabinets were 240v only. I was in another room...sit-in help as needed, I was not allowed in the DC. They made a show of 'lets hit the breakers and turn on all 11 cabinets at once'. Most of them were full of shelves with 120v only power supplies, at the time I think that was "green button" supplies. Lots of oil..lots of fire. Replaced 100+ supplies with switching ones, and all was good in the end. Them was the dayz.. _________________________________ Jeff Mohler Tech Yahoo, Storage Architect, Principal (831)454-6712 TW: @PrincipalYahoo YM: Supra89ta On Wednesday, April 15, 2015 9:51 AM, Steve Rikli <sr(a)genyosha.net> wrote: Don't stand directly behind it when you turn it on. :-) Semi-seriously though, I once had a very old original DS14 shelf p/s (the ones with the vertial bar handles) flame out at me. We'd just finished re-racking the rig, so I flipped on the breakers and moved down the row to start on the next one, when the p/s spat out a small and brief burst of smoke and spark. It wouldn't have been harmful and probably wouldn't have even left a mark, but it was still a surprise. On Wed, Apr 15, 2015 at 04:39:04PM +0000, Jeffrey Mohler wrote: > This could be fun...and old F760 with say, 4 shelves of 36G drives.. > > Replace the NVRAM battery, check power supplies for leaking capacitor oil...reseat cards and DIMMS... > > What're the odds it'll work, and any other fire-prevention steps to take??????? :) _______________________________________________ Toasters mailing list Toasters(a)teaparty.net http://www.teaparty.net/mailman/listinfo/toasters

1 0

Re: FAS8040 network configuration in CDOT
by tmac 15 Apr '15

15 Apr '15

Yeah, keep looking back at the FAS8020 for some reason...only has the four ports. Make sure you have the X6599A (the 10-GIG SFP) and not the X6596(FC SFP). For each controller: a0a should consist of e0e/e0g which should go to the same switch, if possible, different blades on the same switch and e0f/e0h which should go to the same switch, if possible, different blades on the same switch --> if you cannot split across blades, at least split across ASICs on the same blade. --tmac *Tim McCarthy* *Principal Consultant* On Thu, Apr 9, 2015 at 8:24 AM, Clark, André M. <Andre.Clark(a)redeight.com> wrote: > Each 8040/60/80 controller has 4 10GbE ports (e0a-e0d) and 4 UTA2 ports > (e0e-e0h). Ports e0a-e0d, in a cDOT configuration, are used for the > private cluster network while ports e0e-e0h are used for data > communications. No extra 10G card is needed at this time. > > > > Regards, > > > > André M. Clark <Andre.Clark(a)redeight.com> | Sr. Consulting Architect | > 917.388.8236 > > *Tell me I will forget... Show me I may remember... Involve me I WILL > UNDERSTAND!!! Start by doing what's necessary, then what's possible, and > suddenly you are doing the impossible!!!* > > *Red8*, An Insight Investments Company > > www.redeight.com > > > > *From:* toasters-bounces(a)teaparty.net [mailto: > toasters-bounces(a)teaparty.net] *On Behalf Of *tmac > *Sent:* Thursday, 9 April, 2015 06:22 > *To:* Francis Kim > *Cc:* toasters(a)teaparty.net > *Subject:* Re: FAS8040 network configuration in CDOT > > > > No that won't work. > > If you are configuring cDOT, at least two ports per controller are > reserved for the cluster network (e0a & e0c) > > This leaves e0b and e0d available for normal network access > > > > The recommended configuration is to use all four ports for the cluster > network (e0a, e0b, e0c & e0d). > > In this case, if you need/want 10gig network connections you would need an > extra 10gig card > > > > AS indicated earlier in this thread, from each controller: > > a0a should be a multimode_lacp VIF and contain: > > e0b -> switch 1 > > e0d -> switch 2 > > > > Then you can create your VLANs: a0a-123, a0a-456 > > > > Place your LIFs on the tagged VLANs > > > > Create a failover group for node-01:a0a-123 and node-02:a0a-123 > > Create a failover group for node-01:a0a-456 and node-02:a0a-456 > > > > Assign the failover group to the appropriate LIF > > > > PS: DO NOT FORGET to disable spanning tree on the switch ports. > > --> spanning tree protocol should only be enabled on ports connected to > other switches. > > --> it is not needed on ports connected to en hosts > > --> in a cluster failover event it could take an extra 45 seconds for a > port to become available.(not good) > > --> remember to use the right version of the command. if it is a trunk, > you usually need that on the line > > > > --tmac > > > > *Tim McCarthy* > > *Principal Consultant* > > > > > > > > On Wed, Apr 8, 2015 at 11:36 PM, Francis Kim <fkim(a)berkcom.com> wrote: > > You can also tie the four links into a single interface group and carve > it up into multiple VLANs. > > > > What ports are you going to use for the cluster interconnect? I assume > you're ordering a switchless cluster of two nodes? > > > > > > *Francis Kim *| Engineer > > 510-644-1599 x334 | fkim(a)berkcom.com > > > > *BerkCom* | www.berkcom.com > > NetApp | Cisco | Supermicro | Brocade | VMware > > > > On Apr 8, 2015, at 3:51 PM, Sayla, Mustafa <MSAYLA(a)mesirowfinancial.com> > wrote: > > > > We are looking to buy new FAS8040 and configure it with CDOT. I am looking > for network recommendation with Cisco 6509 VSS. 8040 has four 10G ports per > controller and I want to use all four ports to create an interface group > with two VLAN, using VLAN tagging. I want 2 ports to go to one VSS switch > and 2 ports to go to other VSS switch so I have switch redundancy also. I > am not sure if it is doable since I am going to two different switches. Any > recommendation is appreciated. > > > > Mustafa > > *Visit us on the Web at mesirowfinancial.com > <http://mesirowfinancial.com/>* > > *This communication may contain privileged and/or confidential > information. It is intended solely for the use of the addressee. If you are > not the intended recipient, you are strictly prohibited from disclosing, > copying, distributing or using any of this information. If you received > this communication in error, please contact the sender immediately and > destroy the material in its entirety, whether electronic or hard copy. > Confidential, proprietary or time-sensitive communications should not be > transmitted via the Internet, as there can be no assurance of actual or > timely delivery, receipt and/or confidentiality. This is not an offer, or > solicitation of any offer to buy or sell any security, investment or other > product.*_______________________________________________ > Toasters mailing list > Toasters(a)teaparty.net > http://www.teaparty.net/mailman/listinfo/toasters > > > > > _______________________________________________ > Toasters mailing list > Toasters(a)teaparty.net > http://www.teaparty.net/mailman/listinfo/toasters > > >

8 16

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters April 2015