toasters

toasters@lists.teaparty.net

13531 discussions

Frame discards on Brocade with 7-Mode FMC using 8G HBA and DS14
by andrei.borzenkov＠ts.fujitsu.com 03 Oct '16

03 Oct '16

This weekend I did head swap from FAS3140 to FAS8040 in 7-Mode FMC. Storage is DS14mk4 and one DS2246 that was added later. Backend switches are Brocade 300 so we tried to change HBA ports from 4G to 8G hoping to boost overall performance. But almost immediately I observed intermittent Sat Oct 1 23:00:08 YEKT [netapp2:cf.fsm.takeoverOfPartnerDisabled:error]: Failover monitor: takeover of netapp1 disabled (status of backup mailbox is uncertain). Sat Oct 1 23:00:14 YEKT [netapp2:cf.fsm.takeoverOfPartnerEnabled:notice]: Failover monitor: takeover of netapp1 enabled On both heads. There was no load, all applications were still stopped at this point. There were no other errors visible in logs. Looking on switches, the only errors reported for ports were c3 discards. They were most frequent on DS14 ports, but also happened for HBA and even ATTO ports (1 and 13 in this example). Statistic is collected several minutes after resetting counters. netapp2_fcsw1:admin> porterrshow frames enc crc crc too too bad enc disc link loss loss frjt fbsy c3timeout tx rx in err g_eof shrt long eof out c3 fail sync sig tx rx ======================================================================================================================= 0: 124.5k 90.9k 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1: 327.5k 290.8k 0 0 0 0 0 0 0 3 0 0 0 0 0 0 3 2: 278.4k 244.0k 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3: 27.0k 29.1k 0 0 0 0 0 0 0 102 0 0 0 0 0 0 102 4: 426.5k 474.3k 0 0 0 0 0 0 0 324 0 0 0 0 0 324 0 5: 41.9k 48.9k 0 0 0 0 0 0 0 120 0 0 0 0 0 0 120 6: 98.8k 109.8k 0 0 0 0 0 0 0 6 0 0 0 0 0 0 6 7: 111.4k 133.1k 0 0 0 0 0 0 0 2 0 0 0 0 0 0 2 8: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 9: 56.2k 64.0k 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 10: 13.4k 14.9k 0 0 0 0 0 0 0 52 0 0 0 0 0 0 52 11: 46.4k 50.4k 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 12: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 13: 22.0k 23.8k 0 0 0 0 0 0 0 38 0 0 0 0 0 0 38 14: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 15: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 16: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 17: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 18: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 19: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 20: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 21: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 22: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 23: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 I could not find any best practice or recommendation regarding port speeds in such configuration (actually, documentation recommends setting port speed to maximum supported by connected device, which in this case means 8G). After forcing HBA back to 4G the above messages and c3 discards went away. So I'm looking for practical experience in this area. May be there are some settings we missed. Switches are running 7.0.2b (minimal version matching IMT). Shelf firmware is the latest. Data ONTAP is 8.2.4P4. --- With best regards Andrei Borzenkov Senior system engineer FTS WEMEAI RUC RU SC TMS FOS FUJITSU Zemlyanoy Val Street, 9, 105 064 Moscow, Russian Federation Tel.: +7 495 730 62 20 ( reception) Mob.: +7 916 678 7208 Fax: +7 495 730 62 14 E-mail: Andrei.Borzenkov(a)ts.fujitsu.com Web: ru.fujitsu.com Company details: ts.fujitsu.com/imprint This communication contains information that is confidential, proprietary in nature and/or privileged. It is for the exclusive use of the intended recipient(s). If you are not the intended recipient(s) or the person responsible for delivering it to the intended recipient(s), please note that any form of dissemination, distribution or copying of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender and delete the original communication. Thank you for your cooperation. Please be advised that neither Fujitsu, its affiliates, its employees or agents accept liability for any errors, omissions or damages caused by delays of receipt or by any virus infection in this message or its attachments, or which may otherwise arise as a result of this e-mail transmission.

4 5

AFF and 4:1 guaranteed efficiency
by jordan slingerland 28 Sep '16

28 Sep '16

Sales guys are promising me 4:1 dedup ratios on an AFF with ontap9. They say they grantee it. I have specifically asked what stipulation. In a VDI environment with linked clones, etc. Sales guy tells me none and even specifically says they can dedup compressed video or audio (mp3) 4:1. I have A LOT of trouble believing that. So, 4:1 dedup guaranteed or what? Any comments welcome. --Jordan

13 31

Nblade.cifsSameTreePerSess:
by Mark Flint 19 Sep '16

19 Sep '16

Hi all, been seeing quite a bit of this error recently, and I wondered if anyone had seen this before? It looks like e either the user, or software, is trying to connect to the admin share, but could also just be trying to walk the share tree ,maybe? Full error reads:- Nblade.cifsSameTreePerSess: Received too many connection requests to the same share from one session: clientIP:port share "ipc$", user " removed IP and userid. Mark -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

4 7

lun expansion
by Rhodes, Richard L. 08 Sep '16

08 Sep '16

Hello! Data ONTAP Release 8.1.2P1 7-Mode Luns fibrechannel attached to IBM pSeries with AIX Vols containing luns are snapmirrored to a DR site, and also snapvaulted to another filer. I'd like to try out resizing a lun (FibreChannel attached to AIX) to increase it's size. Have never done this! I know OnTap can resize a lun. What I'm not sure about is how that works with snapmirror and snapvault relationships. Snapmirror is at the volume level and shouldn't care. But snapvault in 7-mode is still at the object level - it works on the lun file. But then, SV should just copy the new blocks. So, I'm thinking lun expansion is no problem with SM and SV. Is this correct? Thanks! Rick ----------------------------------------- The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.

2 1

cDOT 8.2.x, grow aggregates or new ones?
by John Stoffel 08 Sep '16

08 Sep '16

Guys, I've got a four node, 8060 cluster running cDOT 8.2.x which we just added in a bunch of disks, spread evenly across our two HA pairs. 2 x DS4246 x 2Tb SATA, and 4 x DS2246 x 600g SAS shelves/disks. I suspect the smart thing to do is to just grow my existing aggregates, which lets me grow existing volumes, etc without too much trouble. And of course I would add in disks in complete Raid Groups. Or do people think I should just create brand new aggregates and move as needed? Do I really need to worry about reallocation issues when I do these adds? My current setup is: n1sas1 20.67TB 7.37TB 64% online 28 n1 raid_dp, n1sata1 56.75TB 12.15TB 79% online 79 n1 raid_dp, n1sata2 56.75TB 7.30TB 87% online 99 n1 raid_dp, n2sas1 26.92TB 6.19TB 77% online 20 n2 raid_dp, n2sas2 26.92TB 9.51TB 65% online 29 n2 raid_dp, n2sas3 20.19TB 9.54TB 53% online 6 n2 raid_dp, n2ssd1 13.09TB 10.84TB 17% online 7 n2 raid_dp, n3sas1 26.92TB 7.24TB 73% online 31 n3 raid_dp, n3sas2 26.92TB 8.13TB 70% online 37 n3 raid_dp, n3sas3 20.19TB 2.97TB 85% online 50 n3 raid_dp, n4sata1 56.75TB 9.73TB 83% online 69 n4 raid_dp, n4sata2 53.84TB 9.46TB 82% online 33 n4 raid_dp, As you can see, we did screw up in n1/n2 by having both SAS and SATA aggregates on the same head. Ooops. We fixed that for the second pair when we grew the cluster. Just looking for a confirmation of my thinking. Thanks, John

3 2

Ontap SELECT SSD
by BERNTSEN Basil 07 Sep '16

07 Sep '16

Hi folks, I was told by someone on my account team that SSD isn't "allowed" on Ontap SELECT. That said, I found in TR 4517, page 9, (http://www.netapp.com/us/media/tr-4517.pdf) that in fact we can use SSDs. Anyone here know the whole story? · If I attach a bunch of SSDs to a RAID card and present them to an Ontap SELECT VM, can I use them? · Will it try to use them like spindles, without any of the new 9.0 flash optimizations? Thanks! Basil Berntsen Société Générale ************************************************************************* This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information. Any unauthorized use or dissemination is prohibited. E-mails are susceptible to alteration. Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified. Please visit http://sgasdisclosure.com for important information regarding SG Americas Securities, LLC (“SGAS”). Please visit http://swapdisclosure.sgcib.com for important information regarding swap transactions with SOCIETE GENERALE. *************************************************************************

4 4

Snapmirror TDP from 7mode to CDOT - Can I 'daisy chain'?
by Edward Rolison 25 Aug '16

25 Aug '16

I'm migrating a bunch of volumes from a 7 mode filer, to CDOT. For various reasons, I'd _like_ to split these volumes apart prior to migration - mostly around filecount. We have a few qtrees with really high file counts, and generally they don't make sense to group together anyway. So - what I'm thinking is: QSM from source qtree to 'staging' volume within filer. VSM from staging volume to CDOT TDP volume. Should I be able to do this, or is there a better way? Ideally - I'd like to avoid a 'double cutover' scenario. My 'plan B' involves just creating about 10 replicas of the source volume, and - post cutover - delete all the stuff I didn't need from each of them, but this seems a suboptimal solution. (I think I have the same problem, in that I can't lower the inodes of the volume, so I'll have 10 volumes with 100M+ inodes, instead of 10 with considerably fewer) It certainly seems like a TDP snapmirror doesn't work when a QSM is inbound to the volume in question - but a break and resync _might_ do the trick? (trying to do that now) Is there a better approach I should be taking?

5 10

xcp for NTFS files?
by Basil 25 Aug '16

25 Aug '16

I heard rumors that xcp is being worked on for NTFS files- is anyone familiar with progress on that? I've started using it for more than just copying data- any time I need an index of my filesystem, I use an xcp scan, which allows me to match on the metadata without hitting the filesystem again.

2 1

SnapMirror vs. SnapVault for 70+ million files...
by Ray Van Dolson 23 Aug '16

23 Aug '16

We wanted to use SnapVault to protect a volume containing 70+ million files (probably also has around 30TB of data, though it de-dupes down to less than 6TB). However, it appears that with SnapVault a full file scan is preformed prior to the block-based replication, and that scan can take around 24 hours. I'm assuming it will do this on subsequent differential vaults, though the block transfer part should be much shorter we'll still need to wait for the file scan to complete. As we'd like to "back up" this data at least once a day, would we be better positioned by using SnapMirror? My belief is that it does *not* scan all of the files first and simply replicates changed blocks. We'd need to keep more snapshots on the source storage to meet our retention requirements (or maybe further replicate the volume on the destination side?). Thanks, Ray

6 8

To enable sanitization or not
by Rhorer, Kyle L. (JSC-OD)[THE BOEING COMPANY] 22 Aug '16

22 Aug '16

Hi folks, When I do an “options licensed_feature.disk_sanitization.enable on”, I get a message asking me to confirm “You will not be able to disable this feature, are you sure you wish to continue?” My question is, why wouldn’t I want to enable it? Is there some feature that doesn’t work when sanitization is enabled? Or some other downside to enabling it? I tried to Google for the answer but I didn’t turn up much with the search terms I could think to try. Thanks, Kyle

2 1

"cifs setup" fails with "Setup cannot connect to an LDAP server for the FQDN"
by Momonth 18 Aug '16

18 Aug '16

Hi, I tried to add 8.2.3 7-Mode filer to Windows AD via "cifs setup" wizard, but it's failing with: CIFS - Logged in as username(a)MYDOMAIN.COM *** Setup cannot connect to an LDAP server for the MYDOMAIN.COM *** active directory domain, and so cannot continue. I think the error message is misleading as the filer can talk to LDAP servers (I have multiple domain controllers) and I have a tcpdump that confirms it. >From what I could get from the tcpdump, the filer does the following: 0. Sends DNS request "SRV _ldap._tcp.MYDOMAIN.COM" // + some more DNS requests for "SRV _kerberos" etc. 1 Sends LDAP search query that looks like this: Filter: (&(&(DnsDomain=MYDOMAIN.COM)(Host=FILER-NAME))(NtVer=0x00000006)) Does it try to find itself ? 2. Gets am empty (but successful) response, where "matchedDN" is empty. 3. Sends "abondonRequest" to LDAP server. 4. Sends "unbindRequest to LDAP server. The filer repeats it for all LDAP server it fetched at step 0. and quits with the error. I found the following KBs: https://kb.netapp.com/support/index?page=content&id=2026294&actp=LIST https://kb.netapp.com/support/index?page=content&id=2018207&actp=LIST All my LDAP servers have names that are less than 15 symbols, that's verified. And NetBIOS is not active I was told. Any ideas maybe? Cheers, Vladimir

2 3

DFM 3.2 Protection Polices - Backup Snapshot Policy
by Ray Van Dolson 17 Aug '16

17 Aug '16

We have a Protection Policy with Primary data set to retain backups (snapshots) of two daily's and two weekly's. On the Backup side, we have it set to retain 6 daily's and 12 weekly's (this is all via the GUI). However, on the Backup side, I'm only seeing three snapshots -- one which appears to be the SnapVault base snapshot and two others correlating with today's SnapVault run and yesterday's. There are a good number of Qtrees under this volume, and the various snaps seem to have one of the Qtree names appended, but not all Qtrees are represented. Seems like we must be doing something wrong? Anyone have any ideas? Ray

1 0

8.2 CDOT Snapmirror reverse resync
by BERNTSEN Basil 13 Aug '16

13 Aug '16

Hi folks, If I have volume A on cluster 1 snapmirrored to volume B on cluster 2 and I do the following: * Break the snapmirror relationship * Resync<https://library.netapp.com/ecmdocs/ECMP1366832/html/snapmirror/resync.html> the snapmirror from cluster 1 using the -source-path of cluster 2 volume B (backward from what I just broke) What should happen is that volume B on cluster 2 is now RW, volume A on cluster 1 is DP (read only), and no full sync is done over the replication network, right? That's how it worked in 7-mode, but I haven't done this in CDOT yet. Thanks! Basil ************************************************************************* This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information. Any unauthorized use or dissemination is prohibited. E-mails are susceptible to alteration. Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or falsified. Please visit http://sgasdisclosure.com for important information regarding SG Americas Securities, LLC (“SGAS”). Please visit http://swapdisclosure.sgcib.com for important information regarding swap transactions with SOCIETE GENERALE. *************************************************************************

2 1

ssh timing out (filer high CPU load)
by Edward Rolison 11 Aug '16

11 Aug '16

On the off chance - I'm having trouble with a filer. I can't ssh to it reliably (at all, mostly). I'm pretty sure that's correlated with some high CPU load - my system console has it 'spiked' at >95% for the last 24h, and that's much higher than 'normal'. What i'm not sure of is quite what's causing it - the filer is busy, but not abnormally so. The only thing I can think of that _might_ have changed it, is api calls (qtree-list, get-file-info) - I've recently started doing quota snmp trap enrichment. (but thats 'every few minutes' at most). But otherwise - I'm not sure what might be causing sshd to stall, and if there's a way to 'kick' it? This is a 7 mode filer, on 8.2.1 I've got a case open, but would appreciate any further insight on how to track a high CPU-causing ssh to not respond type issue. I'm pretty sure a failover/failback will do the trick, but that'll have to wait until the weekend - I'd like not to if I can manage it. My current ps list looks like: Process statistics over 67.328 seconds... ID State Domain %CPU StackUsed %StackUsed Name 195 RR N 47% 6928 10% NwkThd_00 196 RR N 47% 7880 12% NwkThd_01 197 RR 0 47% 6928 10% NwkThd_02 223 BR s 7% 7648 46% pmcsas_intrd_1 259 BR e 5% 2440 19% fal_io_thread2 502 BR R 7% 7448 45% raidio_thread 503 BR R 7% 7448 45% raidio_thread 635 BG k 6% 15184 11% snmpd 1614 BR 0 5% 3464 10% ntm_main 1711 RR w 35% 14256 21% wafl_exempt00 1712 BR w 35% 14136 21% wafl_exempt01 1713 BR w 35% 14136 21% wafl_exempt02 2599 BR k 5% 2752 8% gr_scheduler That seems pretty busy for a 4cpu system... Thanks and regards, Ed.

2 5

cdot initial setup help
by Mr. John W. Miller 10 Aug '16

10 Aug '16

Greetings, I have been using Netapp and ONTAP for years. I am new to CDOT. I am setting up a FAS2552 system running NetApp Release v8.3P1. I have a single HA Pair and have created a two node cluster. This should be very simple. I am looking for simple examples of how to initially configure my cluster. Where do I find such examples or templates? thanks

2 1

Snapshot deletion performance impact
by Basil 05 Aug '16

05 Aug '16

Hi folks, I need to delete a bunch of snapshots that were orphaned by CDOT when someone changed the schedule. It's a lot of data- 500gb for a 1tb LUN. How does ontap prioritize releasing these blocks after the delete? What's the best way in 8.2.3 to measure the impact, if any?

2 1

OnTAP + Brocade's Target Driven Zoning (TDZ)
by Momonth 03 Aug '16

03 Aug '16

Hi, I'm looking at simplifying FC zone management. And since I am 100% Brocade shop, then "Target Driven Zoning (TDZ)" sounds like a possible solution - http://www.brocade.com/content/html/en/administration-guide/fos-741-admingu… I couldn't google anything NetApp's OnTAP wise in this regard, so I guess the TDZ is not supported, but maybe I'm missing something here. Does anyone have any experience with $subj? Cheers, Vladimir

1 0

Kerberized NFSv4 in 7-Mode (AD)
by Ray Van Dolson 30 Jul '16

30 Jul '16

Need some guidance in getting this working. Have an 8.2.2P1 7-mode filer, joined to AD (working fine w/ CIFS) and have used 'nfs setup' to enable Kerberized NFS. However, I noticed that no nfs/* entries are present when I run setspn -L <FILER> from a Windows box. I was under the impression that nfs setup should create these? Or, since we're joined to AD already, perhaps the established machine account is sufficient to obtain one on the fly... I have the following export on a volume with ntfs security style: /vol/raytest -sec=krb5:krb5i:krb5p,rw,anon=0,nosuid On my client (RHEL7+SSSD), I'm fairly confident my setup for Kerberos is good. I can SSH in with a Kerberos login, do kinit, etc and connect to other Kerberized services (like doing an ldapearch do AD without being prompted for a password using -Y GSSAPI as long as I have a valid tgt). I've tried my krb5.conf with and without the following: default_tgs_enctypes = RC4-HMAC DES-CBC-MD5 DES-CBC-CRC default_tkt_enctypes = RC4-HMAC DES-CBC-MD5 DES-CBC-CRC preferred_enctypes = RC4-HMAC DES-CBC-MD5 DES-CBC-CRC I also ran 'net ads keytab add nfs' on my client and see that I have a valid nfs/ entry in my machine's keytab file. If I run the following (either as root or as a user -- below is as a user with a valid TGT): $ sudo mount.nfs4 -o vers=4,sec=krb5 red-str-napc2-p12.esri.com:/vol/raytest /mnt/nfs I get a successful mount and also see a valid nfs ticket in klist. However, when I try to cd to /mnt/nfs, I get a "Permission Denied" error. I have rpc.gssd running in the foreground in verbose mode but don't really see anything odd. Wireshark tells me I've asked for read, lookup, modify, extend and delete permissions but that access was denied and only delete was allowed. I can see that the RPC portion of the packets are speaking Kerberos, but I can't tell much more than that. DNS, NTP, etc. is all set up and working on both sides. I've used sectrace on the /vol/raytest path above to try and catch issues, but get no hits making me think it's NFS on the NetApp rejecting things, not the file system layer... fsecurity shows that everything is wide open and from a CIFS client using the same user as on the Linux box, I can create files on the same path with no issues. Kinda stumped at this point. Any suggestions? Ray

3 8

displayed unix permissions on ntfs qtree
by Fred Grieco 22 Jul '16

22 Jul '16

I'm having an issue on the displayed permissions in linux, on an ntfs qtree. This is in cDOT 8.2.3. I have a vserver that's joined to an AD domain and NIS-enabled. Basically, most of the permissions display rwxrwxrwx on the linux, and it's not clear where it's getting these. The NIS/nfs permission themselves are obeyed -- I can only get to where I have access, on the linux side. This is a snapmirrored volume/qtree from a 7-mode filer. It's user directories The linux permissions from the 7-mode filer are almost exclusively rwx------. The ntfs permissions on the source and destinations match, and the NIS/AD/namemapping configs are the same. I"m not sure why it's not displaying the same permissions from linux on the source and destination. Fred

3 7

oracle linux 5.6 iscsi client multipath question
by Natxo Asenjo 18 Jul '16

18 Jul '16

hi, I am migrating 2 7mode iscsi luns to an iscsi svm on a cdot cluster (8.3.2). The migration is fine, I am now testing the luns from the client os (oracle linux 5.6, I do not have any say on the client os,). So I have followed the instructions in here: https://library.netapp.com/ecmdocs/ECMP1654943/html/index.html I see the luns, but now I see 2x 4 luns, because the cdot cluster has 4 iscsi lifs. So I need to configure multipathd. I have this /etc/multipath.conf defaults { user_friendly_names yes } blacklist { devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*" devnode "^sd[a-c]" } multipaths { multipath { wwid 3600a098038303370562b4946426b6742 alias netapp_oracle_recovery } multipath { wwid 3600a098038303370562b4946426b6743 alias netapp_oracle_datafile } devices { device { vendor "NETAPP" product "LUN" path_grouping_policy group_by_prio features "1 queue_if_no_path" prio_callout "/sbin/mpath_prio_alua /dev/%n" path_checker directio path_selector "round-robin 0" failback immediate hardware_handler "1 alua" rr_weight uniform rr_min_io 128 getuid_callout "/sbin/scsi_id -g -u -s /block/%n" } } I blacklist sda, sdb and sdc (local vmware disks). This is the output of multipath -ll: # multipath -ll netapp_oracle_datafile (3600a098038303370562b4946426b6743) dm-3 NETAPP,LUN C-Mode size=350G features='1 queue_if_no_path' hwhandler='0' wp=rw |-+- policy='round-robin 0' prio=4 status=active | |- 6:0:0:1 sdg 8:96 active ready running | `- 3:0:0:1 sdf 8:80 active ready running `-+- policy='round-robin 0' prio=1 status=enabled |- 4:0:0:1 sdj 8:144 active ready running `- 5:0:0:1 sdk 8:160 active ready running netapp_oracle_recovery (3600a098038303370562b4946426b6742) dm-2 NETAPP,LUN C-Mode size=300G features='1 queue_if_no_path' hwhandler='0' wp=rw |-+- policy='round-robin 0' prio=4 status=active | |- 3:0:0:0 sdd 8:48 active ready running | `- 6:0:0:0 sde 8:64 active ready running `-+- policy='round-robin 0' prio=1 status=enabled |- 5:0:0:0 sdh 8:112 active ready running `- 4:0:0:0 sdi 8:128 active ready running And after installing the netapp host tools, this is the output of sanlun lun show -p # sanlun lun show -p ONTAP Path: ALR-SVM-iSCSI:/vol/vol_oracle_datafile/q_oracle_datafile/lun_oracle_datafile LUN: 1 LUN Size: 350.1g Product: cDOT Host Device: netapp_oracle_datafile(3600a098038303370562b4946426b6743) Multipath Policy: round-robin 0 Multipath Provider: Native --------- ---------- ------- ------------ ---------------------------------------------- host vserver path path /dev/ host vserver state type node adapter LIF --------- ---------- ------- ------------ ---------------------------------------------- up primary sdg host6 iscsi_lif02b up primary sdf host3 iscsi_lif02a up secondary sdj host4 iscsi_lif01a up secondary sdk host5 iscsi_lif01b ONTAP Path: ALR-SVM-iSCSI:/vol/vol_oracle_recovery/q_oracle_recovery/lun_oracle_recovery LUN: 0 LUN Size: 300g Product: cDOT Host Device: netapp_oracle_recovery(3600a098038303370562b4946426b6742) Multipath Policy: round-robin 0 Multipath Provider: Native --------- ---------- ------- ------------ ---------------------------------------------- host vserver path path /dev/ host vserver state type node adapter LIF --------- ---------- ------- ------------ ---------------------------------------------- up primary sdd host3 iscsi_lif02a up primary sde host6 iscsi_lif02b up secondary sdh host5 iscsi_lif01b up secondary sdi host4 iscsi_lif01a and this is sanlun lun show: sanlun lun show controller(7mode/E-Series)/ device host lun vserver(cDOT/FlashRay) lun-pathname filename adapter protocol size product ----------------------------------------------------------------------------------------------------------------------------------------------- ALR-SVM-iSCSI /vol/vol_oracle_datafile/q_oracle_datafile/lun_oracle_datafile /dev/sdk host5 iSCSI 350.1g cDOT ALR-SVM-iSCSI /vol/vol_oracle_recovery/q_oracle_recovery/lun_oracle_recovery /dev/sdi host4 iSCSI 300g cDOT ALR-SVM-iSCSI /vol/vol_oracle_datafile/q_oracle_datafile/lun_oracle_datafile /dev/sdj host4 iSCSI 350.1g cDOT ALR-SVM-iSCSI /vol/vol_oracle_recovery/q_oracle_recovery/lun_oracle_recovery /dev/sdh host5 iSCSI 300g cDOT ALR-SVM-iSCSI /vol/vol_oracle_datafile/q_oracle_datafile/lun_oracle_datafile /dev/sdf host3 iSCSI 350.1g cDOT ALR-SVM-iSCSI /vol/vol_oracle_datafile/q_oracle_datafile/lun_oracle_datafile /dev/sdg host6 iSCSI 350.1g cDOT ALR-SVM-iSCSI /vol/vol_oracle_recovery/q_oracle_recovery/lun_oracle_recovery /dev/sde host6 iSCSI 300g cDOT ALR-SVM-iSCSI /vol/vol_oracle_recovery/q_oracle_recovery/lun_oracle_recovery /dev/sdd host3 iSCSI 300g cDOT In /dev/mapper I see this: ls -l /dev/mapper/ total 0 crw------- 1 root root 10, 62 Jul 13 14:00 control brw-rw---- 1 root disk 253, 3 Jul 13 14:01 netapp_oracle_datafile brw-rw---- 1 root disk 253, 4 Jul 13 14:01 netapp_oracle_datafilep1 brw-rw---- 1 root disk 253, 2 Jul 13 14:01 netapp_oracle_recovery brw-rw---- 1 root disk 253, 5 Jul 13 14:01 netapp_oracle_recoveryp1 brw-rw---- 1 root disk 253, 0 Jul 13 14:00 VolGroup00-LogVol00 brw-rw---- 1 root disk 253, 1 Jul 13 14:00 VolGroup00-LogVol01 Is this ok? What do I have to use in /etc/fstab? /dev/mapper/netapp_oracle_datafile en /dev/mapper/netapp_oracle_recovery? Or am I doing something terribly wrong. I called with support but as this is no break or fix stuff, they recommend calling professional services ... Apologies for the wall of text. Thanks in advance. -- Groeten, natxo

2 3

cDOT cluster replication aka peering via specific LIFs
by Momonth 13 Jul '16

13 Jul '16

Hi All, I have two production cDOT clusters out of 8 nodes in two DCs, running OnTAP 8.3.2. I ended up having a bit of a weird network topology where 6 nodes (3 pairs) are only 1Gb enabled and 2 nodes (1 pair) are 10Gb enabled. I wonder how can I enforce cluster peering traffic via those 10Gb enabled nodes? I know that I have to have ICL LIFs on every node in the clusters, and that's fine, I can do that, but would like to set something like a preference for ICL traffic to flow via 10Gb enabled LIFs. Cheers, Vladimir

5 20

is this a bug ?
by Peter D. Gray 11 Jul '16

11 Jul '16

Hi guys I am running 8.2.3 cluster mode. We usually run 30 days of daily snaps on our volumes. We also use snapmirror dr extensively. What I am noticing is that we are missing daily snapshots with regularity. I think the problem is that than the time for dailys rolls around, if the volumes are involved in a snapmirror operation at the time, the daily snap is missed. Anybody seen this and if so, is it a known bug or is this documented behaviour or am I barking up the wrong tree entirely? Regards, pdg

3 2

cDOT .snapshot access over NFS?
by andrei.borzenkov＠ts.fujitsu.com 10 Jul '16

10 Jul '16

I always configured 7-Mode systems with "nosnapdir on" (because quite a lot of programs were confused by .snapshot directory and its content) but still was able to explicitly mount any snapshot for purposes of restore. This seems to be no more possible in cDOT - snapdir-access is apparently all or nothing for NFS clients; either I can mount snapshots but also get .snapshot visible, or .snapshot is hidden but then I cannot mount them. This is different in case of CIFS where access and visibility are controlled separately. I just verified that this is still the case under ONTAP 9.0RC1. Anyone knows some (hidden) knob that provides 7-Mode semantic on NFS? Thank you! --- With best regards Andrei Borzenkov Senior system engineer FTS WEMEAI RUC RU SC TMS FOS FUJITSU Zemlyanoy Val Street, 9, 105 064 Moscow, Russian Federation Tel.: +7 495 730 62 20 ( reception) Mob.: +7 916 678 7208 Fax: +7 495 730 62 14 E-mail: Andrei.Borzenkov(a)ts.fujitsu.com Web: ru.fujitsu.com Company details: ts.fujitsu.com/imprint This communication contains information that is confidential, proprietary in nature and/or privileged. It is for the exclusive use of the intended recipient(s). If you are not the intended recipient(s) or the person responsible for delivering it to the intended recipient(s), please note that any form of dissemination, distribution or copying of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender and delete the original communication. Thank you for your cooperation. Please be advised that neither Fujitsu, its affiliates, its employees or agents accept liability for any errors, omissions or damages caused by delays of receipt or by any virus infection in this message or its attachments, or which may otherwise arise as a result of this e-mail transmission.

1 0

OnTap read block size?
by Rhodes, Richard L. 06 Jul '16

06 Jul '16

OnTap 8.1.2p1 Our DBA's are complaining that our nSeries (N3220/FAS2240) is reading really slow due to it only returning small 16k blocks. The DBA's are saying the Oracle multi-block read ahead should be reading 128 x 16k blocks = 2m read, but it's only seems to be reading/returning 16k at a time. On a AIX filesystem mounted CIO, if I run "dd if=/dev/zero of=z bs=1m count=9999" I see writes of 500k. In the same filesystem mounted CIO, if I read an existing db file "dd if=<dbfile> of=/dev/null bs=1m" I see reads of up to 30k. Q) Is there a limit in OnTap on read size? Thanks Rick ----------------------------------------- The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.

6 9

Intercluster lifs use an ifgroup but and local target is itself
by Joel Krajden 04 Jul '16

04 Jul '16

There were warnings the last time I upgraded cDOT from 8.3.2RC2 to 8.3.2 GA and again when going from 8.3.2GA to 8.3.2P1 The warnings had no errors associate with them and the upgrade failover/giveback completed without any problems. I wonder if the warnings are related to the fact that each node in the HA cluster has an an ifgroup using two 10G physical ports. The ifgroup a0a is shared using one vlan for the data lifs, and another vlan for the IC lifs. The data lifs failover to the other node's data lifs but the IC lifs failover to the local node where the target is itself. The network infrastructure between the separate buildings where the second cluster lives is such that we cannot use another set of physical ports for the intercluster lifs on the node. Are the vague warnings when upgrading hinting that this is not an optimal configuration? fc1-ev::> network interface show -vserver uperc -lif email.filers -failover Logical Home Failover Failover Vserver Interface Node:Port Policy Group -------- --------------- --------------------- --------------- --------------- uperc email.filers fc1-ev-n2:a0a-539 system-defined DATA_PUB Failover Targets: fc1-ev-n2:a0a-539, fc1-ev-n1:a0a-539 fc1-ev::> network interface show -role intercluster -failover * Logical Home Failover Failover Vserver Interface Node:Port Policy Group -------- --------------- --------------------- --------------- --------------- fc1-ev fc1-ev-n1_ic1 fc1-ev-n1:a0a-736 local-only IC Failover Targets: fc1-ev-n1:a0a-736 fc1-ev-n2_ic1 fc1-ev-n2:a0a-736 local-only IC Failover Targets: fc1-ev-n2:a0a-736 -- Joel Krajden: Core Technologies Manager Engineering & Computer Science Concordia University EV-8.142 Tel: 514 848-2424 3052 joelk(a)encs.concordia.ca

4 8

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters