Hi Dan and all - thanks for the great info!

We'll check out dnfs and I've downloaded Netapp's SIO tool

Will check 
Flow Control (this is usually an issue if you see 10g/1g buffer overruns which could be the case since our 3270 is 10g and this client is 1g…)
test Jumbo Frames (this is challenging since it requires end to end Netapp<==switch==>client config and not all clients can/will do jumbo - bu maybe there is a hybrid where some clients are jumbo and others not?)

Which nfsiostat tool are you referring to?


I've also engaged  Confio with their Ignite trial (which I've used to help refute server/storage vs app/oracle wait times - highly recommend it) 
 

thanks again

On Mar 28, 2012, at 8:03 PM, Daniel Brown wrote:

If this is oracle 11g, use dnfs. It will avoid mount option questions, as well as any weirdness at the kernel Nfs level. The noatime and actimeo=0 can make a big difference. Really simple to get dnfs setup. 

Double check mount options, looking for differences with rac vs single instance. You didn't say, and I know the docs differ for each, but aren't always very clear. go with the NetApp kb article settings. 

Check jumbo frames. You probably want them. 

Look at network Configs. We just worked on one where the issue was flow control at the network level. Getting that set right meant things worked lots better. There is a NetApp kb about it.

Test with netapps sio tool. Note that oracle mostly uses direct io to bypass os level caching. Os level tools like dd or copy won't. NetApp sio offers it as an option. 

Install the nfsiostat tools to monitor what's going on. 



--
Dan Brown

On Mar 28, 2012, at 7:42 PM, Fletcher Cocquyt <fcocquyt@stanford.edu> wrote:

Hi, I'm not seeing write performance issues on the OS (throughput tests on the command line are > 100Mb/sec)

But Oracle is complaining about long commit times for the Netapp NFS mount with the following options:

rw,noatime,bg,hard,nointr,tcp,nfsvers=3,timeo=600,rsize=32768,wsize=32768 (matches what I see in Oracle and Netapp docs)

I'm working with the DBA to see if the Oracle tuning is optimal, but thought I'd poll this list for any nuggets of tuning Oracle on Netapp NFS

And the disk busy on this aggregate is only 10% - and the CPU reads 40-50%

thanks!

Fletcher 

_______________________________________________
Toasters mailing list
Toasters@teaparty.net
http://www.teaparty.net/mailman/listinfo/toasters