Hi Jeremy,
if you buy a PAM card for one of your controllers you always should buy one for the other controller too. It will speed up your Oracle random reads at normal operation as well as help you facing a performance problem if the filesystem/VM- controller with the PAM card fails and your database controller has to handle all your IO.
PAM is short for Performance Accelerator Modul. There are two flavours: PAM-I and PAM-II. PAM-II is of greater cache size but has a slower access time than PAM-I. As far as I know PAM-II is not supported with your version of DataONTAP but please check this with NetApp.
You may send your flexscale-pcs statistics to NetApp (perhaps with a perfstat). They can analyze this and tell you what PAM card would best fit to your IO profile or if you best add more spindles. Furthermore they can help you with your Oracle performance issue.
Regarding your Oracle performance issues: It may be helpful to check if you encounter the performance issue only in your database instances or if your host filesystem in the LUN is slow too. For this you can use "dd" (on UNIX) to generate a serial write or read IO on your LUN. You may test with different block sizes. Please be sure to include the blocksize of your Oracle instance in the tests. Well, I know that nobody (especially NetApp) likes dd to test performance of a LUN. But it's easy to use, always at hand and my experience is that if dd is slow other performance is not very much better. If your performance without Oracle is acceptable (what I expect) then you can look at the Oracle SGA. Increasing this may help to cache more data on your host and decrease IO. You should analyze your select statements, too. If you see a lot of full table scans then you can use indexes to avoid those. But for this you best have an Oracle DBA at hand.
Best Regards
i. A. Dipl.-Inform. (FH) Walter J. Kießl
------------------------------------------------------------ mailto:kiessl@heidenhain.de tel.: +49 8669 31 1954 fax: +49 8669 32 1954 ------------------------------------------------------------
DR. JOHANNES HEIDENHAIN GmbH Dr.-Johannes-Heidenhain-Str. 5 83301 Traunreut, Deutschland http://www.heidenhain.de/
Von: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] Im Auftrag von Page, Jeremy Gesendet: Montag, 22. Februar 2010 21:38 An: Romeo Theriault Cc: toasters@mathworks.com Betreff: (WARNING!!! S/MIME with incorrect signature) RE: PAM cards or disks and some questions about the impact of running with PAM
I've checked the latency on both the host side (nmon) and at the disk level (statit). I am pretty sure they are ok, reads never go higher than 4ms and writes are in the 1ms range (on disk) and from the AIX side it's not much worse except for a few specific file systems. I want the PAM II cards for my VMs and shares (other controller) more than Oracle but I wanted to make sure I was not missing a glaring IO problem on the DB side before I got something that does not make any difference for writes.
The SATA disks holding my VMs are crying out for PAM relief and like you said it won't (shouldn't) hurt for Oracle. I want to make sure that I am doing due dilligance (as far as I can with out access to the data on the Oracle side anyways) so the folks who I provide storage to are comfortable I am making the right choice.
Thanks for all the feedback, I am learning a lot which is always good.
________________________________ From: Romeo Theriault [mailto:romeotheriault@gmail.com] Sent: Monday, February 22, 2010 1:39 PM To: Page, Jeremy Cc: toasters@mathworks.com Subject: Re: PAM cards or disks and some questions about the impact of running with PAM
On Tue, Feb 23, 2010 at 1:35 AM, Page, Jeremy <jeremy.page@gilbarco.commailto:jeremy.page@gilbarco.com> wrote: I read that, unfortunately I am not at 7.3.2 yet, I do get the counters but the format is a bit old.
My disk utilization rarely goes above 25%
Here's what I see but since I'm not at 7.3.2 the numbers may be misleading, I don't know. array01*> stats show -p flexscale-pcs Instance Blocks Usage Hit Miss Hit Evict Invalidate Insert --- ec0 4194304 90 11733 3479 77 1748 57 2236 ec1 4194304 38 1203 2275 34 343 401 1748
I'm by no means an expert on any of this and it's the first time I really look at PCS data but it certainly seems like at least the first level of cache (ec0) would help things out with a 90% usage and 11,733 hits but on the other hand a max 25% disk utilization doesn't seem very high to me. You also mentioned to me that your cache age is a fairly good size too. So, I'm not really sure. It certainly doesn't seem like a PAM card would hurt, that's for sure.
If the only thing noticing a performance issue is the Oracle DB you might want to look at the latency on those volumes.
stats show -i 3 volume:*:avg_latency
or using Performance Advisor.
Romeo </PRE><p> ------------------------------------------------------------------------------------------------------ <br> Registergericht: Traunstein / Registry Court: HRB 275 - Sitz / Head Office: Traunreut <br> Aufsichtsratsvorsitzender / Chairman of Supervisory Board: Rainer Burkhard <br> Geschäftsführung / Management Board: Thomas Sesselmann (Vorsitzender / Chairman),<br> Michael Grimm, Matthias Fauser<br><br> <a href="http://www.heidenhain.de/disclaimer" target="_blank">E-Mail Haftungsausschluss / E-Mail Disclaimer</a><br><pre>