Our experience is similar to your, Daniel, except that we do not use RAQ or Linux.

I would not say our DBA team resisted the idea - merely that they were hesitant that it would actually work. They're good guys and paid to be cautious.

Brian Dunbar Systems Administrator Plexus Desk: (920) 751-3364 Cell: (920) 716-2027

-----Original Message----- From: owner-toasters@mathworks.com on behalf of Leeds, Daniel Sent: Wed 10/17/2007 10:08 AM To: Page, Jeremy; toasters@mathworks.com Subject: RE: Oracle on Netapp

We have over 30 oracle database instances running on both linux and solaris over gigabit nfs. Some are standalone and others raq clusters. There is a product from netapp called snapmanager for oracle but we currently do not use it, instead we just utilize scripts that either put the instance in hot backup mode or brings the db down for cold backup and then initiates a snapshot on the filer. We snapvault the primary snapshot data to a secondary R200 as well.

This scenario works flawlessly and anything from single file restores to entire volume restores take seconds and always work. There was a bit of hesitation implementing this at first but the first time you recover a database completely in under a minute your DBA's will be on board.

--daniel

-- Daniel Leeds Manager, Storage Operations Edmunds, Inc. 1620 26th Street, Suite 400 South Santa Monica, CA 90404

310-309-4999 desk 310-430-0536 cell

-----Original Message----- From: owner-toasters@mathworks.com on behalf of Page, Jeremy Sent: Wed 10/17/2007 5:05 AM To: toasters@mathworks.com Subject: Oracle on Netapp

Looking for someone out there with some experience with pSeries + Oracle. Is SnapVault, SnapMirror, Snapshot used as common replication tools for Oracle in the General Public versus native Oracle Replication or Snapshots? Long ago we also looked at Native clustering / replication tools at the P-Series level. Just curious on how many companies use the SAN replication tools for Oracle. I'd appreciate any insight you might have and I'll try and do some research on this.

From a storage admin side I was assuming it's as simple as creating a shell script that quiesces Oracle, takes a snapshot and then lets Oracle move on with it's life, am I missing something?

-Jeremy

This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

We have several DB's running as single instance but we also have a lot of RAC Clusters. Both installations are based on Linux. The experience we got with oracle on netapp is quite good, but with our RAC's we didn't make the best experiences. Backing up Oracle DB's on NFS with snapshot technology is very handsome. As mentioned recovering a full DB under a minute is nearly unbeatable. We use self written scripts to backup DB's and their archive logs.

What are your experiences with rac clusters over gigabit nfs? What kind of filers do you use? I would be interested in some details of you environement with Oracle RAC on Linux and NetApp. Today we are in discussion of response times and throughput rates. I would like to share some experiences.

Regards Andreas -----Original Message----- From: owner-toasters@mathworks.com on behalf of Leeds, Daniel Sent: Wed 10/17/2007 10:08 AM To: Page, Jeremy; toasters@mathworks.com Subject: RE: Oracle on Netapp

We have over 30 oracle database instances running on both linux and solaris over gigabit nfs. Some are standalone and others raq clusters. There is a product from netapp called snapmanager for oracle but we currently do not use it, instead we just utilize scripts that either put the instance in hot backup mode or brings the db down for cold backup and then initiates a snapshot on the filer. We snapvault the primary snapshot data to a secondary R200 as well.

This scenario works flawlessly and anything from single file restores to entire volume restores take seconds and always work. There was a bit of hesitation implementing this at first but the first time you recover a database completely in under a minute your DBA's will be on board.

--daniel

-- Daniel Leeds Manager, Storage Operations Edmunds, Inc. 1620 26th Street, Suite 400 South Santa Monica, CA 90404

310-309-4999 desk 310-430-0536 cell

-----Original Message----- From: owner-toasters@mathworks.com on behalf of Page, Jeremy Sent: Wed 10/17/2007 5:05 AM To: toasters@mathworks.com Subject: Oracle on Netapp

Looking for someone out there with some experience with pSeries + Oracle. Is SnapVault, SnapMirror, Snapshot used as common replication tools for Oracle in the General Public versus native Oracle Replication or Snapshots? Long ago we also looked at Native clustering / replication tools at the P-Series level. Just curious on how many companies use the SAN replication tools for Oracle. I'd appreciate any insight you might have and I'll try and do some research on this.

From a storage admin side I was assuming it's as simple as creating a shell script that quiesces Oracle, takes a snapshot and then lets Oracle move on with it's life, am I missing something?

-Jeremy

This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.

i thought DNFS bypassed the kernel nfs calls/overhead. what i see below just looks like subnetting your nfs traffic to a dedicated interface which many folks already do out of best practices.

also DNFS is not available in 10g RAC correct? i thought it was a new 11g feature

-- Daniel Leeds Manager, Storage Operations Edmunds, Inc. 1620 26th Street, Suite 400 South Santa Monica, CA 90404

310-309-4999 desk 310-430-0536 cell

-----Original Message----- From: Joe Bishop [mailto:jbishop@west.net] Sent: Sat 12/15/2007 4:06 PM To: toasters@mathworks.com Subject: Oracle Direct NFS client Re: Oracle on Netapp seemless redundant NFS mounts

Dear Toasters.

A performance and availability tip for anyone running Oracle on Netapp.

This is especially true for people running Linux out there with Oracle on NetApp.

To keep the performance of your Oracle Database fast while performing other high loaded NFS operations, consider Oracle's Direct NFS client.

Why have one NFS mount when you can have 16? And if that isn't good enough, how about another 16 on a second dedicated subnet?

Oracle has created the Direct NFS client to provide greater reliability of an available NFS connection through the redundant direct NFS mounts.

Here is an example...

NetApp Server eth8 10.0.0.100 ..................[common 10.0.0.0 switch].................... other n-tier traffic eth9 10.100.0.100 ..............[private 10.100.0.0. NetApp traffic switch]

export /vol/vol1/oradata 10.0.0.200,10.100.0.200 rw,root

DBServer eth0 10.0.0.200 ...............[common 10.0.0.0 switch] eth1 10.100.0.200 ............[private 10.100.0.0 NetApp traffic switch]

/etc/fstab

10.0.0.100:/vol/vol1/oradata /oradata

/etc/oranfstab server:dnfsnetapp path:10.0.0.200 path:10.100.0.200 export:/vol/vol1/oradata mount:/oradata

NOTE: remember to adjust the libodm* files Linux command set is

<shtudown DB>

localhost]# cd $ORACLE_HOME/lib localhost]# mv libodm11.so libodm11.so_stub localhost]# ln -s libnfsodm11.so libodm11.so

<startup DB>

At this point you will see the Oracle DNFS mount

select * from v$dnfs_servers; ID SVRNAME DIRNAME MNTPORT NFSPORT WTMAX RTMAX ---------- --------------- ------------------------ ---------- ---------- ---------- ---------- ---------- ---------- 1 dnfsnetapp /vol/vol1/oradata 4046 2049 32768 32768

And the new connections (DNFS exclusive 10.100.0.0 subnet count 16 -e9 entries) on the NETAPP using netstat

With two subnets, you have eliminated any single point of failure between your database and the Filer.

And you might want to retry that RAC setup with the DNFS.

Cheers,

Joe Bishop