toasters

toasters@lists.teaparty.net

3 participants
13534 discussions

RE: Filer storage for databases, seriously? (Was: Re: NetApp questions)
by Brian Hostetter 09 Aug '00

09 Aug '00

Getting back to the issue at hand. I am running oracle 8.1.5 on a 740 right now. I will be moving it to a 760 over the next few months. I have had nothing but incredible performance from my filers. We had a few problems moving oracle to nfs, first off Oracle consulting was here telling there is no way you can run it on nfs. It physically would not work they told me. It took me all of 2 hours of work to prove them wrong. The only issue we have run into is nfs locking problems with Digital Unix. As for performance, I noticed a huge increase in performance when moving from a local raid5 system to a netapp. Sure I took a hit from NFS, but I also got a huge gain from the speed of the filesystem. I loaded up my server with enough ram to cache the entire database now, so I don't really see any NFS problems, which makes the netapp even better since I can snapshot the databse for full backups in about 45 seconds. All in all, I would never run oracle again on anything but a filer. Course I never run any apps that are not on a filer. --Brian >>> <rdobbins(a)netmore.net> 08/08 8:46 PM >>> No one thoughout recorded history, apart from assorted nuts, has ever believed that the Earth was flat; Eratosthenes calculated both its circumference to within 1% of the true value as well its tilt relative to the plane of the ecliptic no later than 200 B.C. The only real problem was that of terra incognita - i.e., nobody knew exactly where the landmasses were located until a) someone sailed there, and b) accurate chronometers were developed by John Harrison in the 18th Century, enabling navigators to calculate longitude with a high degree of accuracy, and then relay that information to cartographers. Advances in spherical geometry a la Mercator assisted the latter group, of course. Historical canards aside, let me restate that I'm very interested in hearing about production experience with NetApp filers and Oracle over NFS. I've a 740 with a Gigabit Ethernet interface, plugged into a Catalyst 5509 doing MPLS, and so would be willing to entertain the notion if someone can give me anything beyond benchmarks. I know all about snapshots and all that, by the bye. It's -performance- which is the question. Thanks for the pointer to the link, I'll be sure and check it out. ----------------------------------------------------------- Roland Dobbins <rdobbins(a)netmore.net> // 818.535.5024 voice -----Original Message----- From: Keith Brown [mailto:keith@netapp.com] Sent: Tuesday, August 08, 2000 5:48 PM To: rdobbins(a)netmore.net; Perry.Jiang(a)bmo.com Cc: toasters(a)mathworks.com Subject: Filer storage for databases, seriously? (Was: Re: NetApp questions) > As to running Oracle with the data and logfiles on a filer via NFS, > I should think that even with a NetApp using Gigabit Ethernet, > you'd take a -huge- performance hit as compared to a local > disk array. Beware conventional wisdom Roland. People used to think the Earth was flat too. :-) While I wouldn't be so bold as to *guarantee* performance boosts in utilizing the filer storage approach for every database application under the Sun, the simple fact is that filers contain a myriad of features that are very attractive to the database market, and NetApp now draws a significant and growing portion of its revenues from this space. Snapshots & SnapRestore greatly simplify and enhance database backup and restore environs. The WAFL RAID design puts failure resiliancy into the disk subsystem without forcing you take the performance hits inherent in general purpose RAID-5 designs or going to disk-doubling RAID-1 approaches. SnapMirror gives you database replication to offsite locations for disaster recovery purposes. WAFL's ready expandibility lets you make room for growing databases without disrupting their operation. The list goes on... Oh.. and yes... performance very often gets a shot in the arm too! > I've no empirical data > to back this up, mind you; Don't worry. Nobody ever does, not even our direct-attach competitors, not that they can be too harshly criticized. Meaningful performance comparisons are tricky to architect, usually have a short shelf life, and customers have an understandable tendency not to believe vendor funded benchmarks anyway (due to the fact that the vendor performing and/or funding the benchmark almost always wins!). Nevertheless, we did publish a relatively innocuous one some time ago, which can be viewed here: http://www.netapp.com/tech_library/3044.html > it's just that there's so much overhead > associated with NFS even on an optimized platform > like the NetApp filer, I can't see it as being a win. There are certainly some "swings-and-roundabouts"-type things to consider when looking at the two approaches, and some people do conclude that there is more overhead in the network attach approach, dismissing it offhand. However, as far as performance goes, all the theory in the world is no substitute for the practical experience that could be gained by trying a solution for the application you have and actually bearing witness to how well it works and what it performs like. > If there's anyone out there with Oracle experience on filers > via NFS, either pro or con, I'd love to hear from you. I'm hoping there will be some on this list. As I mentioned, beware conventional wisdom. America might have been discovered hundreds of years before Columbus sailed over the horizon, if only all his ancestors hadn't been terrified of falling off the edge of the world! Keith

1 0

RE: Filer Performance in a CIFS environment
by vance＠corp.theglobe.com 09 Aug '00

09 Aug '00

Mike- We are heavy CIFS users in an NT4, IIS, 100 Mb switched environment with several F740's and F760's, and we do not see this kind of problem. We routinely run at hundreds of files per second with latencies more in subsecond range for any file under a few hundred kB. WINS problems, Ethernet duplex settings, or domain controller problems are the only things I can think of which would result in the kind of performance you describe unless the filer or the webservers are completely overloaded. Of course, we've never tried to do what you are doing on W2K. Good luck, and please let the list know what happens. I hope for all of us that what you are seeing is not a W2K compatibility issue. Vance > -----Original Message----- > From: Mike Hopkins [mailto:Mike@broaddaylight.com] > Sent: Monday, August 07, 2000 11:38 PM > To: 'toasters(a)mathworks.com' > Subject: Filer Performance in a CIFS environment > > > I know this is a generalized question where the answer is shaped by a > basketful of variables, but I need to start somewhere. I > have a Filer 740 > that I am using to store files for a Win2000 web server. > > Pages served up by this combination of hardware are > noticeably slower(5 to > 10 seconds versus 1 second) than storing the web content on > the local drive > of the web server. This may not seem like much of a > slowdown, but people > notice these things and it is a big issue. > > So, what are some of the things that cause performance hits in a CIFS > environment. Any suggestions, war stories, magic potions, or good old > fashioned know-how is greatly appreciated. > > > > Mike Hopkins > Broad Daylight, Inc. >

1 0

RE: move command on filer?
by rdobbins＠netmore.net 09 Aug '00

09 Aug '00

Could NDMP be used to copy files to a tape drive hanging off the SCSI port on a filer, or is it strictly limited to the filesystem? -----Original Message----- From: Agnew, Blaine [mailto:Blaine.Agnew@netapp.com] Sent: Tuesday, August 08, 2000 4:59 PM To: ''Nick.Mayrath(a)envoy.com' '; 'toasters(a)mathworks.com ' Subject: RE: move command on filer? NDMPCopy can be handy for this sort of application, however I don't know if someone has ported it to NT yet. It is a freeware utility that runs on the host and controls the filer via NDMP commands. It is similar to having a dump piped through to a restore, except that the data does not have to go through your host. You can get the source from www.ndmp.org if you want to get more information. -----Original Message----- From: Muhlestein, Mark To: 'Nick.Mayrath(a)envoy.com'; toasters(a)mathworks.com Sent: 8/8/00 4:23 PM Subject: RE: move command on filer? If the files are in the same qtree the moves will be fast because this is just a rename; there is no need to copy the data. If not, you will have to copy the files. There is currently no way to do that locally on the filer. Mark -----Original Message----- From: Nick.Mayrath(a)envoy.com [mailto:Nick.Mayrath@envoy.com] Sent: Friday, August 04, 2000 4:07 PM To: toasters(a)mathworks.com Subject: move command on filer? This weekend I need to move alot of files around of my F720. Is there any "move" command locally on the filer that I can use instead of using my NT machine? My concern is that using the NT machine will cause the moves to take longer since they have to "pass through" my NT box. Thanks

2 1

RE: Filer storage for databases, seriously? (Was: Re: NetApp ques tions)
by rdobbins＠netmore.net 09 Aug '00

09 Aug '00

No one thoughout recorded history, apart from assorted nuts, has ever believed that the Earth was flat; Eratosthenes calculated both its circumference to within 1% of the true value as well its tilt relative to the plane of the ecliptic no later than 200 B.C. The only real problem was that of terra incognita - i.e., nobody knew exactly where the landmasses were located until a) someone sailed there, and b) accurate chronometers were developed by John Harrison in the 18th Century, enabling navigators to calculate longitude with a high degree of accuracy, and then relay that information to cartographers. Advances in spherical geometry a la Mercator assisted the latter group, of course. Historical canards aside, let me restate that I'm very interested in hearing about production experience with NetApp filers and Oracle over NFS. I've a 740 with a Gigabit Ethernet interface, plugged into a Catalyst 5509 doing MPLS, and so would be willing to entertain the notion if someone can give me anything beyond benchmarks. I know all about snapshots and all that, by the bye. It's -performance- which is the question. Thanks for the pointer to the link, I'll be sure and check it out. ----------------------------------------------------------- Roland Dobbins <rdobbins(a)netmore.net> // 818.535.5024 voice -----Original Message----- From: Keith Brown [mailto:keith@netapp.com] Sent: Tuesday, August 08, 2000 5:48 PM To: rdobbins(a)netmore.net; Perry.Jiang(a)bmo.com Cc: toasters(a)mathworks.com Subject: Filer storage for databases, seriously? (Was: Re: NetApp questions) > As to running Oracle with the data and logfiles on a filer via NFS, > I should think that even with a NetApp using Gigabit Ethernet, > you'd take a -huge- performance hit as compared to a local > disk array. Beware conventional wisdom Roland. People used to think the Earth was flat too. :-) While I wouldn't be so bold as to *guarantee* performance boosts in utilizing the filer storage approach for every database application under the Sun, the simple fact is that filers contain a myriad of features that are very attractive to the database market, and NetApp now draws a significant and growing portion of its revenues from this space. Snapshots & SnapRestore greatly simplify and enhance database backup and restore environs. The WAFL RAID design puts failure resiliancy into the disk subsystem without forcing you take the performance hits inherent in general purpose RAID-5 designs or going to disk-doubling RAID-1 approaches. SnapMirror gives you database replication to offsite locations for disaster recovery purposes. WAFL's ready expandibility lets you make room for growing databases without disrupting their operation. The list goes on... Oh.. and yes... performance very often gets a shot in the arm too! > I've no empirical data > to back this up, mind you; Don't worry. Nobody ever does, not even our direct-attach competitors, not that they can be too harshly criticized. Meaningful performance comparisons are tricky to architect, usually have a short shelf life, and customers have an understandable tendency not to believe vendor funded benchmarks anyway (due to the fact that the vendor performing and/or funding the benchmark almost always wins!). Nevertheless, we did publish a relatively innocuous one some time ago, which can be viewed here: http://www.netapp.com/tech_library/3044.html > it's just that there's so much overhead > associated with NFS even on an optimized platform > like the NetApp filer, I can't see it as being a win. There are certainly some "swings-and-roundabouts"-type things to consider when looking at the two approaches, and some people do conclude that there is more overhead in the network attach approach, dismissing it offhand. However, as far as performance goes, all the theory in the world is no substitute for the practical experience that could be gained by trying a solution for the application you have and actually bearing witness to how well it works and what it performs like. > If there's anyone out there with Oracle experience on filers > via NFS, either pro or con, I'd love to hear from you. I'm hoping there will be some on this list. As I mentioned, beware conventional wisdom. America might have been discovered hundreds of years before Columbus sailed over the horizon, if only all his ancestors hadn't been terrified of falling off the edge of the world! Keith

3 2

RE: NetApp questions
by Mohler, Jeff 09 Aug '00

09 Aug '00

No, filers do not support scp. Files are copied via the clients using thier own scp, and Xfered to the filer using NFS/CIFS. -----Original Message----- From: rdobbins(a)netmore.net [mailto:rdobbins@netmore.net] Sent: Tuesday, August 08, 2000 6:57 PM To: keith(a)netapp.com; toasters(a)mathworks.com Subject: RE: NetApp questions Does the Secure Administration option (i.e., ssh) for filers support scp to copy the /etc/passwd file across, if you're using quotas? -----Original Message----- From: Keith Brown [mailto:keith@netapp.com] Sent: Tuesday, August 08, 2000 4:39 PM To: Jiang, Perry; toasters Subject: Re: NetApp questions > Do I have to create an Oracle account on NetApp Filer > and put the entry in /vol/vol0/etc/passwd? You mean *by* putting an entry into the filer's /etc/passwd file, right? It's always a good idea to keep a filer's notion of /etc/passwd file entries in sync with the rest of your network, but strictly speaking it's not often necessary for basic NFS operation. In fact I am told that in the early years of NetApp, before my time, filers didn't have /etc/passwd files at all. The NFS protocol just deals in UIDs and GIDs, and back then the filer had little need to know what user names and group names were associated with those numbers. These days, there are features in the filer can benefit from knowing about username/UID correlations. The quota subsystem is one that springs immediately to mind. If you have used usernames in your /etc/quotas file for example, the filer needs to know what UIDs it should be looking for in the file system in order to charge space to the specified users quota. The Windows file service networking is another subsystem that can, in certain configurations, make extensive use of /etc/passwd (oddly enough! :-)), although it is also worth pointing out that day-to-day administration of a passwd file is entirely unnecessary when a filer is deployed in a Windows-only environment. So, in summary, in a UNIX environment, I would make a habit of keeping the filer's /etc/passwd file in sync with the rest of the network as a matter of good practice, even though it may not be absolutely necessary. Don't forget that there is NIS client support in a filer to help you out in this area. Keith

1 0

RE: NetApp questions
by rdobbins＠netmore.net 09 Aug '00

09 Aug '00

Does the Secure Administration option (i.e., ssh) for filers support scp to copy the /etc/passwd file across, if you're using quotas? -----Original Message----- From: Keith Brown [mailto:keith@netapp.com] Sent: Tuesday, August 08, 2000 4:39 PM To: Jiang, Perry; toasters Subject: Re: NetApp questions > Do I have to create an Oracle account on NetApp Filer > and put the entry in /vol/vol0/etc/passwd? You mean *by* putting an entry into the filer's /etc/passwd file, right? It's always a good idea to keep a filer's notion of /etc/passwd file entries in sync with the rest of your network, but strictly speaking it's not often necessary for basic NFS operation. In fact I am told that in the early years of NetApp, before my time, filers didn't have /etc/passwd files at all. The NFS protocol just deals in UIDs and GIDs, and back then the filer had little need to know what user names and group names were associated with those numbers. These days, there are features in the filer can benefit from knowing about username/UID correlations. The quota subsystem is one that springs immediately to mind. If you have used usernames in your /etc/quotas file for example, the filer needs to know what UIDs it should be looking for in the file system in order to charge space to the specified users quota. The Windows file service networking is another subsystem that can, in certain configurations, make extensive use of /etc/passwd (oddly enough! :-)), although it is also worth pointing out that day-to-day administration of a passwd file is entirely unnecessary when a filer is deployed in a Windows-only environment. So, in summary, in a UNIX environment, I would make a habit of keeping the filer's /etc/passwd file in sync with the rest of the network as a matter of good practice, even though it may not be absolutely necessary. Don't forget that there is NIS client support in a filer to help you out in this area. Keith

1 0

RE: move command on filer?
by Agnew, Blaine 09 Aug '00

09 Aug '00

NDMPCopy can be handy for this sort of application, however I don't know if someone has ported it to NT yet. It is a freeware utility that runs on the host and controls the filer via NDMP commands. It is similar to having a dump piped through to a restore, except that the data does not have to go through your host. You can get the source from www.ndmp.org if you want to get more information. -----Original Message----- From: Muhlestein, Mark To: 'Nick.Mayrath(a)envoy.com'; toasters(a)mathworks.com Sent: 8/8/00 4:23 PM Subject: RE: move command on filer? If the files are in the same qtree the moves will be fast because this is just a rename; there is no need to copy the data. If not, you will have to copy the files. There is currently no way to do that locally on the filer. Mark -----Original Message----- From: Nick.Mayrath(a)envoy.com [mailto:Nick.Mayrath@envoy.com] Sent: Friday, August 04, 2000 4:07 PM To: toasters(a)mathworks.com Subject: move command on filer? This weekend I need to move alot of files around of my F720. Is there any "move" command locally on the filer that I can use instead of using my NT machine? My concern is that using the NT machine will cause the moves to take longer since they have to "pass through" my NT box. Thanks

1 0

NetApp questions
by Jiang, Perry 09 Aug '00

09 Aug '00

Hi, there I have a question regarding NetApp Filer 740. Oracle account I am running a Solaris Oracle server, which is a NFS client of the NetApp Filer. Do I have to create an Oracle account on NetApp Filer and put the entry in /vol/vol0/etc/passwd? If yes, what the purpose of that? An on-line NetApp document, "Oracle for UNIX: Integrating with a NetApp Filer", stated that you need to create an Oracle account on Filer. However, according to the System Admin. Guide, /vol/vol0/etc/passwd is only for CIFS, not for NFS. You explaination is appreciated. Perr Jiang

2 1

Backup and quick restore from Workstation Solutions
by Klaus Schoellhorn 09 Aug '00

09 Aug '00

Dear Reader, does anyone have experience with Quick Restore from www.worksta.com ? I would appreciate if there is anyone who wants to bring me up to speed where the caveats are ? I define caveats as pro's and cons as well as restore performance considerations Thanks a lot Klaus

1 0

RE: move command on filer?
by Muhlestein, Mark 09 Aug '00

09 Aug '00

If the files are in the same qtree the moves will be fast because this is just a rename; there is no need to copy the data. If not, you will have to copy the files. There is currently no way to do that locally on the filer. Mark -----Original Message----- From: Nick.Mayrath(a)envoy.com [mailto:Nick.Mayrath@envoy.com] Sent: Friday, August 04, 2000 4:07 PM To: toasters(a)mathworks.com Subject: move command on filer? This weekend I need to move alot of files around of my F720. Is there any "move" command locally on the filer that I can use instead of using my NT machine? My concern is that using the NT machine will cause the moves to take longer since they have to "pass through" my NT box. Thanks

1 0

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters