toasters

toasters@lists.teaparty.net

13531 discussions

RE: Running Postgresql with db on Netapp
by Blake, Delroy 19 Sep '03

19 Sep '03

What are the specs on your PC? Say you have an ATA 100 controller and a drive with 8MB ram you can probably get hit a 30MB/s transfer rate while if you are doing nfs over 100 BASET the best you can hope to do is 12MB/s. If you have a PCI 64/66 or PCI-X bus in You may hit transfer rates of over 50-60MB/S with GE in both filer and PC. When your PC needs to read and write data he just does it he does not have to create IP traffic every time. That means he has to do a little more work to transfer using jumbo frames will free up some of this overhead. Its an option to consider. You might also want to dd a 1 GB file over the network using different block size to see what performance you get. -----Original Message----- From: 'Aditya ' [mailto:aditya@grot.org] Sent: Monday, September 15, 2003 7:04 PM To: Maxwell Reid Cc: 'toasters(a)mathworks.com ' Subject: Re: Running Postgresql with db on Netapp On Mon, Sep 15, 2003 at 03:41:28PM -0700, Maxwell Reid wrote: > Is it possible to install a Gigabit adapter in the *BSD box and > filer? That alone will probably give you a good performance boost... > Switching to udp probably won't improve things, but using Gbe and > jumbo frames will do wonders. I'd consider that, however I'm having a hard time believing that a PC a *stinkeen* plain-ol-IDE drive is doing better than my filer. I can blame (in order of cost of upgrade): - a configuration mistake - mount options - filer options - network hardware - nfs - pc hardware - postgresql and I'm slowly working my way down that list...(grin) I suspect that folks running Oracle/Informix with a filer aren't seeing more than a 10% performance reduction, otherwise very few would opt to do it, so I suspect that it works, it works well and I must be missing something... Thanks, Adi

1 0

RE: filer-mrtg (filer.mrtg.tar.gz)
by Hill, Aaron 16 Sep '03

16 Sep '03

At another organisation I used mrtg to monitor my snapshot levels and gauge how snapmirror was running. Combined with the network stats it was pretty damn good. I use DFM here, much easier to use and definitely makes managing large numbers of volumes/qtrees/filesystems easier. But then you gotta buy another license..... -----Original Message----- From: barrie_spence(a)agilent.com [mailto:barrie_spence@agilent.com] Sent: Wednesday, 17 September 2003 12:45 AM To: JasonT(a)plumtree.com; toasters(a)mathworks.com Subject: RE: filer-mrtg (filer.mrtg.tar.gz) We graph CIFS and NFS server operation rates (using the least significant 32-bits of the SNMP counter) and connected CIFS shares. -----Original Message----- From: Jason Truong [mailto:JasonT@plumtree.com] Sent: 15 September 2003 23:32 To: Sto Rage !; Ziller, Frank; toasters(a)mathworks.com Subject: RE: filer-mrtg (filer.mrtg.tar.gz) What are people monitoring on their NetApps with mrtg? Just curios cause I only use MRTG to graph the network traffic. I did think about using it for CPU/disk space but I currently use Nagios for that. I am sure others on this list will have good uses for MRTG on their NetApps....anyone care to share? Thanks, Jason T. -----Original Message----- From: Sto Rage ! [mailto:Net_Backer@hotmail.com] Sent: Monday, September 15, 2003 3:09 PM To: Ziller, Frank; toasters(a)mathworks.com Subject: Re: filer-mrtg (filer.mrtg.tar.gz) Is there a benefit installing this version of MRTG package instead of using the newer standard mrtg and add your own configs to it? We have the standard build of MRTG (being used to monitor other network related stuff too) to which we added NetApp configs to pull data. What extra info (that's not available with snmp) does this application provide? I think this package is now outdated. Comments? -G ----- Original Message ----- From: Ziller, Frank <mailto:FZiller@IKON.com> To: toasters(a)mathworks.com <mailto:toasters@mathworks.com> Sent: Monday, September 15, 2003 12:28 PM Subject: filer-mrtg (filer.mrtg.tar.gz) Has anyone successfully installed the filer-mrtg application (downloaded off now.netapp.com) on Red Hat 7.3 or Red Hat 9. It looks like I am having some problems with either\both perl and mrtg parsing data collected in the mrtg-filer-stats.sh shell script. See below. [root@atl01-lnx-75 bin]# /opt/nasmrtg/bin/mrtg-filer-stats.sh 10.10.18.21 password + SERVER=10.10.18.21 + PORT=password + USER= + PASSWD= + MRTG_HOME=/opt/nasmrtg/mrtg-bin + MRTG_BIN=/opt/nasmrtg/mrtg-bin + FILER_STATS_HOME=/opt/nasmrtg + BASE_WORKDIR=/opt/nasmrtg/monitor + CONF=/opt/nasmrtg/conf/10.10.18.21.cfg + INDEX_FILE=/opt/nasmrtg/monitor/10.10.18.21/index.html + TITLE=Filer statistics for '10.10.18.21' + REGEX=10.10.18.21 + /opt/nasmrtg/bin/retrieve-filer.sh 10.10.18.21 + SERVER=10.10.18.21 + FILER_ASCII_PORT= + USERNAME= + PASSWD= + FILER_STATS_HOME=/opt/nasmrtg + PATH=/bin:/usr/bin:/usr/local/bin:/opt/gnu/bin:/opt/nasmrtg/bin: + export PATH + DATA_FILE=/opt/nasmrtg/data/retrieve-filer-10.10.18.21.dat + GNU_EGREP= + RCMD=rsh + echo 'Name: 10.10.18.21' + retrieve-cpu.pl 10.10.18.21 + /opt/nasmrtg/mrtg-bin/mrtg /opt/nasmrtg/conf/10.10.18.21.cfg Array found where operator expected at (eval 177) line 1, at end of line * Problem with '1.3.6.1.4.1.789.1.2.2.2.0&1.3.6.1.4.1.789.1.2.2.3.0:public@10.10.18.21': syntax error at (eval 177) line 1, near "1.3.6.1.4.1.789.1.2.2.3.0:" + /opt/nasmrtg/mrtg-bin/indexmaker /opt/nasmrtg/conf/10.10.18.21.cfg 'Filer statistics for '\''10.10.18.21'\''' 10.10.18.21 + exit 0 [root@atl01-lnx-75 bin]# Thanks, Frank _________ Frank Ziller IKON Network Center IKON The Way Business Gets Communicated 5755 Peachtree Industrial Blvd. Norcross, GA 30092 678.728.0601 fax: 678.547.2190 email: fziller(a)ikon.com <mailto:fziller@ikon.com> ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. **************************************************

1 0

RE: filer-mrtg (filer.mrtg.tar.gz)
by barrie_spence＠agilent.com 16 Sep '03

16 Sep '03

We graph CIFS and NFS server operation rates (using the least significant 32-bits of the SNMP counter) and connected CIFS shares. -----Original Message----- From: Jason Truong [mailto:JasonT@plumtree.com] Sent: 15 September 2003 23:32 To: Sto Rage !; Ziller, Frank; toasters(a)mathworks.com Subject: RE: filer-mrtg (filer.mrtg.tar.gz) What are people monitoring on their NetApps with mrtg? Just curios cause I only use MRTG to graph the network traffic. I did think about using it for CPU/disk space but I currently use Nagios for that. I am sure others on this list will have good uses for MRTG on their NetApps....anyone care to share? Thanks, Jason T. -----Original Message----- From: Sto Rage ! [mailto:Net_Backer@hotmail.com] Sent: Monday, September 15, 2003 3:09 PM To: Ziller, Frank; toasters(a)mathworks.com Subject: Re: filer-mrtg (filer.mrtg.tar.gz) Is there a benefit installing this version of MRTG package instead of using the newer standard mrtg and add your own configs to it? We have the standard build of MRTG (being used to monitor other network related stuff too) to which we added NetApp configs to pull data. What extra info (that's not available with snmp) does this application provide? I think this package is now outdated. Comments? -G ----- Original Message ----- From: Ziller, Frank <mailto:FZiller@IKON.com> To: toasters(a)mathworks.com <mailto:toasters@mathworks.com> Sent: Monday, September 15, 2003 12:28 PM Subject: filer-mrtg (filer.mrtg.tar.gz) Has anyone successfully installed the filer-mrtg application (downloaded off now.netapp.com) on Red Hat 7.3 or Red Hat 9. It looks like I am having some problems with either\both perl and mrtg parsing data collected in the mrtg-filer-stats.sh shell script. See below. [root@atl01-lnx-75 bin]# /opt/nasmrtg/bin/mrtg-filer-stats.sh 10.10.18.21 password + SERVER=10.10.18.21 + PORT=password + USER= + PASSWD= + MRTG_HOME=/opt/nasmrtg/mrtg-bin + MRTG_BIN=/opt/nasmrtg/mrtg-bin + FILER_STATS_HOME=/opt/nasmrtg + BASE_WORKDIR=/opt/nasmrtg/monitor + CONF=/opt/nasmrtg/conf/10.10.18.21.cfg + INDEX_FILE=/opt/nasmrtg/monitor/10.10.18.21/index.html + TITLE=Filer statistics for '10.10.18.21' + REGEX=10.10.18.21 + /opt/nasmrtg/bin/retrieve-filer.sh 10.10.18.21 + SERVER=10.10.18.21 + FILER_ASCII_PORT= + USERNAME= + PASSWD= + FILER_STATS_HOME=/opt/nasmrtg + PATH=/bin:/usr/bin:/usr/local/bin:/opt/gnu/bin:/opt/nasmrtg/bin: + export PATH + DATA_FILE=/opt/nasmrtg/data/retrieve-filer-10.10.18.21.dat + GNU_EGREP= + RCMD=rsh + echo 'Name: 10.10.18.21' + retrieve-cpu.pl 10.10.18.21 + /opt/nasmrtg/mrtg-bin/mrtg /opt/nasmrtg/conf/10.10.18.21.cfg Array found where operator expected at (eval 177) line 1, at end of line * Problem with '1.3.6.1.4.1.789.1.2.2.2.0&1.3.6.1.4.1.789.1.2.2.3.0:public@10.10.18.21': syntax error at (eval 177) line 1, near "1.3.6.1.4.1.789.1.2.2.3.0:" + /opt/nasmrtg/mrtg-bin/indexmaker /opt/nasmrtg/conf/10.10.18.21.cfg 'Filer statistics for '\''10.10.18.21'\''' 10.10.18.21 + exit 0 [root@atl01-lnx-75 bin]# Thanks, Frank _________ Frank Ziller IKON Network Center IKON The Way Business Gets Communicated 5755 Peachtree Industrial Blvd. Norcross, GA 30092 678.728.0601 fax: 678.547.2190 email: fziller(a)ikon.com <mailto:fziller@ikon.com>

1 0

RE: Running Postgresql with db on Netapp
by Maxwell Reid 16 Sep '03

16 Sep '03

Hi Aditya, Is it possible to install a Gigabit adapter in the *BSD box and filer? That alone will probably give you a good performance boost... Switching to udp probably won't improve things, but using Gbe and jumbo frames will do wonders. Regards, max -----Original Message----- From: Aditya To: toasters(a)mathworks.com Sent: 9/15/2003 2:57 PM Subject: Running Postgresql with db on Netapp Hi, We've been running Postgresql (7.2.x) on FreeBSD with the database files on a Netapp F85. The mounts are NFSv3/TCP with no special tuning on the filer or client. This is a single db server accessing the database on a rw mount so there are no traditional filesystem locking problems (AFAIK). We seem to have hit a performance wall (vs. a linux box with local IDE drive) and I've been reading the various whitepapers on the NetApp website about Oracle/Informix and filers and started to follow the recommendations: - checked that all interfaces on nfs client/switch/filer are 100baseTX-FD - turned minra on, which made the filer slightly more responsive but nothing spectacular - changed the mount options to include -w=32768,-r=32768 with no perceptible difference (also increased it to 65536 for both r and w with no change) - turned fsync off in Postgres (yes, I know it's risky, but I'm trying to figure out why this is so borked) - unlike solaris there is no "direct access" mode in FreeBSD to prevent the NFS client from caching which is 2x as wasteful since the db is also caching You can see the general performance stats (which are matched by "human perception" testing) for this filer ever since we turned on a heavy-duty application last Thursday: http://dev.zapatec.com/website/internal/stats/netapp/zilch.pr.zapatec.co m/ and the various tweaking described above hasn't made much of a difference as you can see from the graphs (5 minute averages). current sysstat snapshot is pretty consistent and looks like this: zilch> sysstat 1 CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 9% 1450 0 0 1324 3726 3392 0 0 0 0 8% 1744 0 0 1323 3863 3916 0 0 0 0 10% 1588 0 0 1539 3617 3048 0 0 0 0 9% 1940 0 0 2251 3149 3140 4 0 0 0 8% 1718 0 0 401 3750 3288 2816 0 0 0 10% 1440 0 0 2327 3253 3504 0 0 0 0 9% 1648 0 0 2052 3504 3308 0 0 0 0 10% 1425 0 0 1625 3459 3172 0 0 0 0 8% 1709 0 0 1925 3167 3184 0 0 0 0 Any suggestions or hints of what to try other than don't run a db over NFS if you want performance: http://www.sunmanagers.org/pipermail/summaries/2000-December/000072.html After all, I presume that Oracle and Informix using a filer are doing well enough that people stick with the filer? Thanks, Adi This electronic message, along with any attachments, is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any proprietary information or intellectual property contained in this transmission remains the sole and exclusive property of Marshall & Swift or Marshall & Swift/Boeckh. No right to use any products or services described in this transmission is valid without an executed and paid license agreement. If you received this in error, please reply to advise the sender and delete the material from any computer.

3 2

filer-mrtg (filer.mrtg.tar.gz)
by Ziller, Frank 15 Sep '03

15 Sep '03

Has anyone successfully installed the filer-mrtg application (downloaded off now.netapp.com) on Red Hat 7.3 or Red Hat 9. It looks like I am having some problems with either\both perl and mrtg parsing data collected in the mrtg-filer-stats.sh shell script. See below. [root@atl01-lnx-75 bin]# /opt/nasmrtg/bin/mrtg-filer-stats.sh 10.10.18.21 password + SERVER=10.10.18.21 + PORT=password + USER= + PASSWD= + MRTG_HOME=/opt/nasmrtg/mrtg-bin + MRTG_BIN=/opt/nasmrtg/mrtg-bin + FILER_STATS_HOME=/opt/nasmrtg + BASE_WORKDIR=/opt/nasmrtg/monitor + CONF=/opt/nasmrtg/conf/10.10.18.21.cfg + INDEX_FILE=/opt/nasmrtg/monitor/10.10.18.21/index.html + TITLE=Filer statistics for '10.10.18.21' + REGEX=10.10.18.21 + /opt/nasmrtg/bin/retrieve-filer.sh 10.10.18.21 + SERVER=10.10.18.21 + FILER_ASCII_PORT= + USERNAME= + PASSWD= + FILER_STATS_HOME=/opt/nasmrtg + PATH=/bin:/usr/bin:/usr/local/bin:/opt/gnu/bin:/opt/nasmrtg/bin: + export PATH + DATA_FILE=/opt/nasmrtg/data/retrieve-filer-10.10.18.21.dat + GNU_EGREP= + RCMD=rsh + echo 'Name: 10.10.18.21' + retrieve-cpu.pl 10.10.18.21 + /opt/nasmrtg/mrtg-bin/mrtg /opt/nasmrtg/conf/10.10.18.21.cfg Array found where operator expected at (eval 177) line 1, at end of line * Problem with '1.3.6.1.4.1.789.1.2.2.2.0&1.3.6.1.4.1.789.1.2.2.3.0:public@10.10.18.21': syntax error at (eval 177) line 1, near "1.3.6.1.4.1.789.1.2.2.3.0:" + /opt/nasmrtg/mrtg-bin/indexmaker /opt/nasmrtg/conf/10.10.18.21.cfg 'Filer statistics for '\''10.10.18.21'\''' 10.10.18.21 + exit 0 [root@atl01-lnx-75 bin]# Thanks, Frank _________ Frank Ziller IKON Network Center IKON The Way Business Gets Communicated 5755 Peachtree Industrial Blvd. Norcross, GA 30092 678.728.0601 fax: 678.547.2190 email: fziller(a)ikon.com <mailto:fziller@ikon.com>

2 1

Running Postgresql with db on Netapp
by Aditya 15 Sep '03

15 Sep '03

Hi, We've been running Postgresql (7.2.x) on FreeBSD with the database files on a Netapp F85. The mounts are NFSv3/TCP with no special tuning on the filer or client. This is a single db server accessing the database on a rw mount so there are no traditional filesystem locking problems (AFAIK). We seem to have hit a performance wall (vs. a linux box with local IDE drive) and I've been reading the various whitepapers on the NetApp website about Oracle/Informix and filers and started to follow the recommendations: - checked that all interfaces on nfs client/switch/filer are 100baseTX-FD - turned minra on, which made the filer slightly more responsive but nothing spectacular - changed the mount options to include -w=32768,-r=32768 with no perceptible difference (also increased it to 65536 for both r and w with no change) - turned fsync off in Postgres (yes, I know it's risky, but I'm trying to figure out why this is so borked) - unlike solaris there is no "direct access" mode in FreeBSD to prevent the NFS client from caching which is 2x as wasteful since the db is also caching You can see the general performance stats (which are matched by "human perception" testing) for this filer ever since we turned on a heavy-duty application last Thursday: http://dev.zapatec.com/website/internal/stats/netapp/zilch.pr.zapatec.com/ and the various tweaking described above hasn't made much of a difference as you can see from the graphs (5 minute averages). current sysstat snapshot is pretty consistent and looks like this: zilch> sysstat 1 CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 9% 1450 0 0 1324 3726 3392 0 0 0 0 8% 1744 0 0 1323 3863 3916 0 0 0 0 10% 1588 0 0 1539 3617 3048 0 0 0 0 9% 1940 0 0 2251 3149 3140 4 0 0 0 8% 1718 0 0 401 3750 3288 2816 0 0 0 10% 1440 0 0 2327 3253 3504 0 0 0 0 9% 1648 0 0 2052 3504 3308 0 0 0 0 10% 1425 0 0 1625 3459 3172 0 0 0 0 8% 1709 0 0 1925 3167 3184 0 0 0 0 Any suggestions or hints of what to try other than don't run a db over NFS if you want performance: http://www.sunmanagers.org/pipermail/summaries/2000-December/000072.html After all, I presume that Oracle and Informix using a filer are doing well enough that people stick with the filer? Thanks, Adi

1 0

NFS performances with Samba server ?
by Frank Bonnet 15 Sep '03

15 Sep '03

Hi Due to lack of Samba PDC support by Netapp filers I use a Samba server working with NFS on a Filer. That is Windows clients access to users's data thru the samba server. I need to boost a bit NFS access from samba server to Netapp filer, actually I use NFS over TCP and I wonder if using it over UDP will accelerate a bit ? Any infos / tricks welcome PS : the filer is plugged to the LAN over a Giga-ethernet link Thanks -- Frank Bonnet Responsable Reseau et Sytemes UNIX Groupe ESIEE Paris

1 0

URGENT
by collinsodowa2＠katamail.com 13 Sep '03

13 Sep '03

From:DR.COLLINS ODOWA 40 WOODALE ST. EAST LONDON, SOUTH AFRICA. E-MAIL:[collinsodowa2@katamail.com] l am a financial consultant based in eastlondon SOUTH AFRICA .l have a client (a widow)she has $10,500,000USD with a private equity investment trust company for safekeeping. And she is willing to offer you 20% of the total fund if you can assist her transfer this fund tO your country or any bank of your wish.She wishes to invest in a stable economy. Her interest is in companies with potentials for rapid growth in long terms. My client is interested in placing part of her fund in your company,if your country`s bi-laws allows foreign investment. You can contact me for more details via my e-mail address or fax with your reference. Yours faithfully, DR.COLLINS ODOWA E-MAIL:collinsodowa2@katamail.com [please reply me withthis e-mail address] N:B The fund is free from drug and laundering related offences and this transaction need.

1 0

RE: volume disk space
by Alan McLachlan 12 Sep '03

12 Sep '03

Marcus, WAFL "steals" 10%; this loss is inherent in the file system design. Think about how you lose up to 12% of your free space for the MFT on an NTFS volume; same thing on WAFL except it isn't allocated as a contiguous chunk like the MFT - rather the space is used dynamically to allow the filesystem to function properly. regards, Alan. -----Original Message----- From: Bui, Marcus [mailto:Marcus.Bui@aiminvestments.com] Sent: Friday, 12 September 2003 8:09 AM To: 'toasters(a)mathworks.com' Subject: volume disk space I created a volume on F880c, ONTAP 6.4.1, with CIFS as follows: 37 - 72GB disk Raid group size = 14 with 3 Raid groups No snapshot snapshot reserve = 0 But in Filerview the volume space shows 1.98TB and 'df -g' shows 2031GB. I thought the volume space should be 2.257TB (34 data disks x 66.385GB). Map to the volume from a Windows client and it shows 1.98TB. Why am I missing a lot of disk space? cheers, Marcus Bui **** ASI Solutions Disclaimer **** The material transmitted may contain confidential and/or privileged material and is intended only for the addressee. If you receive this in error, please notify the sender and destroy any copies of the material immediately. ASI will protect your Privacy according to the 10 Privacy Principles outlined under the new Privacy Act, Dec 2001. This email is also subject to copyright. Any use of or reliance upon this material by persons or entities other than the addressee is prohibited. E-mails may be interfered with, may contain computer viruses or other defects. Under no circumstances do we accept liability for any loss or damage which may result from your receipt of this message or any attachments. **** END OF MESSAGE ****

3 2

volume disk space
by Bui, Marcus 11 Sep '03

11 Sep '03

I created a volume on F880c, ONTAP 6.4.1, with CIFS as follows: 37 - 72GB disk Raid group size = 14 with 3 Raid groups No snapshot snapshot reserve = 0 But in Filerview the volume space shows 1.98TB and 'df -g' shows 2031GB. I thought the volume space should be 2.257TB (34 data disks x 66.385GB). Map to the volume from a Windows client and it shows 1.98TB. Why am I missing a lot of disk space? cheers, Marcus Bui

1 0

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters