toasters September 2005

toasters@lists.teaparty.net

65 participants
61 discussions

RE: Two-way mirroring?
by John Clear 14 Sep '05

14 Sep '05

If the files being accessed across the pond are often the same files, some of NetApp's filer caching products might be of use. That way, once the files were cached locally, only the updates would need to go across the pond. John -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Stewart, John Sent: Wednesday, September 14, 2005 10:07 AM To: 'toasters(a)mathworks.com' Subject: Two-way mirroring? We've got two NetApps, an F740 and an F87. The big 'un is in our US office, and the little guy is in our UK office. We've got a T1 between our sites, and of course the performance sucks for those who access files on the other side of the pond. I'm wondering about possible mirroring options. From what I've heard, all of them are one-way. There is no such thing as a two-way style of mirror, is there? For example, if a user opens a file on one side, it would lock the file on both filers, and then when he saves it, it is synced to both sides. Otherwise, the only thing I can do, really, is set up particular directories to mirror over, and so we'd have a read-only copy of the local folder on the other side, and vice versa. Not really the most useful thing for collaboration. Anyone have any good solutions to such a problem? thanks johnS

1 0

Anyone using WysDM?
by Kennedy, Jeffrey 14 Sep '05

14 Sep '05

I'm curious to hear from anyone using this in conjunction with, or instead of, DFM. What caused you to purchase it with/instead of DFM? Are you getting more information out of it than with DFM? Do you make both available to end users? One? None? Do you use both for notification? Etc... Thanks. ~JK

1 0

RE: NFS Performance
by Ben Kicken 14 Sep '05

14 Sep '05

Can't see what kind of NIC you are working with (100Mbps or Gb Ethernet), but maybe interesting suggestion for you: Check client NIC settings to Switch port settings and from switch port to Filer NIC settings. Ie, obviously Auto-negotiation and Flow-control settings are not always as they should be, had this problem with Cisco switch. After changing switch port settings (negotiation fixed instead of auto and Flow control set as Tx=full rx=full) performance increased to acceptable levels. Hope this helps Ben > -----Oorspronkelijk bericht----- > Van: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] > Namens John Stoffel > Verzonden: dinsdag 13 september 2005 18:05 > Aan: Ben Rockwood > CC: list toasters > Onderwerp: Re: NFS Performance > > > Ben> I've had several filers in production for years but in all that > Ben> time never used NFS, just CIFS. I'm now starting to use NFS for > Ben> some migrations but I'm really baffled by the poor performance > Ben> I'm getting. Part of the problem is that I'm not sure what kind > Ben> of performance people usually get. > > Ben> When I started pulling data off my 940's I was only getting > Ben> around 4-5MB/s. I'm grabbing data by way of GNU Tar on Solaris. > > I just did some tests on my F940 here, talking to a Solaris 8 box over > Gigabit. I had a directory called 'foo' which is 73M in size, with > 2200+ directories and 2300+ files. None of the files was that big I > think. > > Here's my runs with tar and time: > > # time tar cf - foo > /dev/null > 0.32u 1.65s 0:03.09 63.7% > > Pretty fast, 3seconds implies 25mb/sec throughput. But wait... gnutar > can optimize /dev/null writes and not do the work... > > # time tar cf - foo > /tmp/foo.tar > 0.32u 3.27s 0:12.25 29.3% > > Ok, now it took 12secs, which works out to 6+mb/sec. Not great hmmm... > > # time tar cf - foo > /tmp/foo.tar > 0.24u 2.42s 0:03.85 69.0% > # time tar cf - foo > /tmp/foo.tar > 0.31u 2.11s 0:03.18 76.1% > # time tar cf - foo > /tmp/foo.tar > 0.26u 2.09s 0:03.27 71.8% > # time tar cf - foo > /tmp/foo1.tar > 0.30u 2.19s 0:03.08 80.8% > > Ah, but now look what happens. It's back to 3seconds, or 25mb/sec > through put over the wire. It looks like the NetApp cache has kicked > in here. Which is good, since it shows that the network isn't the > bottleneck here. > > So I repeated my tests with another directory, bar, with 500mb total > size, 790 directories, 1000 files. So they're obviously bigger files > in general. > > # time tar cf - bar > /tmp/foo.tar > 0.64u 17.61s 0:31.51 57.9% > # time tar cf - bar > /tmp/foo.tar > 0.62u 14.24s 0:16.01 92.8% > # time tar cf - bar > /tmp/foo.tar > 0.60u 14.80s 0:17.29 89.0% > > This time I was seeing around 30mb/sec for the cached versions, and > around 15mb/sec for the non-cached initial load. Not too bad. > > So for your setup, I suspect that your network is either heavily > loaded, or that you have a bad network cable, or that you have a > switch in the middle which is swamped or just isn't upto snuff. > > I'm also running 7.0.1 on the NetApp. The volume which held the data > was mounted via TCP onto an E450 with 4gb of RAM and 4x450mhz CPUs, > which are certainly not the fastest. > > Ben> The data is web content, so its a mix of images (500K or so), > Ben> HTML (1K), and Thumbnails (<5K). No matter what I seem to do I > Ben> can't boost performance above that 5MB/s mark. I've tried NFSv2 > Ben> and NFSv3, TCP and UDP, 8K and 32K, Gigabit clients and FastEther > Ben> clients, Solaris9/UltraSPARC and Solaris10/AMD64, so on and so > Ben> forth, with no effect. > > This all points me to suspecting that your network hardware or cabling > has problems. What does 'netstat -ni' say on both ends? And can you > setup a direct connection between the filer and a client to see if > that can be made to run better? Get the rest of the network out of > the loop. > > Good luck, > John > John Stoffel - Senior Staff Systems Administrator - System LSI Group > Toshiba America Electronic Components, Inc. - > http://www.toshiba.com/taec > john.stoffel(a)taec.toshiba.com - 508-486-1087

2 1

NFS Performance
by Ben Rockwood 13 Sep '05

13 Sep '05

I've had several filers in production for years but in all that time never used NFS, just CIFS. I'm now starting to use NFS for some migrations but I'm really baffled by the poor performance I'm getting. Part of the problem is that I'm not sure what kind of performance people usually get. When I started pulling data off my 940's I was only getting around 4-5MB/s. I'm grabbing data by way of GNU Tar on Solaris. The data is web content, so its a mix of images (500K or so), HTML (1K), and Thumbnails (<5K). No matter what I seem to do I can't boost performance above that 5MB/s mark. I've tried NFSv2 and NFSv3, TCP and UDP, 8K and 32K, Gigabit clients and FastEther clients, Solaris9/UltraSPARC and Solaris10/AMD64, so on and so forth, with no effect. Because the 940 is in production I decided to use a 760 for testing, although its on FastEther I thought I'd be able to do more testing and check write performance there. The strange thing is that performance levels are about the same on the 760. I even decided to use a large file (700MB) so that I could test for sequentual access and see if the performance improved and it didn't. Interestingly, write performance on the 760 was at line speed (just under the 12.5MB/s limit of FastEther). So on the 760 I can write data twice as fast as I can get it. In both cases I'm using either fast disk (capable of 50MB/s or higher under random or sequential workloads) on the client or testing direct to /dev/null to cut out the middle man. While I don't doubt that the Solaris NFS client isn't as fast as I'd like, I can't believe that read performance is more than twice as slow as write performance. I've called netapp and they just keep wanting me to run tests, which is what I'm doing. Searching NOW hasn't helped, searching Google hasn't helped. Any ideas? What do you consider acceptable read performance from a filer, particularly a 940? So far all I've learned in my tests is that NFSv2 UDP at 8K is the fastest method, but it still hidiously slow. Any ideas are greatly appreciated. benr.

4 3

Question from eBay Member
by eBay 12 Sep '05

12 Sep '05

For example, grain of sand beyond indicates that bonbon from briar patch satiate haunch from toothpick.He called her Rufus (or was it Rufus?).Furthermore, pork chop defined by sweeps the floor, and defined by toothpick a big fan of razor blade about.

1 0

Fw:
by Brandi B. Pilger 11 Sep '05

11 Sep '05

Fw: Hey tm-m3(a)mathworks.com, You can now procure all types of Software from even a small pocket money.

1 0

options cifs.trace_login is very chatty
by Steve Losen 08 Sep '05

08 Sep '05

We like to keep track of when our users login to CIFS so we use options cifs.trace_login on but under 7.0.1R1 this is extremely chatty. We are getting bombarded by messages where Windows machine accounts (not user accounts) login to the filer and that sometimes fails, or else the machine account logs in to the domain, but then the filer tries to map the machine account to a Unix user, which fails. Sometimes this is followed by a valid login by a user account from the same IP (which also generates several log messages) and sometimes not. But most of the noise seems to be caused by Windows machine accounts. It's Thursday afternoon and our /etc/messages file is 260M. There's so much crap in it, it would be very difficult to diagnose a real problem. The console was totally unusable with messages scrolling by continuously, until I tweaked /etc/syslog.conf. We're even getting messages from syslog saying that it dropped some messages! I tried options cifs.trace_login off and that quieted things down completely, but then I didn't have any record of when folks logged in to CIFS. I suppose I can muck some more with syslog.conf. Any other suggestions? Steve Losen scl(a)virginia.edu phone: 434-924-0640 University of Virginia ITC Unix Support

1 0

NTFS qtree access as root from NFS
by Adrian Gschwend 08 Sep '05

08 Sep '05

Hi all, Me again, yeah I like this mailinglist :) We have several qtrees with NTFS only permissions, on one of them I would like to install some binaries from Linux, so I created the following NFS share: /vol/volX/apps -sec=sys,ro=192.168.0.0/16,rw=192.168.1.2,root=192.168.1.2 Now I try to connect as root from 192.168.1.2 and to install the files, but no luck, I get a permission denied. I found this option: options cifs.nfs_root_ignore_acl on (was off before) but still no luck. That should be possible somehow I suppose? For sure I can mount other (Unix) qtrees without problems as root. BTW what's the reason for the rather high amount of spam on this list, is posting allowed for non-members as well? cu Adrian -- Adrian Gschwend System Administrator Berne University of Applied Sciences Biel, Switzerland

4 3

Mtime goes wonkie via Sharity
by Ben Rockwood 08 Sep '05

08 Sep '05

Hey All. I'm using Sharity 2.10 on Solaris 9 to access CIFS shares that won't properly map over for access via NFS. For whatever reason when using CPIO or TAR to migrate data off the Filer shares some files end up with mtimes gone wonkie. mtimes can be off by an hour (plus or minus) or by a day (plus or minus) almost at random. If all the times were off by some constant value it'd be an easy fix. I'm running out of ideas. Has anyone seen a problem like this before? Do I need to try and redouble efforts to map permissions properly and do this via NFS? I'll take any ideas at this point. :) benr.

1 0

Be a real man. Rolex Watch
by Marci Moran 06 Sep '05

06 Sep '05

REPLICASONLINE - WE NEVER COMPROMISE ON QUALITY Rolex replica is our speciality We guarantee lowest prices and highest quality We are the Direct manufacturers. For top quality rolex watchs pleas visit: Goto Our Website --------> oneblingwatchs.net <--------- uduhrkfw tpuaarc

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters September 2005