toasters December 2006

toasters@lists.teaparty.net

50 participants
40 discussions

Start a nNew thread

7.2 stability
by Grey Friday 10 Jan '07

10 Jan '07

So what's the word on 7.2 ready for install or still hold off?

7 8

Snapmirror transferrates??
by Thomas Bleek 09 Jan '07

09 Jan '07

Hello, I wonder what transferrate I could expect for snapmirror volumes (an/or qtrees) between 2 FAS270 directly connected with Gigabit Ethernet. We use one filer as NFS backing store for our Mailsystem (Communigate Pro) with mdir mailbox format, so we have many small files here. I see abnormal high lags with really moderate sizes of the transferred data. For instance we need about 20 to 40 minutes to transfer 100 to 600 MBytes! The filesystems a 50% filled 250 GByte Volume/qtree with 10.3 million files (with 7 mio free inodes). so the average filesize is about 12KByte. We use Ontap 7.0.4 here and will upgrade to 7.0.5 next week. But I don't really have much hope that this will change the problem. Could anybody give me some data about his/her transfer rates? I really can't believe, that this slow transfers are normal. An repeatedly snapmirror status command on the filer shows this: at first the transfer startet and transferred about 68 MByte in 80 seconds. after that it paused for 15 minutes (output constantly "transferring 68MB done"). from minute 16 to 26 it says "transferring inodes". in these 11 minutes it transferred 225.000 inodes. after that it transfers data again. in minute 28 it has transferred 550 MBytes. after that one minute pause and then the status is idle. Has netapp/snapmirror a big problem with small files? I don't want to switch to mailbox format because I like the advantages of mdir (single copy mailstore, easier backup?) Thanks for any hints, thomas

5 6

Fwd: POST NOT ALLOWED - NETAPP
by Blake Golliher 29 Dec '06

29 Dec '06

Wasn't someone from Earthlink going to look into this? -Blake ---------- Forwarded message ---------- From: Netapp List Owner <netapp-owner(a)lists.corp.earthlink.net> Date: Dec 29, 2006 12:18 PM Subject: POST NOT ALLOWED - NETAPP To: netapp-owner(a)lists.corp.earthlink.net, Blake Golliher <thelastman(a)gmail.com> The message attached could not be sent to "NETAPP" mailing list because of the following error message: -> Domain gmail.com is not allowed to post A copy of this message is being sent to the list owner(s). Thank you, Mordomo Volume snapmirror shouldn't have that classic problem. Volume snapmirror is block based, and therefor doesn't care about the number of files. Qtree snapmirror interacts with WAFL the same way any file level application might, so qtree snapmirror might be the wrong choice, if that's what they are using. I'd like to know more about their setup, and their snapmirror relationship. -Blake On 12/29/06, Julio Calderon <jcalderon(a)agami.com> wrote: > > > > Everyone has a challenge with high numbers of small files and to add to that > challenge; you are using one of the slowest ntap gear out in the market. > > > > -----Original Message----- > From: Thomas Bleek [mailto:bl@gfz-potsdam.de] > Sent: Fri Dec 29 09:46:45 2006 > To: Toaster Admins > Subject: Snapmirror transferrates?? > > Hello, > > I wonder what transferrate I could expect for snapmirror volumes > (an/or qtrees) between 2 FAS270 directly connected with Gigabit > Ethernet. > > We use one filer as NFS backing store for our Mailsystem (Communigate > Pro) with mdir mailbox format, so we have many small files here. > > I see abnormal high lags with really moderate sizes of the transferred > data. > > For instance we need about 20 to 40 minutes to transfer 100 to 600 MBytes! > > The filesystems a 50% filled 250 GByte Volume/qtree with 10.3 million > files (with 7 mio free inodes). > > so the average filesize is about 12KByte. > > We use Ontap 7.0.4 here and will upgrade to 7.0.5 next week. > But I don't really have much hope that this will change the problem. > > Could anybody give me some data about his/her transfer rates? > I really can't believe, that this slow transfers are normal. > > An repeatedly snapmirror status command on the filer shows this: > > at first the transfer startet and transferred about 68 MByte in > 80 seconds. after that it paused for 15 minutes (output constantly > "transferring 68MB done"). > from minute 16 to 26 it says "transferring inodes". in these 11 minutes > it transferred 225.000 inodes. after that it transfers data again. > in minute 28 it has transferred 550 MBytes. after that one minute pause > and then the status is idle. > > > Has netapp/snapmirror a big problem with small files? > I don't want to switch to mailbox format because I like the advantages > of mdir (single copy mailstore, easier backup?) > > Thanks for any hints, > thomas > > >

1 0

Re: Snapmirror transferrates??
by Julio Calderon 29 Dec '06

29 Dec '06

That's a good point. Wonder if there are any documented performance numbers of any sample case done by netapp. -----Original Message----- From: Blake Golliher [mailto:thelastman@gmail.com] Sent: Fri Dec 29 12:05:34 2006 To: Julio Calderon Cc: Thomas Bleek; Toaster Admins Subject: Re: Snapmirror transferrates?? Volume snapmirror shouldn't have that classic problem. Volume snapmirror is block based, and therefor doesn't care about the number of files. Qtree snapmirror interacts with WAFL the same way any file level application might, so qtree snapmirror might be the wrong choice, if that's what they are using. I'd like to know more about their setup, and their snapmirror relationship. -Blake On 12/29/06, Julio Calderon <jcalderon(a)agami.com> wrote: > > > > Everyone has a challenge with high numbers of small files and to add to that > challenge; you are using one of the slowest ntap gear out in the market. > > > > -----Original Message----- > From: Thomas Bleek [mailto:bl@gfz-potsdam.de] > Sent: Fri Dec 29 09:46:45 2006 > To: Toaster Admins > Subject: Snapmirror transferrates?? > > Hello, > > I wonder what transferrate I could expect for snapmirror volumes > (an/or qtrees) between 2 FAS270 directly connected with Gigabit > Ethernet. > > We use one filer as NFS backing store for our Mailsystem (Communigate > Pro) with mdir mailbox format, so we have many small files here. > > I see abnormal high lags with really moderate sizes of the transferred > data. > > For instance we need about 20 to 40 minutes to transfer 100 to 600 MBytes! > > The filesystems a 50% filled 250 GByte Volume/qtree with 10.3 million > files (with 7 mio free inodes). > > so the average filesize is about 12KByte. > > We use Ontap 7.0.4 here and will upgrade to 7.0.5 next week. > But I don't really have much hope that this will change the problem. > > Could anybody give me some data about his/her transfer rates? > I really can't believe, that this slow transfers are normal. > > An repeatedly snapmirror status command on the filer shows this: > > at first the transfer startet and transferred about 68 MByte in > 80 seconds. after that it paused for 15 minutes (output constantly > "transferring 68MB done"). > from minute 16 to 26 it says "transferring inodes". in these 11 minutes > it transferred 225.000 inodes. after that it transfers data again. > in minute 28 it has transferred 550 MBytes. after that one minute pause > and then the status is idle. > > > Has netapp/snapmirror a big problem with small files? > I don't want to switch to mailbox format because I like the advantages > of mdir (single copy mailstore, easier backup?) > > Thanks for any hints, > thomas > > >

1 0

RE: Snapmirror transferrates??
by Julio Calderon 29 Dec '06

29 Dec '06

Everyone has a challenge with high numbers of small files and to add to that challenge; you are using one of the slowest ntap gear out in the market. -----Original Message----- From: Thomas Bleek [mailto:bl@gfz-potsdam.de] Sent: Fri Dec 29 09:46:45 2006 To: Toaster Admins Subject: Snapmirror transferrates?? Hello, I wonder what transferrate I could expect for snapmirror volumes (an/or qtrees) between 2 FAS270 directly connected with Gigabit Ethernet. We use one filer as NFS backing store for our Mailsystem (Communigate Pro) with mdir mailbox format, so we have many small files here. I see abnormal high lags with really moderate sizes of the transferred data. For instance we need about 20 to 40 minutes to transfer 100 to 600 MBytes! The filesystems a 50% filled 250 GByte Volume/qtree with 10.3 million files (with 7 mio free inodes). so the average filesize is about 12KByte. We use Ontap 7.0.4 here and will upgrade to 7.0.5 next week. But I don't really have much hope that this will change the problem. Could anybody give me some data about his/her transfer rates? I really can't believe, that this slow transfers are normal. An repeatedly snapmirror status command on the filer shows this: at first the transfer startet and transferred about 68 MByte in 80 seconds. after that it paused for 15 minutes (output constantly "transferring 68MB done"). from minute 16 to 26 it says "transferring inodes". in these 11 minutes it transferred 225.000 inodes. after that it transfers data again. in minute 28 it has transferred 550 MBytes. after that one minute pause and then the status is idle. Has netapp/snapmirror a big problem with small files? I don't want to switch to mailbox format because I like the advantages of mdir (single copy mailstore, easier backup?) Thanks for any hints, thomas

3 2

RE: Addendum: ID in quota report showing up as 911-####
by Glenn Walker 29 Dec '06

29 Dec '06

My First Thoughts: The Adminis ID is (I'm just guessing here) a Domain Admin account - by default, these are also admins on the filer. All administrator accounts (in the windows world) show ownership as the builtin\administrators group (this is a Microsoft thing, not a NetApp thing). This means that ANYONE that is a member of this group will show files that they own as belonging to this group - no matter where they are located. It's highly likely that these files are scattered about your file system and not located in a single place. Glenn -----Original Message----- From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Maglinger, Paul Sent: Thursday, December 28, 2006 4:51 PM To: NetApps list server Subject: Addendum: ID in quota report showing up as 911-#### Okay... Had a major brain glitch. The accounts were deleted in Windows and that's why the name didn't appear. But now I have another question. There is an Adminis ID that's showing up in the quota report with a large amount of data, yet I do not see the folder in Windows or Unix. Any thoughts on that?!? Original message: When I run a quota report on our 740 running 6.4.5, some of the user ID in the home directory are showing up as 911-#### (such as 911-3265, 911-1456, etc.) First, why the heck is this happening and second, how do I identify the user with the number? I Googled and found a link that looked perfect but was dead. Thanks! Paul Maglinger, A+, CA, CCA, CET, MCSE Systems Administrator Shoe Carnival Inc. (812)867-4674 pmaglinger(a)scvl.com ________________________________

1 0

Addendum: ID in quota report showing up as 911-####
by Maglinger, Paul 28 Dec '06

28 Dec '06

Okay... Had a major brain glitch. The accounts were deleted in Windows and that's why the name didn't appear. But now I have another question. There is an Adminis ID that's showing up in the quota report with a large amount of data, yet I do not see the folder in Windows or Unix. Any thoughts on that?!? Original message: When I run a quota report on our 740 running 6.4.5, some of the user ID in the home directory are showing up as 911-#### (such as 911-3265, 911-1456, etc.) First, why the heck is this happening and second, how do I identify the user with the number? I Googled and found a link that looked perfect but was dead. Thanks! Paul Maglinger, A+, CA, CCA, CET, MCSE Systems Administrator Shoe Carnival Inc. (812)867-4674 pmaglinger(a)scvl.com ________________________________

1 0

ID in quota report showing up as 911-####
by Maglinger, Paul 28 Dec '06

28 Dec '06

When I run a quota report on our 740 running 6.4.5, some of the user ID in the home directory are showing up as 911-#### (such as 911-3265, 911-1456, etc.) First, why the heck is this happening and second, how do I identify the user with the number? I Googled and found a link that looked perfect but was dead. Thanks! Paul Maglinger, A+, CA, CCA, CET, MCSE Systems Administrator Shoe Carnival Inc. (812)867-4674 pmaglinger(a)scvl.com ________________________________

1 0

How do I derive sysstat "Disk Util" percentage from SNMP data?
by Andrew Siegel 21 Dec '06

21 Dec '06

I'm trying to use SNMP to record the "Disk Util" percentage numbers that are given by the sysstat command. The MIB doesn't present this number directly. The sysstat man page defines "Disk Util" as "The disk utilization (percentage) of the busiest disk", but I can't find any OIDs from which I could derive this. Does anyone know what to read and calculate in SNMP to obtain this number? -- Andrew Siegel Head of Systems Blue Sky Studios, Inc. 44 South Broadway, 17th floor White Plains, NY 10601 914-259-6336 direct 914-259-6500 main 914-259-6499 fax abs(a)blueskystudios.com

1 0

20 Dec '06

Hello Gmail users are you also getting this email when you post to this list? What's earthlink got to do with this? -G ---------- Forwarded message ---------- From: Netapp List Owner <netapp-owner(a)lists.corp.earthlink.net> Date: Dec 19, 2006 7:09 PM Subject: POST NOT ALLOWED - NETAPP To: netapp-owner(a)lists.corp.earthlink.net, Sto Rage(c) <netbacker(a)gmail.com> The message attached could not be sent to "NETAPP" mailing list because of the following error message: -> Domain gmail.com is not allowed to post A copy of this message is being sent to the list owner(s). Thank you, Mordomo

3 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters December 2006