Thanks Tim!
The thought here was that NDMP was “built for speed” and should be taking all it can get from the 10GbE pipe. I was wondering if I was missing some hidden setting that was capping or throttling or “nice”-ing the NDMP process.
From: tmac [mailto:tmacmd@gmail.com]
Sent: Wednesday, February 20, 2013 9:31 AM
To: Christopher S Eno
Cc: toasters@teaparty.net
Subject: Re: NDMP speed question
DUMPing data is historically a slow process. There is much more involved than simply
FTP'ing data to the NetApp.
The filesystem is walked inode by inode and archive bits are set among other things.
--> A highly fragmented data set will also slow down any potential dumps.
--> Wide directories (large file counts in a single directory) significantly slow down dumps
--> Small files slow down dumps.
*--> qtree dumps seem to be a little better for dump speed
--tmac
Tim McCarthy
Principal Consultant
![]()
![]()
Clustered ONTAP Clustered ONTAP
NCDA ID: XK7R3GEKC1QQ2LVD RHCE5 805007643429572 NCSIE ID: C14QPHE21FR4YWD4
Expires: 08 November 2014 Expires w/release of RHEL7 Expires: 08 November 2014
On Wed, Feb 20, 2013 at 9:03 AM, Christopher S Eno <s.eno@me.com> wrote:
Hi,
In testing NDMP dumps over 10GbE, I am seeing it max out at 1.5Gb/s. Some
here are thinking that NDMP should be using more of that pipe. Anyone know
about, or have numbers of NDMP transfer rates over 10GbE? Any caps or
thresholds in OnTap that keep NDMP from gobbling up resources on the
controller? I have run tests over the 10GbE connection from controller to
controller, 10k drives to 10k drives, sata drives to sata drives, and always
1.5Gb/s is the ceiling. FTP'ing data from server to server across the same
10GbE network shows rates of 2.5Gb/s or higher.
My NDMP options:
ndmpd.access all
ndmpd.authtype challenge
ndmpd.connectlog.enabled off
ndmpd.data_port_range all
ndmpd.enable on
ndmpd.fh_node_retry_interval 250
ndmpd.ignore_ctime.enabled off
ndmpd.maxversion 4
ndmpd.offset_map.enable on
ndmpd.password_length 16
ndmpd.preferred_interface e1a (value might be overwritten in
takeover)
ndmpd.tcpnodelay.enable on
ndmpd.tcpwinsize 65534
IF e1a configuration:
e1a: flags=0x5f4e867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,NOWINS> mtu
1500
inet x.x.x.x netmask 0xffffff00 broadcast x.x.x.x
partner e1a (not in use)
ether 00:07:43:08:98:ae (auto-10g_sr-fd-up) flowcontrol none
_______________________________________________
Toasters mailing list
Toasters@teaparty.net
http://www.teaparty.net/mailman/listinfo/toasters
_______________________________________________
Toasters mailing list
Toasters@teaparty.net
http://www.teaparty.net/mailman/listinfo/toasters