Hi Basil

Yes we are also aware of this.  But this happens at the start of the NDMP dump where is dumps the file and directory structure first, and then it dumps the data as the last part… and even when the system is running the last part of the backup we do not see speeds over 60MB/sec…   and yes we are sure it uses the 10G NICs and the Intercluster NICs etc.

If I really have a lot of spare time on my hands I might just open a case with Veritas and/or NetApp to figure out if it is possible to speed it up.

/Heino

Fra: Basil <basilberntsen@gmail.com>
Dato: onsdag, 2. juni 2021 kl. 21.53
Til: tmac <tmacmd@gmail.com>
Cc: Heino Walther <hw@beardmann.dk>, toasters@teaparty.net <toasters@teaparty.net>
Emne: Re: NDMP Backup speeds

Another thing we’ve observed is that since NDMP has to enumerate the entire file system, backups of locations with lots of inodes can take a long time and drive high levels of CPU and memory utilization.

On Wed, Jun 2, 2021 at 3:45 PM tmac <tmacmd@gmail.com> wrote:

How about this for the win?

https://docs.netapp.com/ontap-9/topic/com.netapp.doc.dot-cm-ptbrg/GUID-6EC88448-13B9-41E9-A8BD-218E5343D7DF.html

--tmac

Tim McCarthy, Principal Consultant

Proud Member of the #NetAppATeam

I Blog at TMACsRack

On Wed, Jun 2, 2021 at 9:41 AM Heino Walther <hw@beardmann.dk> wrote:

Hi there

We are doing NDMP backups from out FAS2750 with NL-SAS disks onto LTO8 tape drives via NetBackup.

For other reasons we are doing this via 10G Ethernet, and not directly connected tapedrives to the NetApp controllers.

We are seeing backup speeds of about 40-50MB/sec. which is kinda slow, the backup is a Windows host that is doing nothing… no CPU or memory load as we backup.

The LTO8 drives should be able to do much better (350MB/sec. before compression)…

The aggregates are RAID-TEC with 17 drives in it.  We are on ONTAP 9.7.  We are not seeing a lot of load as we are running the backups…

Could it be that the protocol itself it as cause here?

In the “old days” we did NDMP backup directly from the controllers to the tape drives.

We are now thinking of converting two 10G ports to fibrechannel ports…  if possible…

So I have two questions 😊

The FAS2750 is configured with RJ45 10G ports, but would it be possible to use FCoE and somehow connect this to a FC/Ethernet switch and be able to connect it to the tape drive which is 8G FC (LC Connectors) ?

(I have not worked that much with FCoE… if the FAS2750 was configured with CNA-Ports, it would have been easy to convert that into FC)

Has anyone tried to backup NL-SAS volumes similar to this over directly connected NDMP, and what kind of speeds are you seeing?

Finally if anyone have any idea if the NetBackup setup can be tweaked somehow, that would also be useful… (we have tweaked it a bit)

/Heino

_______________________________________________
Toasters mailing list
Toasters@teaparty.net
https://www.teaparty.net/mailman/listinfo/toasters

_______________________________________________
Toasters mailing list
Toasters@teaparty.net
https://www.teaparty.net/mailman/listinfo/toasters