Hello,
i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage.
It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself.
I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result
Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster...
Best Regards,
Markus Schlegel
Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier
Hi Markus What version of ONTAP is this? In 8.1, we changed single file SnapRestore to use SIS clone as the underlying engine to revert the object - way faster, and makes the object immediately available as it does the clone in the background. I don't remember if it requires a FlexClone license or just SnapRestore. Which of those licenses do you have?
Peter
From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Markus.Schlegel@roto-frank.com Sent: Friday, August 01, 2014 4:19 AM To: toasters@teaparty.net Subject: SnapRestore very slow
Hello,
i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage.
It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself.
I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result
Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster...
Best Regards,
Markus Schlegel
Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier
I always found snaprestore nearly instant to revert an entire volume but slow for a single file and always use ndmp for single dike /folder restores. From peters comments , maybe I will revisit snsprestore for files as I have bed using ndmp for several releases ________________________________________ From: toasters-bounces@teaparty.net [toasters-bounces@teaparty.net] on behalf of Learmonth, Peter [Peter.Learmonth@netapp.com] Sent: Friday, August 01, 2014 1:58 PM To: Markus.Schlegel@roto-frank.com; toasters@teaparty.net Subject: RE: SnapRestore very slow
Hi Markus What version of ONTAP is this? In 8.1, we changed single file SnapRestore to use SIS clone as the underlying engine to revert the object – way faster, and makes the object immediately available as it does the clone in the background. I don’t remember if it requires a FlexClone license or just SnapRestore. Which of those licenses do you have?
Peter
From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Markus.Schlegel@roto-frank.com Sent: Friday, August 01, 2014 4:19 AM To: toasters@teaparty.net Subject: SnapRestore very slow
Hello,
i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage.
It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself.
I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result
Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster...
Best Regards,
Markus Schlegel
Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier
Regarding licenses, it again depends on your ONTAP version:
*FlexClone* The FlexClone license is required in the following situations: ◦ You are using VSC to clone virtual machines. ◦ You are performing *backup and restore operations in NFS environments* and running a version of Data ONTAP*prior to 8.1*. You do *not *need a *FlexClone *license if you are performing backup and restore operations in *NFS* environments with one of the following versions of Data ONTAP: • Data ONTAP *8.1 operating in 7-Mode* • *Clustered Data ONTAP 8.1.1 or later*
Hope that helps
Sebastian
On 8/1/2014 7:58 PM, Learmonth, Peter wrote:
Hi Markus
What version of ONTAP is this? In 8.1, we changed single file SnapRestore to use SIS clone as the underlying engine to revert the object – way faster, and makes the object immediately available as it does the clone in the background. I don’t remember if it requires a FlexClone license or just SnapRestore. Which of those licenses do you have?
Peter
*From:*toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] *On Behalf Of *Markus.Schlegel@roto-frank.com *Sent:* Friday, August 01, 2014 4:19 AM *To:* toasters@teaparty.net *Subject:* SnapRestore very slow
Hello,
i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage.
It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself.
I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result
Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster...
Best Regards,
Markus Schlegel
Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Sure, that’s from the VSC docs. My previous comments were in regards to SFSR in general.
From: Sebastian Goetze [mailto:spgoetze@gmail.com] Sent: Friday, August 01, 2014 11:14 AM To: Markus.Schlegel@roto-frank.com; toasters@teaparty.net Cc: Learmonth, Peter Subject: Re: SnapRestore very slow
Regarding licenses, it again depends on your ONTAP version:
FlexClone The FlexClone license is required in the following situations: ◦ You are using VSC to clone virtual machines. ◦ You are performing backup and restore operations in NFS environments and running a version of Data ONTAP prior to 8.1. You do not need a FlexClone license if you are performing backup and restore operations in NFS environments with one of the following versions of Data ONTAP: • Data ONTAP 8.1 operating in 7-Mode • Clustered Data ONTAP 8.1.1 or later
Hope that helps
Sebastian On 8/1/2014 7:58 PM, Learmonth, Peter wrote: Hi Markus What version of ONTAP is this? In 8.1, we changed single file SnapRestore to use SIS clone as the underlying engine to revert the object – way faster, and makes the object immediately available as it does the clone in the background. I don’t remember if it requires a FlexClone license or just SnapRestore. Which of those licenses do you have?
Peter
From: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Markus.Schlegel@roto-frank.commailto:Markus.Schlegel@roto-frank.com Sent: Friday, August 01, 2014 4:19 AM To: toasters@teaparty.netmailto:toasters@teaparty.net Subject: SnapRestore very slow
Hello,
i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage.
It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself.
I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result
Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster...
Best Regards,
Markus Schlegel
Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier
_______________________________________________
Toasters mailing list
Toasters@teaparty.netmailto:Toasters@teaparty.net
Yep, I mentioned it, because he used VSC...
I have a feeling though, that without a FlexClone license (and ONTAP 8.1.1+) it'll work, but slow... From an unrelated part of the VSC documentation:
This process uses the file level FlexClone feature of the controller. This process automatically falls back to the controller offloaded copy as needed if the fallBackToCopy parameter is set to true.
I guess it does that for Restores, also.
@Markus: By now we'd really like to know, if you have a FlexClone license and what ONTAP version you're running... ;-)
Sebastian
On 8/1/2014 8:36 PM, Learmonth, Peter wrote:
Sure, that’s from the VSC docs. My previous comments were in regards to SFSR in general.
*From:*Sebastian Goetze [mailto:spgoetze@gmail.com] *Sent:* Friday, August 01, 2014 11:14 AM *To:* Markus.Schlegel@roto-frank.com; toasters@teaparty.net *Cc:* Learmonth, Peter *Subject:* Re: SnapRestore very slow
Regarding licenses, it again depends on your ONTAP version:
*FlexClone* The FlexClone license is required in the following situations: ◦ You are using VSC to clone virtual machines. ◦ You are performing *backup and restore operations in NFS environments* and running a version of Data ONTAP*prior to 8.1*. You do *not *need a *FlexClone *license if you are performing backup and restore operations in *NFS* environments with one of the following versions of Data ONTAP: • Data ONTAP *8.1 operating in 7-Mode* • *Clustered Data ONTAP 8.1.1 or later*
Hope that helps
Sebastian
On 8/1/2014 7:58 PM, Learmonth, Peter wrote:
Hi Markus What version of ONTAP is this? In 8.1, we changed single file SnapRestore to use SIS clone as the underlying engine to revert the object – way faster, and makes the object immediately available as it does the clone in the background. I don’t remember if it requires a FlexClone license or just SnapRestore. Which of those licenses do you have? Peter *From:*toasters-bounces@teaparty.net <mailto:toasters-bounces@teaparty.net> [mailto:toasters-bounces@teaparty.net] *On Behalf Of *Markus.Schlegel@roto-frank.com <mailto:Markus.Schlegel@roto-frank.com> *Sent:* Friday, August 01, 2014 4:19 AM *To:* toasters@teaparty.net <mailto:toasters@teaparty.net> *Subject:* SnapRestore very slow Hello, i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage. It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself. I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster... Best Regards, Markus Schlegel Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier _______________________________________________ Toasters mailing list Toasters@teaparty.net <mailto:Toasters@teaparty.net> http://www.teaparty.net/mailman/listinfo/toasters
Sorry that it took so long to answer - i just enjoyed my weekend ;-)
We don't own a FlexClone license and we are on ONTAP 8.1.2P4 (7-mode) with NFS Datastores only. But as i mentioned before, i also tried it on the console using snap restore ... and it wasn't really faster. So it seems like it's not a VSC-thing :(
Mit freundlichen Grüßen / Best Regards
Markus Schlegel
Von: Sebastian Goetze spgoetze@gmail.com An: "Learmonth, Peter" Peter.Learmonth@netapp.com, Markus Schlegel/RFLE/ROTO_FRANK@ROTO_FRANK, "toasters@teaparty.net" toasters@teaparty.net Datum: 01.08.2014 23:38 Betreff: Re: SnapRestore very slow
Yep, I mentioned it, because he used VSC...
I have a feeling though, that without a FlexClone license (and ONTAP 8.1.1+) it'll work, but slow... From an unrelated part of the VSC documentation: This process uses the file level FlexClone feature of the controller. This process automatically falls back to the controller offloaded copy as needed if the fallBackToCopy parameter is set to true. I guess it does that for Restores, also.
@Markus: By now we'd really like to know, if you have a FlexClone license and what ONTAP version you're running... ;-)
Sebastian
On 8/1/2014 8:36 PM, Learmonth, Peter wrote: Sure, that’s from the VSC docs. My previous comments were in regards to SFSR in general.
From: Sebastian Goetze [mailto:spgoetze@gmail.com] Sent: Friday, August 01, 2014 11:14 AM To: Markus.Schlegel@roto-frank.com; toasters@teaparty.net Cc: Learmonth, Peter Subject: Re: SnapRestore very slow
Regarding licenses, it again depends on your ONTAP version:
FlexClone The FlexClone license is required in the following situations: ◦ You are using VSC to clone virtual machines. ◦ You are performing backup and restore operations in NFS environments and running a version of Data ONTAP prior to 8.1. You do not need a FlexClone license if you are performing backup and restore operations in NFS environments with one of the following versions of Data ONTAP: • Data ONTAP 8.1 operating in 7-Mode • Clustered Data ONTAP 8.1.1 or later
Hope that helps
Sebastian On 8/1/2014 7:58 PM, Learmonth, Peter wrote: Hi Markus What version of ONTAP is this? In 8.1, we changed single file SnapRestore to use SIS clone as the underlying engine to revert the object – way faster, and makes the object immediately available as it does the clone in the background. I don’t remember if it requires a FlexClone license or just SnapRestore. Which of those licenses do you have?
Peter
From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Markus.Schlegel@roto-frank.com Sent: Friday, August 01, 2014 4:19 AM To: toasters@teaparty.net Subject: SnapRestore very slow
Hello,
i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage.
It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself.
I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result
Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster...
Best Regards,
Markus Schlegel
Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier
_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier
Where is it documented? I checked 8.2.2 7-mode and it still describes what looks like traditional file copy (including out if space considerations and background operation). And it is exactly opposite to "immediately available" :)
File clone requires FlexClone license, that for sure.
Отправлено с iPhone
01 авг. 2014 г., в 22:03, "Learmonth, Peter" <Peter.Learmonth@netapp.commailto:Peter.Learmonth@netapp.com> написал(а):
Hi Markus What version of ONTAP is this? In 8.1, we changed single file SnapRestore to use SIS clone as the underlying engine to revert the object – way faster, and makes the object immediately available as it does the clone in the background. I don’t remember if it requires a FlexClone license or just SnapRestore. Which of those licenses do you have?
Peter
From: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Markus.Schlegel@roto-frank.commailto:Markus.Schlegel@roto-frank.com Sent: Friday, August 01, 2014 4:19 AM To: toasters@teaparty.netmailto:toasters@teaparty.net Subject: SnapRestore very slow
Hello,
i played a bit with VMware + NetApp VSC Backup/Restore and was very surprised by the bad performance of SnapRestore on a NFS Storage.
It took SnapRestore 24 hours to restore a 1TB vmdk! Looking at the filer usage (sysstat) it looked like the filer just copied the files out of the Snapshot into the live filesystem with terrible slow 12MB/s. I always thought that SnapRestore restores in a few seconds because if just copies the pointers and not the data itself.
I tried the same again (copying out of the Snapshot), this time with ndmpcopy and got ~350GB/h, which is around 100MB/s and an expected result
Currently we don't own the SnapManager License for VSC - maybe thats the problem? A short test using the cmdline wasn't faster...
Best Regards,
Markus Schlegel
Roto Frank AG Wilhelm-Frank-Platz 1 . D-70771 Leinfelden-Echterdingen . Telefon +49 711 7598 0 Sitz der Gesellschaft: Leinfelden-Echterdingen . Amtsgericht: Stuttgart . HRB 222 698 . Ust-IdNr.: DE147843524 Aufsichtsrat: Dr. Michael Stahl (Vorsitzender) Vorstand: Dr. Eckhard Keill (Vorsitzender), Leonhard Braig, Christoph Hugenberg, Michael Stangier _______________________________________________ Toasters mailing list Toasters@teaparty.netmailto:Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
-
Borzenkov, Andrey -
Jordan Slingerland -
Learmonth, Peter -
Markus.Schlegel＠roto-frank.com -
Sebastian Goetze