On 2016-08-22 19:06, Klise, Steve wrote:
I used to do ~ 10m files (10TB vol) for a roaming profile repository via snapmirror about 5 years ago. Worked like a charm and was 7-mode. We would sm to another filer, and then ndmp dump of the 2ndary vol to a vtl.
I'm sure 10 M inodes in 10 TB worked AOK for you. It did for us as well, no prob. If you multiply that by 10x... to 100 M inodes... *then* it's a problem. Then several volumes with >100 M inodes, and it starts to hurt. A lot. I think that a FlexVol (qtree or whatever) with 10 M inodes in it isn't very much, not even 5 y ago
Luckily we're rid of all this file tree walk c**p in C.DOT
All the bg scanners still in ONTAP walking file trees, like the redirect scanner which implicitly runs after you've done Aggr reallocate, is just a PITA.... *sigh* They literally can never finish. I've tried, during a long period of time and it's just "#(¤%/%(¤
I think there's probably some of these bg scanner still in Kahuna as well, but I don't know for sure. Redirect scanning was moved to Vol Affinity in wafl_exempt though, in 8.3.1 (I think it was, correct me if I'm wrong!)
Regards, M
On 8/22/16, 9:59 AM, "toasters-bounces@teaparty.net on behalf of Sebastian Goetze"<toasters-bounces@teaparty.net on behalf of spgoetze@gmail.com> wrote:
In 7-Mode, SnapVault logically goes through the whole filesystem to find changed blocks. E.g. dedupe is not 'seen' at all by SnapVault. SnapMirror on the other hand just looks at the blocks and doesn't care how big or small the filesystem is.
In High File Count (HFC) situations (or highly dedupeable data) I always advise to use SnapMirror, if at all possible.
It transfers the data deduped (and compressed, if the source is compressed) and can also compress on the wire (don't do this, if your source data is already compressed...).
And yes, you could continue the replication sequence with SnapVault (e.g local on the secondary, e.g. only weekly's but further back). This could offset the possibly more storage you might need on the primary (e.g. if you don't yet do weekly's at all on the primary at the moment).
My 2c
Sebastian