Hello All,
We're migrating from a FAS to a new AFF that has inline compression and a guarantee of 3X compression.
I'm trying to convert a graphite/snmp graphing system that reports our overall aggregate space usage to the new system.
A straightforward graph of used and free space on the data aggregates/tiers shows the right portion of space used but seems to be reporting pre-compression usage (and we appear to be getting less than 3X).
The System Manager webUI says we're getting ~120:1 "Data Reduction" but it also says we're using 1.74PB and have 14TB available. In fact we currently have 48 x 900GB SSDs in two disk groups/tiers and about 40TB of actual unstructured data.
Is there a doc somewhere on understanding space reporting with the new system including meaningful reporting of compression returns?
Grateful for any help,
Randy in Seattle
OK, no responses to my below so let me ask a simpler question.
The System Manager Dashboard's "Capacity" pane says I'm using 1.83PB with 11.7TB available. That's clearly not accurate.
If I click into the arrow in that pane I get the Tiers page and it says my two Tiers respectively have 875TB used and 6.5TB available, and 1PB used and 5.2TB available.
What the hell are these numbers describing?
Hope to hear from you
On 6/10/2021 9:24 AM, Rue, Randy wrote:
Hello All,
We're migrating from a FAS to a new AFF that has inline compression and a guarantee of 3X compression.
I'm trying to convert a graphite/snmp graphing system that reports our overall aggregate space usage to the new system.
A straightforward graph of used and free space on the data aggregates/tiers shows the right portion of space used but seems to be reporting pre-compression usage (and we appear to be getting less than 3X).
The System Manager webUI says we're getting ~120:1 "Data Reduction" but it also says we're using 1.74PB and have 14TB available. In fact we currently have 48 x 900GB SSDs in two disk groups/tiers and about 40TB of actual unstructured data.
Is there a doc somewhere on understanding space reporting with the new system including meaningful reporting of compression returns?
Grateful for any help,
Randy in Seattle
also, that pane says I'm getting 108X data reduction. Is that the new inline compression? And is that number likely to be accurate after NetApp promised us (in writing!) compression?
On 7/6/2021 11:42 AM, Rue, Randy wrote:
OK, no responses to my below so let me ask a simpler question.
The System Manager Dashboard's "Capacity" pane says I'm using 1.83PB with 11.7TB available. That's clearly not accurate.
If I click into the arrow in that pane I get the Tiers page and it says my two Tiers respectively have 875TB used and 6.5TB available, and 1PB used and 5.2TB available.
What the hell are these numbers describing?
Hope to hear from you
On 6/10/2021 9:24 AM, Rue, Randy wrote:
Hello All,
We're migrating from a FAS to a new AFF that has inline compression and a guarantee of 3X compression.
I'm trying to convert a graphite/snmp graphing system that reports our overall aggregate space usage to the new system.
A straightforward graph of used and free space on the data aggregates/tiers shows the right portion of space used but seems to be reporting pre-compression usage (and we appear to be getting less than 3X).
The System Manager webUI says we're getting ~120:1 "Data Reduction" but it also says we're using 1.74PB and have 14TB available. In fact we currently have 48 x 900GB SSDs in two disk groups/tiers and about 40TB of actual unstructured data.
Is there a doc somewhere on understanding space reporting with the new system including meaningful reporting of compression returns?
Grateful for any help,
Randy in Seattle
I would assume that when NetApp promised you 3x savings they weren't
referring to just compression. The AFF also does in-line deduplication, plus
there is compaction. And some things also count in savings from snapshots.
The 180x number, is that in the circle on the tiers page? If you hover over it,
it will show the value without snapshots counted.
If you want a better break down try using (CLI):
aggr show-efficiency -aggregate aggr -instance
________________________________ From: Toasters toasters-bounces@teaparty.net on behalf of Rue, Randy randyrue@gmail.com Sent: Tuesday, July 6, 2021 11:51 AM To: Toasters Subject: Re: space reporting on AFF's with compression?
also, that pane says I'm getting 108X data reduction. Is that the new inline compression? And is that number likely to be accurate after NetApp promised us (in writing!) compression?
On 7/6/2021 11:42 AM, Rue, Randy wrote:
OK, no responses to my below so let me ask a simpler question.
The System Manager Dashboard's "Capacity" pane says I'm using 1.83PB with 11.7TB available. That's clearly not accurate.
If I click into the arrow in that pane I get the Tiers page and it says my two Tiers respectively have 875TB used and 6.5TB available, and 1PB used and 5.2TB available.
What the hell are these numbers describing?
Hope to hear from you
On 6/10/2021 9:24 AM, Rue, Randy wrote:
Hello All,
We're migrating from a FAS to a new AFF that has inline compression and a guarantee of 3X compression.
I'm trying to convert a graphite/snmp graphing system that reports our overall aggregate space usage to the new system.
A straightforward graph of used and free space on the data aggregates/tiers shows the right portion of space used but seems to be reporting pre-compression usage (and we appear to be getting less than 3X).
The System Manager webUI says we're getting ~120:1 "Data Reduction" but it also says we're using 1.74PB and have 14TB available. In fact we currently have 48 x 900GB SSDs in two disk groups/tiers and about 40TB of actual unstructured data.
Is there a doc somewhere on understanding space reporting with the new system including meaningful reporting of compression returns?
Grateful for any help,
Randy in Seattle
_______________________________________________ Toasters mailing list Toasters@teaparty.net https://www.teaparty.net/mailman/listinfo/toasters
Those super large artificial numbers:
Basically, if you were to rehydrate *all* the snapshots on the system, I think that is the amount of space it would consume. I am not a fan, more of a marketing gimmick. i wish/hope it changes. I see questions on it way too much --tmac
*Tim McCarthy, **Principal Consultant*
*Proud Member of the #NetAppATeam https://twitter.com/NetAppATeam*
*I Blog at TMACsRack https://tmacsrack.wordpress.com/*
On Tue, Jul 6, 2021 at 3:21 PM Jeff Bryer bryer@sfu.ca wrote:
I would assume that when NetApp promised you 3x savings they weren't
referring to just compression. The AFF also does in-line deduplication, plus
there is compaction. And some things also count in savings from snapshots.
The 180x number, is that in the circle on the tiers page? If you hover over it,
it will show the value without snapshots counted.
If you want a better break down try using (CLI):
aggr show-efficiency -aggregate aggr -instance
*From:* Toasters toasters-bounces@teaparty.net on behalf of Rue, Randy < randyrue@gmail.com> *Sent:* Tuesday, July 6, 2021 11:51 AM *To:* Toasters *Subject:* Re: space reporting on AFF's with compression?
also, that pane says I'm getting 108X data reduction. Is that the new inline compression? And is that number likely to be accurate after NetApp promised us (in writing!) compression?
On 7/6/2021 11:42 AM, Rue, Randy wrote:
OK, no responses to my below so let me ask a simpler question.
The System Manager Dashboard's "Capacity" pane says I'm using 1.83PB with 11.7TB available. That's clearly not accurate.
If I click into the arrow in that pane I get the Tiers page and it says my two Tiers respectively have 875TB used and 6.5TB available, and 1PB used and 5.2TB available.
What the hell are these numbers describing?
Hope to hear from you
On 6/10/2021 9:24 AM, Rue, Randy wrote:
Hello All,
We're migrating from a FAS to a new AFF that has inline compression and a guarantee of 3X compression.
I'm trying to convert a graphite/snmp graphing system that reports our overall aggregate space usage to the new system.
A straightforward graph of used and free space on the data aggregates/tiers shows the right portion of space used but seems to be reporting pre-compression usage (and we appear to be getting less than 3X).
The System Manager webUI says we're getting ~120:1 "Data Reduction" but it also says we're using 1.74PB and have 14TB available. In fact we currently have 48 x 900GB SSDs in two disk groups/tiers and about 40TB of actual unstructured data.
Is there a doc somewhere on understanding space reporting with the new system including meaningful reporting of compression returns?
Grateful for any help,
Randy in Seattle
Toasters mailing list Toasters@teaparty.net https://www.teaparty.net/mailman/listinfo/toasters _______________________________________________ Toasters mailing list Toasters@teaparty.net https://www.teaparty.net/mailman/listinfo/toasters
On 2021-07-07 05:18, tmac wrote:
Those super large artificial numbers:
Basically, if you were to rehydrate *all* the snapshots on the system, I think that is the amount of space it would consume.
Yes, I think you're right. This way of presenting a number related to saving of volume is inane IMHO and that opinion has not changed in a long time. Sure, there are (were) really STUPID ways to "take snapshots" that once existed in the IT business but no one has anything like that any more so comparing with a total "rehydration" and calling that volume savings is very close t falsehood
Regards, /M
I am not a fan, more of a marketing gimmick. i wish/hope it changes. I see questions on it way too much --tmac
*Tim McCarthy, */Principal Consultant/
*Proud Member of the #NetAppATeam https://twitter.com/NetAppATeam*
*I Blog at TMACsRack
Yeah, that's not a useful number in any context and it just creates confusion. What I need to know is how much uncompressed data I'm serving and what portion of the physical space it's consuming. I need to know what my users are storing and when I need to plan for expansion.
On 7/6/2021 8:18 PM, tmac wrote:
Those super large artificial numbers:
Basically, if you were to rehydrate *all* the snapshots on the system, I think that is the amount of space it would consume. I am not a fan, more of a marketing gimmick. i wish/hope it changes. I see questions on it way too much --tmac
*Tim McCarthy, */Principal Consultant/
*Proud Member of the #NetAppATeam https://twitter.com/NetAppATeam*
*I Blog at TMACsRack https://tmacsrack.wordpress.com/*
On Tue, Jul 6, 2021 at 3:21 PM Jeff Bryer <bryer@sfu.ca mailto:bryer@sfu.ca> wrote:
I would assume that when NetApp promised you 3x savings they weren't referring to just compression. The AFF also does in-line deduplication, plus there is compaction. And some things also count in savings from snapshots. The 180x number, is that in the circle on the tiers page? If you hover over it, it will show the value without snapshots counted. If you want a better break down try using (CLI): aggr show-efficiency -aggregate aggr -instance ------------------------------------------------------------------------ *From:* Toasters <toasters-bounces@teaparty.net <mailto:toasters-bounces@teaparty.net>> on behalf of Rue, Randy <randyrue@gmail.com <mailto:randyrue@gmail.com>> *Sent:* Tuesday, July 6, 2021 11:51 AM *To:* Toasters *Subject:* Re: space reporting on AFF's with compression? also, that pane says I'm getting 108X data reduction. Is that the new inline compression? And is that number likely to be accurate after NetApp promised us (in writing!) compression? On 7/6/2021 11:42 AM, Rue, Randy wrote: > OK, no responses to my below so let me ask a simpler question. > > The System Manager Dashboard's "Capacity" pane says I'm using 1.83PB > with 11.7TB available. That's clearly not accurate. > > If I click into the arrow in that pane I get the Tiers page and it > says my two Tiers respectively have 875TB used and 6.5TB available, > and 1PB used and 5.2TB available. > > What the hell are these numbers describing? > > > Hope to hear from you > > > On 6/10/2021 9:24 AM, Rue, Randy wrote: >> Hello All, >> >> We're migrating from a FAS to a new AFF that has inline compression >> and a guarantee of 3X compression. >> >> I'm trying to convert a graphite/snmp graphing system that reports >> our overall aggregate space usage to the new system. >> >> A straightforward graph of used and free space on the data >> aggregates/tiers shows the right portion of space used but seems to >> be reporting pre-compression usage (and we appear to be getting less >> than 3X). >> >> The System Manager webUI says we're getting ~120:1 "Data Reduction" >> but it also says we're using 1.74PB and have 14TB available. In fact >> we currently have 48 x 900GB SSDs in two disk groups/tiers and about >> 40TB of actual unstructured data. >> >> Is there a doc somewhere on understanding space reporting with the >> new system including meaningful reporting of compression returns? >> >> >> Grateful for any help, >> >> Randy in Seattle >> _______________________________________________ Toasters mailing list Toasters@teaparty.net <mailto:Toasters@teaparty.net> https://www.teaparty.net/mailman/listinfo/toasters <https://www.teaparty.net/mailman/listinfo/toasters> _______________________________________________ Toasters mailing list Toasters@teaparty.net <mailto:Toasters@teaparty.net> https://www.teaparty.net/mailman/listinfo/toasters <https://www.teaparty.net/mailman/listinfo/toasters>
-
Jeff Bryer -
Michael Bergman -
Rue, Randy -
tmac