On 2013-1-11 23:56 , Fletcher Cocquyt wrote: [...]
But the numbers on the vendors dashboard were different. I asked vendor support and the next day they confirmed (as I suspected) they were converting using powers of 10 But what I did not know, was this was on purpose due to the disk manufacturer's convention: http://en.wikipedia.org/wiki/Hard_disk_drive#Units
It's worse than that. First, see http://xkcd.com/394/ for more confusion.
And currently, drive manufacturers allow themselves to be about 10% to 20% off in the number of bytes. (so the xkcd comic is probably right about the size of a "marketing KB"). The error, I might add, is never in your advantage. A "1 TByte" drive won't fit 1000^4 bytes. It is actually about 888 * 1000^3 bytes. Or slightly less than 850 GByte (real 1024^3 Byte = 1 Gbytes).
In sizing calculations, I estimate "df" will give me a number that's 46% of the size that the marketing department puts on the bill (including spares, raid overhead, OS overhead and snapshot overhead). In mirrored configurations, it's half that amount (23%).
For someone with a computer science background this was surprising to not have uniform definitions of units across media
I think this old usenet signature describes the IT landscape pretty well: "You're in a twisty maze of standards, all conflicting".
Ram manufacturers don't do this according to the article they use (do Flash or SSD makers?)
Yes, flash sizing has the same "feature". On the other hand, flash drives are really always bigger than advertised because of bad blocks and wear leveling and write (or erase) buffering. But you can't really use that because of the smart controller.
Made me wonder what the Netapp reporting tools, OpsMgr, System Manager, DFM etc do when reporting the #bytes available on a HDD as Tb do they do binary or decimal conversions?
I don't know about those, but I do know all command-line tools, SNMP queries and API calls report "real" power-of-1024 units. So I suspect DFM et al will, too.
What are some other implications of the unit definition difference?
That the 'aggr create' and 'aggr add' commands are irritating when you have a number of different-sized disks available.
"so sysconfig -r says these spares are 418000MB... should I use them as 'aggr create newaggr 16@400g' or '16@450g' or '16@500g' ?"
You have to know what label the marketing department has put on the drives that are in your system, or you have to guess. (The answer: these disks are 450g. 500g would have 423111MB available. Duh!)
And there's more confusion ahead, as the current 3TB drives are really only 2.5TB, but there's a new batch of 3TB drives coming that are supposed to be really 2.9TB (which is revolutionary, because even if that's 2900000 real Mbytes, that would still be 3040870400000 bytes, which is more than advertised!) (but I haven't seen those drives yet).