Hi toasters,
We have a couple of 100 TBs of heterogenous storage (some from netapp), and see that our storage grows close to 60% over year. We were looking at alternatives for managing this data growth. Compression was one of the techniques we were considering for our nearline and (possibly) primary storage. Our applications cannot change to do their own compression, so it boils down to doing this in the storage layer or through an external device. Also, we'd like to not have any performance impact and compression to happen transparently. Deduplication technology from storage vendors would help, but it is not a hetrogenous solution.
I am not aware of any compression technology from netapp. Are you folks aware of any solutions? Would love to hear your experience with those or other alternative ways you deal with the storage growth problem while managing costs.
Thx, Wilbur
Hi Wilbur,
I have tested one of these and found it to work well - however this was only in a test environment. www.storewiz.com - have a look.
Thanks
Michael.
From: Wilbur Castro [mailto:wilburcastro@gmail.com] Sent: Tuesday, 27 February 2007 8:55 AM To: toasters@mathworks.com Subject: data management through compression for Netapp
Hi toasters,
We have a couple of 100 TBs of heterogenous storage (some from netapp), and see that our storage grows close to 60% over year. We were looking at alternatives for managing this data growth. Compression was one of the techniques we were considering for our nearline and (possibly) primary storage. Our applications cannot change to do their own compression, so it boils down to doing this in the storage layer or through an external device. Also, we'd like to not have any performance impact and compression to happen transparently. Deduplication technology from storage vendors would help, but it is not a hetrogenous solution.
I am not aware of any compression technology from netapp. Are you folks aware of any solutions? Would love to hear your experience with those or other alternative ways you deal with the storage growth problem while managing costs.
Thx, Wilbur
Wilbur:
What are your performance requirements? Adding compression/deDup into this has a serious impact on I/O performance, it will pretty much totally screw any read-ahead optimization.
If you still want to go ahead, look at Data domain's Gateway series. It doesn't formally support Netapp, but i'm sure you could use it. This will do exactly what you want, as long as you want NFS!
Glenn (the other one)
________________________________
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Wilbur Castro Sent: Monday, February 26, 2007 4:55 PM To: toasters@mathworks.com Subject: data management through compression for Netapp
Hi toasters,
We have a couple of 100 TBs of heterogenous storage (some from netapp), and see that our storage grows close to 60% over year. We were looking at alternatives for managing this data growth. Compression was one of the techniques we were considering for our nearline and (possibly) primary storage. Our applications cannot change to do their own compression, so it boils down to doing this in the storage layer or through an external device. Also, we'd like to not have any performance impact and compression to happen transparently. Deduplication technology from storage vendors would help, but it is not a hetrogenous solution.
I am not aware of any compression technology from netapp. Are you folks aware of any solutions? Would love to hear your experience with those or other alternative ways you deal with the storage growth problem while managing costs.
Thx, Wilbur
-
Glenn Dekhayser -
Michael Schipp -
Wilbur Castro