Thanks Wolfgang,
If I may, can I ask a few more questions.
How many offline storage shares do you have configured?
How many rules do you have defined for each primary storage policy?
Your network infrastructure is similar in throughput to what we have configured. Hardware being FAS960c's migrating to R150's. My initial pilot involved scanning ~300Gb, of which we migrated around 60-70 Gb in about 12-20 hours.
For our first stage production run we scaled this up to scanning 2Tb and migrating around 900Gb. There were 160 rules with 160 offline storage's configured. Of the 900Gb marked for transfer, we saw only 411mb transferred in 56 hours. Not good, not good at all. Especially since we are looking at scanning up to 4x this amount of data (~20-25 million files) at the end point.
It seems that the increased # rules and offline storage's is causing some problems with the application throughput. It also seems to transfer files in serial fashion. i.e. Waits for one file to complete transfer before starting the next. It would seem logical to me that the most efficient way would be to open multiple threads to manage the transfer.
Aaron
_____
From: Scholz Wolfgang [mailto:Wolfgang.Scholz@fja.com] Sent: Monday, 24 January 2005 4:36 PM To: 'Hill, Aaron'; 'toasters@mathworks.com' Subject: AW: Experiences: ILM with Nuview FLM
hi aaron,
we are using flm quite a while here but not with your amount of data. our total storage capacity is around 2 tb´s . used space on our cifs volume is 335gb with over 4,5 million files on it. we scheduled our policy to run once every week. in the last policy run we migrated 65624 files, alltogether 7GB of data. it took 3 hours and 13 minutes to complete the policy run. we have here an f825 filer wich is connected to the network over a vif with 2 gb. our secondary storage is a hp storageworks 1200s nas appliance which is connected at 100/mbps to the network.
hope that helps
wolfgang
_________________________
Wolfgang Scholz
FJA Feilmeier & Junker GmbH
Leonhard-Moll-Bogen 10
81373 Muenchen
Tel. : ++49 89 76901 7470
Fax : ++49 89 76901 9500
email: wolfgang.scholz@fja.com
Hey there,
I am interested in hearing from other Filer admins that are using the Nuview File Lifecycle Manager (FLM) software for data archiving or Information Lifecycle Management (ILM).
I am in the process of rolling this product out in a large environment with the aim of migrating TB of data. At the moment I am seeing extremely slow migration rates.
Has anyone else experienced this or in contrast has had very fast or even acceptable transfer rates?
Thanks,
Aaron
************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au. If you no longer wish to receive commercial electronic messages from us, please reply to this e-mail by typing Unsubscribe in the subject line. ***************************************************************