toasters July 2004

toasters@lists.teaparty.net

60 participants
79 discussions

RE: VSCAN and Backsups
by Martin Hughes 27 Jul '04

27 Jul '04

We have our backups set to run over CIFS shares that have the vscan disabled. We can backup at faster speed and the filer is still protected. We found it easiest to duplicate all of our root shares in this manner. cifs shares -add <sharename> <path> -novscan or -novscanread ________________________________ From: owner-toasters(a)mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Mike Sphar Sent: Monday, July 26, 2004 11:54 PM To: ''toasters(a)mathworks.com' ' Subject: RE: VSCAN and Backsups I may stand corrected, but I don't believe the part below is true. I don't believe the real-time settings on the Trend server have any bearing on which files are scanned. From what I see, it appears to me that the Netapp decides whether a file should be scanned or not, and then sends a specific manual "Please scan this file" request to the Trend server. The Netapp is supposed to "cache" which files have been scanned and verified as clean, I believe, so static files shouldn't be slowing down the backup process once they've been scanned the first time, no? -- Mike Sphar - Sr Systems Administrator - Remedy, a BMC Software Company -----Original Message----- From: Hill, Aaron [mailto:aaron.hill@cba.com.au] Sent: Monday, July 26, 2004 6:30 PM To: 'SKIP HOFMANN'; ''toasters(a)mathworks.com' ' Subject: RE: VSCAN and Backsups I think you said you were using trendmicro as the scanning server. If you are try setting your realtime scan to "incoming" only. I think this should improve your backup speed somewhat as the backup file read requests will no longer require a VSCAN before the file is handed over to the backup client. The problem here is that you need to be sure that all of the content currently on your filer is virus free. Because from now on, only incoming files will be scanned. Its not ideal. Would be nice if you could exclude your backup client from virus scans during file open requests. I don't know of trendmicro offering this.

1 0

RE: VSCAN and Backsups
by Mike Sphar 27 Jul '04

27 Jul '04

I may stand corrected, but I don't believe the part below is true. I don't believe the real-time settings on the Trend server have any bearing on which files are scanned. From what I see, it appears to me that the Netapp decides whether a file should be scanned or not, and then sends a specific manual "Please scan this file" request to the Trend server. The Netapp is supposed to "cache" which files have been scanned and verified as clean, I believe, so static files shouldn't be slowing down the backup process once they've been scanned the first time, no? -- Mike Sphar - Sr Systems Administrator - Remedy, a BMC Software Company -----Original Message----- From: Hill, Aaron [mailto:aaron.hill@cba.com.au] Sent: Monday, July 26, 2004 6:30 PM To: 'SKIP HOFMANN'; ''toasters(a)mathworks.com' ' Subject: RE: VSCAN and Backsups I think you said you were using trendmicro as the scanning server. If you are try setting your realtime scan to "incoming" only. I think this should improve your backup speed somewhat as the backup file read requests will no longer require a VSCAN before the file is handed over to the backup client. The problem here is that you need to be sure that all of the content currently on your filer is virus free. Because from now on, only incoming files will be scanned. Its not ideal. Would be nice if you could exclude your backup client from virus scans during file open requests. I don't know of trendmicro offering this.

1 0

RE: VSCAN and Backsups
by Hill, Aaron 26 Jul '04

26 Jul '04

Skip, Your VSCAN server is definitely the primary bottleneck as you have clearly identified. Although the fact you are using CIFS for your backup communication/share connection probably isn't helping either. For every single file that you backup, a vscan is being performed. Thus during these backup periods I would not be surprised if you see some of those VSCAN timeouts you found in the filer syslog/messages. As far as I understand it, the CIFS style backup will not utilize a snapshot for the backup like direct attach or NDMP will do. (Someone please set me straight with this if I am wrong!) I think you said you were using trendmicro as the scanning server. If you are try setting your realtime scan to "incoming" only. I think this should improve your backup speed somewhat as the backup file read requests will no longer require a VSCAN before the file is handed over to the backup client. The problem here is that you need to be sure that all of the content currently on your filer is virus free. Because from now on, only incoming files will be scanned. Its not ideal. Would be nice if you could exclude your backup client from virus scans during file open requests. I don't know of trendmicro offering this. The 1 Gb connection MAY help if you have identified the network as a bottleneck. Have you ruled out CPU maxxing on the AV box? No point increasing bandwidth to the server if the server can't handle any more requests. Your best option, as you have alluded to, is move away from CIFS to direct attach scsi or NDMP. I like NDMP and use it widely. However you may not have the necessary infrastructure. I don't know if Backup exec supports NDMP, so you may need to go to an enterprise version. Check the veritas site for this. In your case, direct attach might be better, as long as you have some tape drives to spare for this filer. As for compatibility of you tape drive, I would check the NOW site for the hardware compatibility lists with R200. Files Backed up: Incremental - 648,800 files, 300 GB Full - 2,340,000 files, 970 GB These aren't a large amount of files or quantity of data. However you may want to check the drive utilization for your raid groups on the R200 during the CIFS backup. Those babies aren't built for speed. Good luck, sounds like a fun upgrade. Aaron _____ From: SKIP HOFMANN [mailto:SKIP.HOFMANN@ttisg.com] Sent: Tuesday, 27 July 2004 7:17 AM To: ''toasters(a)mathworks.com' ' Subject: VSCAN and Backsups Hi all I am backing up data on a R200 over a 1 gig connection. The hardware that I'm using is. When I enable VSCAN on the filer the mb/minute in the backup job start going down, when I turn off VSCAN the MB/ minute start going up. I have set vscan options mandatory_scan to off. The VSCAN server and the filer are not connected via a gig speed its 100/mb im wondering if I make the connection from r200 to the VSCAN server 1 gig that this might speed up my backup jobs Skip Tape Library: ADIC, Scalar 24, firmware version 109A, SCSI connected to ISGBKHA Tapes Used: HP Ultrium 400 GB, LTO Media Files Backed up: Incremental - 648,800 files, 300 GB Full - 2,340,000 files, 970 GB ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au **************************************************

1 0

VSCAN and Backsups
by SKIP HOFMANN 26 Jul '04

26 Jul '04

Hi all I am backing up data on a R200 over a 1 gig connection. The hardware that I'm using is. When I enable VSCAN on the filer the mb/minute in the backup job start going down, when I turn off VSCAN the MB/ minute start going up. I have set vscan options mandatory_scan to off. The VSCAN server and the filer are not connected via a gig speed its 100/mb im wondering if I make the connection from r200 to the VSCAN server 1 gig that this might speed up my backup jobs Skip Tape Library: ADIC, Scalar 24, firmware version 109A, SCSI connected to ISGBKHA Tapes Used: HP Ultrium 400 GB, LTO Media Files Backed up: Incremental - 648,800 files, 300 GB Full - 2,340,000 files, 970 GB

1 0

Can this be done
by SKIP HOFMANN 26 Jul '04

26 Jul '04

Hi all In an effort to speed up our backups we want to know if it's possible to connect a ADIC, Scalar 24, firmware version 109A, SCSI connected to a R200 filer, and have the R200 run the backup jobs. Thanks for any input Skip

1 0

RE: Two questions
by SKIP HOFMANN 26 Jul '04

26 Jul '04

Thank you very much for your comments they are very helpful. Skip _____ From: Hill, Aaron [mailto:aaron.hill@cba.com.au] Sent: Sunday, July 25, 2004 5:22 PM To: SKIP HOFMANN; ''toasters(a)mathworks.com' ' Subject: RE: Two questions Skip, Oplock timeouts are fairly normal behaviour for CIFS oplocks. The vscan error can be a problem as I believe it may indicate that the virus scanner has not responded in time to a file scan request. This means that access to the file was given to the user (CIFS requestor) before the virus scan was completed. If the file was infected, then there is a chance your client may have been infected. Why is this happening? Maybe your vscan box is too busy and can't service all the requests and/or network connectivity is slow or there are errors. What kind of load are you seeing on your vscan box? What type of network connectivity? 1Gb, 100Mb? Maybe do a netdiag on the filer and check network connectivity for the AV box. Aaron _____ From: SKIP HOFMANN [mailto:SKIP.HOFMANN@ttisg.com] Sent: Saturday, 24 July 2004 4:03 AM To: ''toasters(a)mathworks.com' ' Subject: Two questions I'm getting messages in the syslog on my R200 that say "[vscan.server.completionRequestLost:warning] <javascript:popEMS('vscan.server.completionRequestLost');> : CIFS: Vscan server 10.20.0.58 completed a scan request for ONTAP_ADMIN$\vol\vol1\HA\cart\data\accnt\data\PSteinhart\vallecfundg.wpd but the original request was not found. And oplock break timed out to station ISGDRLV1 for file \\ISGIRVNETAPP02 <file:///\\ISGIRVNETAPP02> I'm using Trend AV for the filer does this message mean that may be a problem with the AV on either the management server or Vscan on the filer? Thanks for any help Much appreciated Skip ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au **************************************************

1 0

NetApp admin in Pheonix region?
by Darcy Brockbank 26 Jul '04

26 Jul '04

Hi All, I am a long time user of Netapp hardware, having bought a 1440 FASserver back when it was new and cutting edge :-). I've left the computer world for a couple of years, and when my brother started to have server issues I recommended a Netapp to him and his small company in Pheonix. Trying to help him get this set up remotely has shown itself to be impossible, and he has no external network connection that I can get in and configure his system. He's got a fresh Linux install, and a 700 series Netapp that has a CIFS and NFS license. The problem is permissions, he was unable to configure it so it would work with a Windows domain server (preferred) and he was unable to use the Linux box (UNIX illiterate) to get a simple password file set up and operational. There are too many small tweaks that can get set that screw him up. It isn't an advanced install, it just needs to have the setup completed so that Windows2000 users can connect up and have a home directory and authentication on the server, and a private directory exported for the Linux database server to store some files. Is there anyone in the Pheonix area who can handle a short paid consulting job to get this straightened out? I'd go, but I'm 2,000 miles away. Thanks, - darcy

1 0

RE: Two questions
by Hill, Aaron 26 Jul '04

26 Jul '04

Skip, Oplock timeouts are fairly normal behaviour for CIFS oplocks. The vscan error can be a problem as I believe it may indicate that the virus scanner has not responded in time to a file scan request. This means that access to the file was given to the user (CIFS requestor) before the virus scan was completed. If the file was infected, then there is a chance your client may have been infected. Why is this happening? Maybe your vscan box is too busy and can't service all the requests and/or network connectivity is slow or there are errors. What kind of load are you seeing on your vscan box? What type of network connectivity? 1Gb, 100Mb? Maybe do a netdiag on the filer and check network connectivity for the AV box. Aaron _____ From: SKIP HOFMANN [mailto:SKIP.HOFMANN@ttisg.com] Sent: Saturday, 24 July 2004 4:03 AM To: ''toasters(a)mathworks.com' ' Subject: Two questions I'm getting messages in the syslog on my R200 that say "[vscan.server.completionRequestLost:warning] <javascript:popEMS('vscan.server.completionRequestLost');> : CIFS: Vscan server 10.20.0.58 completed a scan request for ONTAP_ADMIN$\vol\vol1\HA\cart\data\accnt\data\PSteinhart\vallecfundg.wpd but the original request was not found. And oplock break timed out to station ISGDRLV1 for file \\ISGIRVNETAPP02 <file:///\\ISGIRVNETAPP02> I'm using Trend AV for the filer does this message mean that may be a problem with the AV on either the management server or Vscan on the filer? Thanks for any help Much appreciated Skip ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au **************************************************

1 0

RE: Auto Support option
by Hill, Aaron 26 Jul '04

26 Jul '04

Skip, Send us the filer output from this command (I find rsh/ssh the best for this); Options autosupport I am guessing you are trying to use the http/https for ASUPs, but I won't be sure until you send me that output. Also paste us a few lines from the /vol/vol0/etc/messages (\\<filer>\etc$\messages) file that concern these failed ASUPs. You seem to be logging into FilerView ok, so I am assuming there is no http authentication problems there. Thanks, Aaron _____ From: SKIP HOFMANN [mailto:SKIP.HOFMANN@ttisg.com] Sent: Saturday, 24 July 2004 3:57 AM To: ''toasters(a)mathworks.com' ' Subject: Auto Support option Hi all I'm trying to setup and use auto support on my R200. When I check in the syslogs on the filler I get a "[asup.post.badUrl:warning] <javascript:popEMS('asup.post.badUrl');> :" I'm using the Web interface to try and configure this. What am I missing here? Thanks for any help ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au **************************************************

1 0

RE: Veritas Backup Exec version 9.1 sp1
by Hill, Aaron 26 Jul '04

26 Jul '04

Skip, What kind of backup hardware are you using? Is it NDMP, direct attach SCSI etc. Tape technology? How many files are trying to backup? More files are going to take longer. Are you doing volume level or qtree level backups? What quantity of data are we talking here? Aaron _____ From: SKIP HOFMANN [mailto:SKIP.HOFMANN@ttisg.com] Sent: Saturday, 24 July 2004 4:54 AM To: ''toasters(a)mathworks.com' ' Subject: Veritas Backup Exec version 9.1 sp1 Hi We are noting it takes quite a long time to backup my R200 (version NetApp Release 6.5) our backup exec server keeps complaining about an agent not being installed. I have found this article from Veritas http://seer.support.veritas.com/docs/240654.htm <http://seer.support.veritas.com/docs/240654.htm> and was wondering if installing this unix agent would help speed up my backup jobs? Or if anyone has any ideas for me on how to speed these jobs up that would be great Skip ************** IMPORTANT MESSAGE ************** This e-mail message is intended only for the addressee(s) and contains information which may be confidential. If you are not the intended recipient please advise the sender by return email, do not use or disclose the contents, and delete the message and any attachments from your system. Unless specifically indicated, this email does not constitute formal advice or commitment by the sender or the Commonwealth Bank of Australia (ABN 48 123 123 124) or its subsidiaries. We can be contacted through our web site: commbank.com.au **************************************************

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

1997

toasters July 2004