Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
____________________________ Matt Davies Director of International IT Operations General Atlantic 23 Savile Row London W1S 2ET
Tel: +44 207 484 3203 Fax: +44 207 484 2803 Mobile: +44 777 559 4265 ____________________________
________________________________ _____________________________________________________________ This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
Hi,
You could take a look at "sysstat" command, run it from an admin host. But I think SNMP is a better option. I haven't used it myself, but, you could always take a look at the NetApp MIBs.
I hope that helps.
-LOhit
On Wed, Nov 17, 2010 at 9:56 PM, Davies, Matt MDAVIES@generalatlantic.comwrote:
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
Matt Davies
Director of International IT Operations
General Atlantic
23 Savile Row
London
W1S 2ET
Tel: +44 207 484 3203
Fax: +44 207 484 2803
Mobile: +44 777 559 4265
This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
You can run iostat and parse corresponding columns.
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Davies, Matt Sent: Wednesday, November 17, 2010 10:26 AM To: toasters@mathworks.com Subject: Measuring IOPS
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
____________________________ Matt Davies Director of International IT Operations General Atlantic 23 Savile Row London W1S 2ET
Tel: +44 207 484 3203 Fax: +44 207 484 2803 Mobile: +44 777 559 4265 ____________________________
________________________________ _____________________________________________________________ This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Anheuser-Busch InBev Email Disclaimer www.ab-inbev.com
I apologize, I meant sysstat. LoHit is correct. : )
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Fang, Ming Sent: Wednesday, November 17, 2010 10:53 AM To: Davies, Matt; toasters@mathworks.com Subject: RE: Measuring IOPS
You can run iostat and parse corresponding columns.
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Davies, Matt Sent: Wednesday, November 17, 2010 10:26 AM To: toasters@mathworks.com Subject: Measuring IOPS
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
____________________________ Matt Davies Director of International IT Operations General Atlantic 23 Savile Row London W1S 2ET
Tel: +44 207 484 3203 Fax: +44 207 484 2803 Mobile: +44 777 559 4265 ____________________________
________________________________ _____________________________________________________________ This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You. ________________________________ Anheuser-Busch InBev Email Disclaimer www.ab-inbev.comhttp://www.ab-inbev.com/disclaimer.cfm
I asked a similar question on the Netapp community. I got several hundred reads but not a single response. Disappointing.
My question specifically was how to get the Perf Advisor data from DFM via the cli, specifically for scripting and throwing the data into other applications like mrtg. Perf Advisor collects not only total iops but type of iop as well; read, write, or meta. Very nice info but using PA all the time is too heavyweight for me.
If all you want is total iops, the sysstat parse, as already mentioned, on a periodic basis is simple enough to do.
I'm hoping a Netapp lurker might have an answer to my query though....
Jeff Kennedy Qualcomm, Incorporated QCT Engineering Compute 858-651-6592
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Davies, Matt Sent: Wednesday, November 17, 2010 8:26 AM To: toasters@mathworks.com Subject: Measuring IOPS
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
____________________________ Matt Davies Director of International IT Operations General Atlantic 23 Savile Row London W1S 2ET
Tel: +44 207 484 3203 Fax: +44 207 484 2803 Mobile: +44 777 559 4265 ____________________________
________________________________ _____________________________________________________________ This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
On 11/17/2010 12:35 PM, Kennedy, Jeffrey wrote:
I asked a similar question on the Netapp community. I got several hundred reads but not a single response. Disappointing.
My question specifically was how to get the Perf Advisor data from DFM via the cli, specifically for scripting and throwing the data into other applications like mrtg. Perf Advisor collects not only total iops but type of iop as well; read, write, or meta. Very nice info but using PA all the time is too heavyweight for me.
If all you want is total iops, the sysstat parse, as already mentioned, on a periodic basis is simple enough to do.
I’m hoping a Netapp lurker might have an answer to my query though….
I don't know how to get Perf Advisor data from the dfm cli, however form filers you could look at 'stats show'. That will give you ops per aggr/volume/qtree - in read/wrote/other (if memory serves).
--rdp
Jeff Kennedy
Qualcomm, Incorporated
QCT Engineering Compute
858-651-6592
*From:*owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] *On Behalf Of *Davies, Matt *Sent:* Wednesday, November 17, 2010 8:26 AM *To:* toasters@mathworks.com *Subject:* Measuring IOPS
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
Matt Davies
Director of International IT Operations
General Atlantic
23 Savile Row
London
W1S 2ET
Tel: +44 207 484 3203
Fax: +44 207 484 2803
Mobile: +44 777 559 4265
This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
I'm not much on coding, but it sounds like the NetApp Manageability SDK may be what you are looking for. http://communities.netapp.com/docs/DOC-1152
This email is UNCLASSIFIED.
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Kennedy, Jeffrey Sent: Wednesday, November 17, 2010 12:35 PM To: Davies, Matt; toasters@mathworks.com Subject: RE: Measuring IOPS
I asked a similar question on the Netapp community. I got several hundred reads but not a single response. Disappointing.
My question specifically was how to get the Perf Advisor data from DFM via the cli, specifically for scripting and throwing the data into other applications like mrtg. Perf Advisor collects not only total iops but type of iop as well; read, write, or meta. Very nice info but using PA all the time is too heavyweight for me.
If all you want is total iops, the sysstat parse, as already mentioned, on a periodic basis is simple enough to do.
I'm hoping a Netapp lurker might have an answer to my query though....
Jeff Kennedy
Qualcomm, Incorporated
QCT Engineering Compute
858-651-6592
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Davies, Matt Sent: Wednesday, November 17, 2010 8:26 AM To: toasters@mathworks.com Subject: Measuring IOPS
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
____________________________
Matt Davies
Director of International IT Operations
General Atlantic
23 Savile Row
London
W1S 2ET
Tel: +44 207 484 3203
Fax: +44 207 484 2803
Mobile: +44 777 559 4265
____________________________
________________________________
_____________________________________________________________ This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
Yes, I was going to suggest that too. If you download our SDK, there is a Windows tool called zexplore.exe (for ZAPI explorer, named for Zephyr - the code name for the original API project). This will let you connect to a NetApp controller and ... explore. Be careful. It actually executes APIs, so things like volume-destroy do exactly as the name suggests. perf-object-* are the equivalent APIs to the stats command Rich Payne mentioned. Any halfway decent OO perl hacker could whip up a script to pull the objects/instances/counters you want and make them all pretty. Or you could look at the PowerShell tools we've posted on Communities.
Share and enjoy!
Peter
From: Holland, William L [mailto:HollandWL@state.gov] Sent: Wednesday, November 17, 2010 10:22 AM To: Kennedy, Jeffrey; Davies, Matt; toasters@mathworks.com Subject: RE: Measuring IOPS
I'm not much on coding, but it sounds like the NetApp Manageability SDK may be what you are looking for. http://communities.netapp.com/docs/DOC-1152
This email is UNCLASSIFIED.
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Kennedy, Jeffrey Sent: Wednesday, November 17, 2010 12:35 PM To: Davies, Matt; toasters@mathworks.com Subject: RE: Measuring IOPS
I asked a similar question on the Netapp community. I got several hundred reads but not a single response. Disappointing.
My question specifically was how to get the Perf Advisor data from DFM via the cli, specifically for scripting and throwing the data into other applications like mrtg. Perf Advisor collects not only total iops but type of iop as well; read, write, or meta. Very nice info but using PA all the time is too heavyweight for me.
If all you want is total iops, the sysstat parse, as already mentioned, on a periodic basis is simple enough to do.
I'm hoping a Netapp lurker might have an answer to my query though....
Jeff Kennedy
Qualcomm, Incorporated
QCT Engineering Compute
858-651-6592
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Davies, Matt Sent: Wednesday, November 17, 2010 8:26 AM To: toasters@mathworks.com Subject: Measuring IOPS
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
____________________________
Matt Davies
Director of International IT Operations
General Atlantic
23 Savile Row
London
W1S 2ET
Tel: +44 207 484 3203
Fax: +44 207 484 2803
Mobile: +44 777 559 4265
____________________________
________________________________
_____________________________________________________________ This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
If you want to avoid using the SDK, you can use the dfm cli to display data that you normally see in the perf advisor:
The cmd sets are:
dfm perf data retrieve
Example for total ops of all vols: dfm perf data retrieve -o <filer name> -C volume:total_ops -M nov -s 3600 -m mean
Regards Andreas
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Learmonth, Peter Sent: Wednesday, November 17, 2010 8:09 PM To: Holland, William L; Kennedy, Jeffrey; Davies, Matt; toasters@mathworks.com Subject: RE: Measuring IOPS
Yes, I was going to suggest that too. If you download our SDK, there is a Windows tool called zexplore.exe (for ZAPI explorer, named for Zephyr - the code name for the original API project). This will let you connect to a NetApp controller and ... explore. Be careful. It actually executes APIs, so things like volume-destroy do exactly as the name suggests. perf-object-* are the equivalent APIs to the stats command Rich Payne mentioned. Any halfway decent OO perl hacker could whip up a script to pull the objects/instances/counters you want and make them all pretty. Or you could look at the PowerShell tools we've posted on Communities.
Share and enjoy!
Peter
From: Holland, William L [mailto:HollandWL@state.gov] Sent: Wednesday, November 17, 2010 10:22 AM To: Kennedy, Jeffrey; Davies, Matt; toasters@mathworks.com Subject: RE: Measuring IOPS
I'm not much on coding, but it sounds like the NetApp Manageability SDK may be what you are looking for. http://communities.netapp.com/docs/DOC-1152
This email is UNCLASSIFIED.
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Kennedy, Jeffrey Sent: Wednesday, November 17, 2010 12:35 PM To: Davies, Matt; toasters@mathworks.com Subject: RE: Measuring IOPS
I asked a similar question on the Netapp community. I got several hundred reads but not a single response. Disappointing.
My question specifically was how to get the Perf Advisor data from DFM via the cli, specifically for scripting and throwing the data into other applications like mrtg. Perf Advisor collects not only total iops but type of iop as well; read, write, or meta. Very nice info but using PA all the time is too heavyweight for me.
If all you want is total iops, the sysstat parse, as already mentioned, on a periodic basis is simple enough to do.
I'm hoping a Netapp lurker might have an answer to my query though....
Jeff Kennedy Qualcomm, Incorporated QCT Engineering Compute 858-651-6592
From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Davies, Matt Sent: Wednesday, November 17, 2010 8:26 AM To: toasters@mathworks.com Subject: Measuring IOPS
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
____________________________ Matt Davies Director of International IT Operations General Atlantic 23 Savile Row London W1S 2ET
Tel: +44 207 484 3203 Fax: +44 207 484 2803 Mobile: +44 777 559 4265 ____________________________
________________________________ _____________________________________________________________ This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
WINCOR NIXDORF International GmbH Sitz der Gesellschaft: Paderborn Registergericht Paderborn HRB 3507 Geschäftsführer: Eckard Heidloff (Vorsitzender), Stefan Auerbach, Dr. Jürgen Wunram Vorsitzender des Aufsichtsrats: Karl-Heinz Stiller Steuernummer: 339/5884/0020 - Ust-ID Nr.: DE812927716 - WEEE-Reg.-Nr. DE44477193
Diese E-Mail enthält vertrauliche Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese E-Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser E-Mail ist nicht gestattet.
This e-mail may contain confidential information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorised copying, disclosure or distribution of the material in this e-mail is strictly forbidden.
snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname misc64CifsOps snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname misc64NfsOps snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname iscsi64Ops
On 11/17/2010 8:26 AM, Davies, Matt wrote:
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
Matt Davies
Director of International IT Operations
General Atlantic
23 Savile Row
London
W1S 2ET
Tel: +44 207 484 3203
Fax: +44 207 484 2803
Mobile: +44 777 559 4265
This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
Oops.. had a typo:
snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname misc64CifsOps.0 snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname misc64NfsOps.0 snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname iscsi64Ops.0
On 11/17/2010 11:18 AM, Robert McDermott wrote:
snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname misc64CifsOps snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname misc64NfsOps snmpget -m /path/to/mibs/netapp64.mib -c public -v 2c hostname iscsi64Ops
If you have a local account (or a readonly account, or a or something with a role that allows ssh access) you can drop a key on the filer, and use key based authentication on the filer. Then all kinds of things are possible to capture via simple shell scripting.
[bgolliher@whatever:~] $ ssh toastpower stats show -i 1 -n 10 -e system:system:ops Instance nfs_ops cifs_ops http_ops fcp_ops iscsi_ops read_ops write_ops /s /s /s /s /s /s /s system 695 0 0 0 0 2 9 system 790 21 0 0 0 115 1 system 1831 0 0 0 0 70 15 system 2147 3 0 0 0 277 119 system 1029 0 0 0 0 43 6 system 937 2 0 0 0 84 0 system 1329 0 0 0 0 63 9 system 605 3 0 0 0 35 6 system 905 0 0 0 0 40 38 system 759 2 0 0 0 73 13 [bgolliher@whatever:~] $
That's a stupid simple example, but you get the idea. Another great one is to capture latency per volume like this "stats show -i 1 -n 10 -e volume:*:latency"
That's a pretty basic method, and in my option more useful then the snmp implementation netapp puts out, and easier then trying to use perl to implement their api. But I'm not much of a perl guy so YMMV.
-Blake
On Wed, Nov 17, 2010 at 8:26 AM, Davies, Matt MDAVIES@generalatlantic.com wrote:
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
Matt Davies
Director of International IT Operations
General Atlantic
23 Savile Row
London
W1S 2ET
Tel: +44 207 484 3203
Fax: +44 207 484 2803
Mobile: +44 777 559 4265
This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
I agree with Blake, in addition you can dump these stats to a csv file and import them to what ever you need. We do have Cacti set up here using the SDK to query the filer for performance statistics but it's writes a load of data to our debug logs - pretty much making them useless for troubleshooting.
Does give pretty utilization graphs though.
-----Original Message----- From: owner-toasters@mathworks.com [mailto:owner-toasters@mathworks.com] On Behalf Of Blake Golliher Sent: Wednesday, November 17, 2010 2:32 PM To: Davies, Matt Cc: toasters@mathworks.com Subject: Re: Measuring IOPS
If you have a local account (or a readonly account, or a or something with a role that allows ssh access) you can drop a key on the filer, and use key based authentication on the filer. Then all kinds of things are possible to capture via simple shell scripting.
[bgolliher@whatever:~] $ ssh toastpower stats show -i 1 -n 10 -e system:system:ops Instance nfs_ops cifs_ops http_ops fcp_ops iscsi_ops read_ops write_ops /s /s /s /s /s /s /s system 695 0 0 0 0 2 9 system 790 21 0 0 0 115 1 system 1831 0 0 0 0 70 15 system 2147 3 0 0 0 277 119 system 1029 0 0 0 0 43 6 system 937 2 0 0 0 84 0 system 1329 0 0 0 0 63 9 system 605 3 0 0 0 35 6 system 905 0 0 0 0 40 38 system 759 2 0 0 0 73 13 [bgolliher@whatever:~] $
That's a stupid simple example, but you get the idea. Another great one is to capture latency per volume like this "stats show -i 1 -n 10 -e volume:*:latency"
That's a pretty basic method, and in my option more useful then the snmp implementation netapp puts out, and easier then trying to use perl to implement their api. But I'm not much of a perl guy so YMMV.
-Blake
On Wed, Nov 17, 2010 at 8:26 AM, Davies, Matt MDAVIES@generalatlantic.com wrote:
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a
filer
is handling via SNMP or some way to script a collection ?
Thanks
Matt
Matt Davies
Director of International IT Operations
General Atlantic
23 Savile Row
London
W1S 2ET
Tel: +44 207 484 3203
Fax: +44 207 484 2803
Mobile: +44 777 559 4265
This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication
is
strictly prohibited. If you have received this communication in error, please
erase
all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.
Please be advised that this email may contain confidential information. If you are not the intended recipient, please notify us by email by replying to the sender and delete this message. The sender disclaims that the content of this email constitutes an offer to enter into, or the acceptance of, any agreement; provided that the foregoing does not invalidate the binding effect of any digital or other electronic reproduction of a manual signature that is included in any attachment.
Matt -
To review, there are several options:
1. Use SNMP. Scan the file netapp.mib and look for "Ops". You should find various protocols returning IOPs.
2. Parse sysstat output.
3. Use the APIs. There are 2 types of APIs: ONTAP and OnCommand (Operations Manger, DFM). The ONTAP APIs will only give you information about a specific storage controller. The OnCommand APIs can give you information about multiple storage controllers that the OnCommand server is managing. One person already gave you a communities pointer to the APIs. Here is a pointer to using Performance Management APIs: http://communities.netapp.com/docs/DOC-1044.
You should also check-out the NetApp communities. It contains a lot of information.
Regards,
- Rick -
From: Davies, Matt [mailto:MDAVIES@generalatlantic.com] Sent: Wednesday, November 17, 2010 8:26 AM To: toasters@mathworks.com Subject: Measuring IOPS
Hi all,
Does anyone know if there is a way to calculate the number of IOPS a filer is handling via SNMP or some way to script a collection ?
Thanks
Matt
____________________________
Matt Davies
Director of International IT Operations
General Atlantic
23 Savile Row
London
W1S 2ET
Tel: +44 207 484 3203
Fax: +44 207 484 2803
Mobile: +44 777 559 4265
____________________________
________________________________
_____________________________________________________________ This e-mail (including all attachments) is confidential and may be privileged. It is for the exclusive use of the addressee only. If you are not the addressee, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please erase all copies of the message and its attachments and notify us immediately at help@generalatlantic.com . Thank You.