Also, Ive noticed a max input rate of about 20Mb/sec into the filter, then the CPU tops out on my F760.
I understand that the NVRAM can only process 16Mb at a time before the system really gums up, but I did expect a little more input performance.
If your F760 is still of the unclustered variety (which I'm sure it is, as we haven't quite yet shipped the F700 series cluster release of Data ONTAP) then you will currently be enjoying the full 32 MB capacity of your NVRAM. In a clustered pair of filers however, each systems NVRAM is mirrored to the other, meaning that each filer's individual *effective* NVRAM capacity for the file system(s) that they are individually journaling is halved to 16 MB. They each still physically have 32 MB of NVRAM of course. ---
Yes, I have 32Mb of RAM, but at 50% or 10 seconds, the NVRAM flushes. I only buffer 16Mb before it takes a data dump *grin* if I understand correctly. In a clustered environment, I just use that other half of NVRAM to buffer to the other box instead of mirroring myself in case of a write failure (power, etc).
On the performance front, I'm afraid you would need to better stipulate precisely what you mean by a "20 Mb/sec input rate" for me or anyone else at NetApp to be able to make a useful comment on whether it looks about right or not. How are you determining this number? Is this MBytes/Sec or MBits/Sec? How many clients are you using, and through what networks are they talking to the filer? What software are you running? What is that software really doing on the I/O front? How are the timings being made? Etc... ---
Two clients, both on separate 100Mb interfaces, creating spool files for my news services using 'dd if/dev/zero of=<filename> count=<x>'. Hardware was dual Sparc250s with dual 300Mhz procs, 1Gb RAM, Solaris 5.6 Generic_105181-07.
Both clients were local to the box on a Catylist switch entering in on separate interfaces on the F760.
When I was seeing about 1300 NFSops/Sec and 18-20MegaBytes of input traffic, the CPU on the F760 would peg.
NVRAM writes took place every single second of the 'sysstat 1' on the console with no more than 16 or maybe on occasion 17Megabytes written per flush. (This is where I made the assumption that NVRAM buffering/flushing was the limiting factor on overall performance FROM the network)
Both clients were nfs2/udp.