On Mon, Oct 22, 2007 at 12:55:48PM -0700, Blake Golliher wrote:
I have to deal with millions of objects in filesystems, I highly recommend subdirectories. look at your nfs_hist output. First do nfs_hist -z. Then count to 30 and run nfs_hist again. It's a histogram of all nfs ops, and how long they took in milisecond buckets. I'd bet lookup is taking a very long time. When dealing with a large number of objects, sensible directory structures are key.
Yes, but to be fair, this is a weakness in the wafl filesystem. You cannot have everything, and wafl has made a trade off in the way it stores file metadata that makes it slow to handle large number of files in a directory.
I am not sure if netapp is planning any enhancements in this area or even what would be possible.
Anybody care to comment?
Regards, pdg
--
See mail headers for contact information.