64MB file on an F740 running 5.1.2, minra=on on that RAID volume. The filesystem is mounted via NFSv3 and UDP transport. Network connection is fast Ethernet via crossover cable.
First run is from a Sun E450 reading in the file with dd and 32K block size. Second run is from another E450 (same network config, different NIC on the F740) reading in the same file. Reading a file from disk seems to be exceptionally slow. Reading the same file from cache is faster, but still not close to what I'd expect over an otherwise quiet 100 Mbps link. Is there something I need to tune?
CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 19% 455 0 0 92 3890 3639 0 0 0 7 18% 437 0 0 90 3732 3507 0 0 0 7 18% 436 0 0 89 3720 3480 0 0 0 7 16% 364 0 0 74 3109 2922 0 0 0 7 18% 426 0 0 86 3638 3411 0 0 0 7 18% 435 0 0 88 3712 3480 0 0 0 7 [...]
CPU NFS CIFS HTTP Net kB/s Disk kB/s Tape kB/s Cache in out read write read write age 12% 560 0 0 122 4708 0 0 0 0 2 19% 1029 0 0 224 8780 0 0 0 0 2 19% 993 0 0 217 8472 0 0 0 0 2 19% 1017 0 0 222 8677 0 0 0 0 2 20% 1025 0 0 224 8746 0 0 0 0 2 19% 1017 0 0 222 8677 0 0 0 0 2 [...]