I appear to have a problem with the lightly-loaded filer's quad 10/100 card or the cables connecting it to the switch. I should have more clue on the cables by Monday.
I moved traffic to the lightly-loaded filer to the on-board 10/100 port (F760). iostat looked better. After installing the Solaris 2.6 patches mentioned yesterday that address poor NFS client performance with a NetApp filer, I changed NFS mount options to "vers=3,proto=tcp".
See the output of iostat -cxn 10|awk '$8 > 100.0 {print}':
# iostat -cxn 10|awk '$8 > 100.0 {print}' r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.1 3.9 0.8 57.3 0.1 0.9 26.8 213.7 11 49 md4 0.1 3.9 0.8 57.3 0.0 0.7 0.0 169.9 0 48 md6 r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 0.7 0.0 5.6 0.1 0.3 123.0 468.0 9 21 md4 0.0 0.7 0.0 5.6 0.0 0.3 0.0 468.0 0 21 md6 r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 5.6 0.0 84.8 0.1 0.7 16.3 131.4 9 24 md4 r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.1 0.6 0.8 4.5 0.0 0.1 48.5 154.3 3 6 md4 0.0 0.6 0.0 4.5 0.0 0.1 0.0 171.5 0 6 md6 0.0 0.4 0.0 6.4 0.0 0.1 0.7 165.0 0 7 10.16.119.10:/vol/vol0/logs r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 5.6 0.0 75.2 0.0 0.6 6.2 115.7 3 18 md4 r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device ^C#
Much better.
If I request an RMA on an older quad 10/100, will I receive a newer Intel-based board?