IBM N3220 - 2857-A22 (NetApp FAS2240-2) Data ONTAP Release 8.1.2P1 7-Mode
We are trying to move a share from a EMC CX4 to a nSeries system. The method for moving is to mount both shares to a Win server and robocopy.
The application using this share has a BUG - it creates little files and NEVER deletes them. There is now almost 10m files in the share, almost all of them in one directory. This bug won't be resolved anytime soon.
==> PROBLEM
The robocopy runs, then fails with out of space condition. The filer gets the following these messages - all the same - all for the same directory "Resubmitted".
___ Thu 06 11 17:28:28 EDT [isnapr0664a:wafl.dir.size.max:warning]: Directory /vol/v_prdieeapp_cifs/q_prdieeapp_cifs/XXXXData/Data/HVRI/Resubmitted/ reached the maxdirsize limit. Reduce the number of files or use the vol options command to increase this limit.
==> Comments/Questions
So we've hit the maxdirsize on something, but on what?
The Win admin doing the robocopy ran TreeSize Professional on both shares, and it looks like the copy is almost complete. The REALLY WEIRD THING is that the dir "WorkBIn" with +8m files did NOT get any errors. But the dir "Resubmitted" with +470k files DOES get the errors.
Q) Why would we hit maxdirsize on a dir with +460k files, but not hit maxdirsize on a dir with +8m files?
Q) Is maxdirsize for an entire dir structure, or, for an individual dir?
I have a case open with IBM support, but not getting very far.
==> maxdirsize
ssh -q xxxxxxxx options wafl.maxdirsize wafl.maxdirsize 45875
==> vol size
Size = 1tb, used = 564gb, avail = 484gb Thin, autogrow = 5g
ssh -q xxxxxxxx df /vol/v_prdieeapp_cifs/ Filesystem kbytes used avail capacity Mounted on /vol/v_prdieeapp_cifs/ 1048576000 564393044 484182956 54% /vol/v_prdieeapp_cifs/ /vol/v_prdieeapp_cifs/.snapshot 0 0 0 ---% /vol/v_prdieeapp_cifs/.snapshot
=> inodes
Used = +10m, Free = +21m
ssh -q xxxxxxxx df -i /vol/v_prdieeapp_cifs/ Filesystem iused ifree %iused Mounted on /vol/v_prdieeapp_cifs/ 10056313 21073268 32% /vol/v_prdieeapp_cifs/
=> vol options
ssh -q xxxxxxxx vol options /vol/v_prdieeapp_cifs nosnap=on, nosnapdir=off, minra=off, no_atime_update=off, nvfail=off, ignore_inconsistent=off, snapmirrored=off, create_ucode=on, convert_ucode=on, maxdirsize=45875, schedsnapname=ordinal, fs_size_fixed=off, guarantee=none, svo_enable=off, svo_checksum=off, svo_allow_rman=off, svo_reject_errors=off, no_i2p=off, fractional_reserve=0, extent=off, try_first=volume_grow, read_realloc=off, snapshot_clone_dependency=off, dlog_hole_reserve=off, nbu_archival_snap=off
==> TreeSize info of SOURCE and TARGET shares
SOURCE share ------------ Full Path Size Allocated Files Folders Y:\ 513,366.5 MB 564,771.9 MB 10,077,444.00 713 Y:\XXXXData 513,366.2 MB 564,771.7 MB 10,077,437.00 710 Y:\XXXXData\Data 513,181.4 MB 564,585.9 MB 10,077,161.00 609 Y:\XXXXData\Data\HVRI 345,036.1 MB 394,556.1 MB 9,597,937.00 476 Y:\XXXXData\Data\HVRI\Readings 312,822.8 MB 312,898.3 MB 18,255.00 0 Y:\XXXXData\Data\HVRI\WorkBin 22,386.3 MB 68,378.2 MB 8,768,414.00 473 Y:\XXXXData\Data\HVRI\Resubmitted 9,827.0 MB 13,279.6 MB 811,268.00 0 Y:\XXXXData\Data\Import 167,672.7 MB 169,541.3 MB 475,794.00 102 Y:\XXXXData\Data\Export 470.3 MB 486.1 MB 3,420.00 27 Y:\XXXXData\Data\XMLExamples 2.3 MB 2.4 MB 10.00 0 Y:\XXXXData\CRFFiles 144.0 MB 144.9 MB 255.00 83 Y:\XXXXData\IEE Installs 29.4 MB 29.5 MB 20.00 12 Y:\XXXXData\RODSData 11.4 MB 11.4 MB 1.00 2 Y:.etc 0.3 MB .3 MB 7.00 0 Y:\lost+found 0.0 MB .0 MB 0.00 0
TARGET share ------------ Full Path Size Allocated Files Folders Z:\ 490,573.6 MB 518,678.1 MB 9,776,433.00 714 Z:\XXXXData 490,573.3 MB 518,677.8 MB 9,776,426.00 710 Z:\XXXXData\Data 490,388.6 MB 518,492.5 MB 9,776,150.00 609 Z:\XXXXData\Data\HVRI 322,961.8 MB 350,056.7 MB 9,299,556.00 476 Z:\XXXXData\Data\HVRI\Readings 294,757.3 MB 294,792.3 MB 17,375.00 0 Z:\XXXXData\Data\HVRI\WorkBin 22,621.6 MB 48,775.0 MB 8,823,422.00 473 Z:\XXXXData\Data\HVRI\Resubmitted 5,582.8 MB 6,489.4 MB 458,759.00 0 Z:\XXXXData\Data\Import 166,956.4 MB 167,957.6 MB 473,182.00 102 Z:\XXXXData\Data\Export 468.0 MB 475.8 MB 3,402.00 27 Z:\XXXXData\Data\XMLExamples 2.3 MB 2.4 MB 10.00 0 Z:\XXXXData\CRFFiles 144.0 MB 144.5 MB 255.00 83 Z:\XXXXData\IEE Installs 29.4 MB 29.4 MB 20.00 12 Z:\XXXXData\RODSData 11.4 MB 11.4 MB 1.00 2 Z:.etc 0.3 MB 0.3 MB 7.00 0 Z:~snapshot 0.0 MB 0.0 MB 0.00 0 Z:\lost+found 0.0 MB 0.0 MB 0.00 0
----------------------------------------- The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
There are a couple good KB articles that cover mazdirsize. Have you had a chance to read through them?
https://kb.netapp.com/index?page=content&id=3011562&actp=LIST_POPULA... https://kb.netapp.com/support/index?page=content&id=3012261
The above articles can be seen using a guest level access account on the support site.
On Thu, Jul 2, 2015 at 9:12 AM, Rhodes, Richard L. < rrhodes@firstenergycorp.com> wrote:
IBM N3220 - 2857-A22 (NetApp FAS2240-2) Data ONTAP Release 8.1.2P1 7-Mode
We are trying to move a share from a EMC CX4 to a nSeries system. The method for moving is to mount both shares to a Win server and robocopy.
The application using this share has a BUG - it creates little files and NEVER deletes them. There is now almost 10m files in the share, almost all of them in one directory. This bug won't be resolved anytime soon.
==> PROBLEM
The robocopy runs, then fails with out of space condition. The filer gets the following these messages - all the same - all for the same directory "Resubmitted".
___ Thu 06 11 17:28:28 EDT [isnapr0664a:wafl.dir.size.max:warning]: Directory /vol/v_prdieeapp_cifs/q_prdieeapp_cifs/XXXXData/Data/HVRI/Resubmitted/ reached the maxdirsize limit. Reduce the number of files or use the vol options command to increase this limit.
==> Comments/Questions
So we've hit the maxdirsize on something, but on what?
The Win admin doing the robocopy ran TreeSize Professional on both shares, and it looks like the copy is almost complete. The REALLY WEIRD THING is that the dir "WorkBIn" with +8m files did NOT get any errors. But the dir "Resubmitted" with +470k files DOES get the errors.
Q) Why would we hit maxdirsize on a dir with +460k files, but not hit maxdirsize on a dir with +8m files?
Q) Is maxdirsize for an entire dir structure, or, for an individual dir?
I have a case open with IBM support, but not getting very far.
==> maxdirsize
ssh -q xxxxxxxx options wafl.maxdirsize wafl.maxdirsize 45875
==> vol size
Size = 1tb, used = 564gb, avail = 484gb Thin, autogrow = 5g
ssh -q xxxxxxxx df /vol/v_prdieeapp_cifs/ Filesystem kbytes used avail capacity Mounted on /vol/v_prdieeapp_cifs/ 1048576000 564393044 484182956 54% /vol/v_prdieeapp_cifs/ /vol/v_prdieeapp_cifs/.snapshot 0 0 0 ---% /vol/v_prdieeapp_cifs/.snapshot
=> inodes
Used = +10m, Free = +21m
ssh -q xxxxxxxx df -i /vol/v_prdieeapp_cifs/ Filesystem iused ifree %iused Mounted on /vol/v_prdieeapp_cifs/ 10056313 21073268 32% /vol/v_prdieeapp_cifs/
=> vol options
ssh -q xxxxxxxx vol options /vol/v_prdieeapp_cifs nosnap=on, nosnapdir=off, minra=off, no_atime_update=off, nvfail=off, ignore_inconsistent=off, snapmirrored=off, create_ucode=on, convert_ucode=on, maxdirsize=45875, schedsnapname=ordinal, fs_size_fixed=off, guarantee=none, svo_enable=off, svo_checksum=off, svo_allow_rman=off, svo_reject_errors=off, no_i2p=off, fractional_reserve=0, extent=off, try_first=volume_grow, read_realloc=off, snapshot_clone_dependency=off, dlog_hole_reserve=off, nbu_archival_snap=off
==> TreeSize info of SOURCE and TARGET shares
SOURCE share
Full Path Size Allocated Files Folders Y:\ 513,366.5 MB 564,771.9 MB 10,077,444.00 713 Y:\XXXXData 513,366.2 MB 564,771.7 MB 10,077,437.00 710 Y:\XXXXData\Data 513,181.4 MB 564,585.9 MB 10,077,161.00 609 Y:\XXXXData\Data\HVRI 345,036.1 MB 394,556.1 MB 9,597,937.00 476 Y:\XXXXData\Data\HVRI\Readings 312,822.8 MB 312,898.3 MB 18,255.00 0 Y:\XXXXData\Data\HVRI\WorkBin 22,386.3 MB 68,378.2 MB 8,768,414.00 473 Y:\XXXXData\Data\HVRI\Resubmitted 9,827.0 MB 13,279.6 MB 811,268.00 0 Y:\XXXXData\Data\Import 167,672.7 MB 169,541.3 MB 475,794.00 102 Y:\XXXXData\Data\Export 470.3 MB 486.1 MB 3,420.00 27 Y:\XXXXData\Data\XMLExamples 2.3 MB 2.4 MB 10.00 0 Y:\XXXXData\CRFFiles 144.0 MB 144.9 MB 255.00 83 Y:\XXXXData\IEE Installs 29.4 MB 29.5 MB 20.00 12 Y:\XXXXData\RODSData 11.4 MB 11.4 MB 1.00 2 Y:.etc 0.3 MB .3 MB 7.00 0 Y:\lost+found 0.0 MB .0 MB 0.00 0
TARGET share
Full Path Size Allocated Files Folders Z:\ 490,573.6 MB 518,678.1 MB 9,776,433.00 714 Z:\XXXXData 490,573.3 MB 518,677.8 MB 9,776,426.00 710 Z:\XXXXData\Data 490,388.6 MB 518,492.5 MB 9,776,150.00 609 Z:\XXXXData\Data\HVRI 322,961.8 MB 350,056.7 MB 9,299,556.00 476 Z:\XXXXData\Data\HVRI\Readings 294,757.3 MB 294,792.3 MB 17,375.00 0 Z:\XXXXData\Data\HVRI\WorkBin 22,621.6 MB 48,775.0 MB 8,823,422.00 473 Z:\XXXXData\Data\HVRI\Resubmitted 5,582.8 MB 6,489.4 MB 458,759.00 0 Z:\XXXXData\Data\Import 166,956.4 MB 167,957.6 MB 473,182.00 102 Z:\XXXXData\Data\Export 468.0 MB 475.8 MB 3,402.00 27 Z:\XXXXData\Data\XMLExamples 2.3 MB 2.4 MB 10.00 0 Z:\XXXXData\CRFFiles 144.0 MB 144.5 MB 255.00 83 Z:\XXXXData\IEE Installs 29.4 MB 29.4 MB 20.00 12 Z:\XXXXData\RODSData 11.4 MB 11.4 MB 1.00 2 Z:.etc 0.3 MB 0.3 MB 7.00 0 Z:~snapshot 0.0 MB 0.0 MB 0.00 0 Z:\lost+found 0.0 MB 0.0 MB 0.00 0
The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
1. Directories never shrink so it is possible that it had many entries which are now deleted. Also it is the size of directory file, not number of entries, which counts. I.e. long names would consume more space (although this is less likely with such difference).
2. maxdirsize is global per volume.
-----Original Message----- From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Rhodes, Richard L. Sent: Thursday, July 02, 2015 4:12 PM To: toasters@teaparty.net Subject: maxdirsize
IBM N3220 - 2857-A22 (NetApp FAS2240-2) Data ONTAP Release 8.1.2P1 7-Mode
We are trying to move a share from a EMC CX4 to a nSeries system. The method for moving is to mount both shares to a Win server and robocopy.
The application using this share has a BUG - it creates little files and NEVER deletes them. There is now almost 10m files in the share, almost all of them in one directory. This bug won't be resolved anytime soon.
==> PROBLEM
The robocopy runs, then fails with out of space condition. The filer gets the following these messages - all the same - all for the same directory "Resubmitted".
___ Thu 06 11 17:28:28 EDT [isnapr0664a:wafl.dir.size.max:warning]: Directory /vol/v_prdieeapp_cifs/q_prdieeapp_cifs/XXXXData/Data/HVRI/Resubmitted/ reached the maxdirsize limit. Reduce the number of files or use the vol options command to increase this limit.
==> Comments/Questions
So we've hit the maxdirsize on something, but on what?
The Win admin doing the robocopy ran TreeSize Professional on both shares, and it looks like the copy is almost complete. The REALLY WEIRD THING is that the dir "WorkBIn" with +8m files did NOT get any errors. But the dir "Resubmitted" with +470k files DOES get the errors.
Q) Why would we hit maxdirsize on a dir with +460k files, but not hit maxdirsize on a dir with +8m files?
Q) Is maxdirsize for an entire dir structure, or, for an individual dir?
I have a case open with IBM support, but not getting very far.
==> maxdirsize
ssh -q xxxxxxxx options wafl.maxdirsize wafl.maxdirsize 45875
==> vol size
Size = 1tb, used = 564gb, avail = 484gb Thin, autogrow = 5g
ssh -q xxxxxxxx df /vol/v_prdieeapp_cifs/ Filesystem kbytes used avail capacity Mounted on /vol/v_prdieeapp_cifs/ 1048576000 564393044 484182956 54% /vol/v_prdieeapp_cifs/ /vol/v_prdieeapp_cifs/.snapshot 0 0 0 ---% /vol/v_prdieeapp_cifs/.snapshot
=> inodes
Used = +10m, Free = +21m
ssh -q xxxxxxxx df -i /vol/v_prdieeapp_cifs/ Filesystem iused ifree %iused Mounted on /vol/v_prdieeapp_cifs/ 10056313 21073268 32% /vol/v_prdieeapp_cifs/
=> vol options
ssh -q xxxxxxxx vol options /vol/v_prdieeapp_cifs nosnap=on, nosnapdir=off, minra=off, no_atime_update=off, nvfail=off, ignore_inconsistent=off, snapmirrored=off, create_ucode=on, convert_ucode=on, maxdirsize=45875, schedsnapname=ordinal, fs_size_fixed=off, guarantee=none, svo_enable=off, svo_checksum=off, svo_allow_rman=off, svo_reject_errors=off, no_i2p=off, fractional_reserve=0, extent=off, try_first=volume_grow, read_realloc=off, snapshot_clone_dependency=off, dlog_hole_reserve=off, nbu_archival_snap=off
==> TreeSize info of SOURCE and TARGET shares
SOURCE share ------------ Full Path Size Allocated Files Folders Y:\ 513,366.5 MB 564,771.9 MB 10,077,444.00 713 Y:\XXXXData 513,366.2 MB 564,771.7 MB 10,077,437.00 710 Y:\XXXXData\Data 513,181.4 MB 564,585.9 MB 10,077,161.00 609 Y:\XXXXData\Data\HVRI 345,036.1 MB 394,556.1 MB 9,597,937.00 476 Y:\XXXXData\Data\HVRI\Readings 312,822.8 MB 312,898.3 MB 18,255.00 0 Y:\XXXXData\Data\HVRI\WorkBin 22,386.3 MB 68,378.2 MB 8,768,414.00 473 Y:\XXXXData\Data\HVRI\Resubmitted 9,827.0 MB 13,279.6 MB 811,268.00 0 Y:\XXXXData\Data\Import 167,672.7 MB 169,541.3 MB 475,794.00 102 Y:\XXXXData\Data\Export 470.3 MB 486.1 MB 3,420.00 27 Y:\XXXXData\Data\XMLExamples 2.3 MB 2.4 MB 10.00 0 Y:\XXXXData\CRFFiles 144.0 MB 144.9 MB 255.00 83 Y:\XXXXData\IEE Installs 29.4 MB 29.5 MB 20.00 12 Y:\XXXXData\RODSData 11.4 MB 11.4 MB 1.00 2 Y:.etc 0.3 MB .3 MB 7.00 0 Y:\lost+found 0.0 MB .0 MB 0.00 0
TARGET share ------------ Full Path Size Allocated Files Folders Z:\ 490,573.6 MB 518,678.1 MB 9,776,433.00 714 Z:\XXXXData 490,573.3 MB 518,677.8 MB 9,776,426.00 710 Z:\XXXXData\Data 490,388.6 MB 518,492.5 MB 9,776,150.00 609 Z:\XXXXData\Data\HVRI 322,961.8 MB 350,056.7 MB 9,299,556.00 476 Z:\XXXXData\Data\HVRI\Readings 294,757.3 MB 294,792.3 MB 17,375.00 0 Z:\XXXXData\Data\HVRI\WorkBin 22,621.6 MB 48,775.0 MB 8,823,422.00 473 Z:\XXXXData\Data\HVRI\Resubmitted 5,582.8 MB 6,489.4 MB 458,759.00 0 Z:\XXXXData\Data\Import 166,956.4 MB 167,957.6 MB 473,182.00 102 Z:\XXXXData\Data\Export 468.0 MB 475.8 MB 3,402.00 27 Z:\XXXXData\Data\XMLExamples 2.3 MB 2.4 MB 10.00 0 Z:\XXXXData\CRFFiles 144.0 MB 144.5 MB 255.00 83 Z:\XXXXData\IEE Installs 29.4 MB 29.4 MB 20.00 12 Z:\XXXXData\RODSData 11.4 MB 11.4 MB 1.00 2 Z:.etc 0.3 MB 0.3 MB 7.00 0 Z:~snapshot 0.0 MB 0.0 MB 0.00 0 Z:\lost+found 0.0 MB 0.0 MB 0.00 0
----------------------------------------- The information contained in this message is intended only for the personal and confidential use of the recipient(s) named above. If the reader of this message is not the intended recipient or an agent responsible for delivering it to the intended recipient, you are hereby notified that you have received this document in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately, and delete the original message.
_______________________________________________ Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
-
Borzenkov, Andrei -
Brad Thompson -
Rhodes, Richard L.