Greetings,
I have a 8.1.2 7-mode cluster and was asked to adjust a couple of quotas. The problem is there doesn't appear to be a quota set on the trees.
If I cd to the top of the volume and do a "df -h .", I get the volume totals. When I go into any of the sub-directories, it shows me different numbers for size allocated and used. The free is consistent at all levels but not the size and used. I've looked at the /etc/quotas, quota report, and viewed it through OnCommand. Nothing shows a quota limit. I've also run pwd-P and the df -h . both show I'm in the same file system and have not followed a symlink. The space reservation is volume and guaranteed, and snap reserve is at 0% utilized and has not grown beyond it's reserve. Below is the best I can give for details.
Thanks,
Jeff
[root@admin storage1]# df -h . ## top level volume
Filesystem Size Used Avail Use% Mounted on
filer2:/vol/storage1 2.4T 1.1T 1.3T 45% /net/filer2/vol/storage1
[root@admin storage1]# cd tools
[root@admin tools]# df -h .
Filesystem Size Used Avail Use% Mounted on
filer2:/vol/storage1 1.4T 71G 1.3T 6% /net/filer2/vol/storage1
[root@admin tools]# cd ../home
[root@admin home]# df -h .
Filesystem Size Used Avail Use% Mounted on
filer2:/vol/storage1/home 1.5T 118G 1.3T 9% /net/filer2/vol/storage1/home
[root@admin home]# cd ..
[root@admin storage1]# df -h win_shares
Filesystem Size Used Avail Use% Mounted on
filer2:/vol/storage1 2.2T 843G 1.3T 39% /net/filer2/vol/storage1
[root@admin etc]# cat quotas
#Auto-generated by setup Tue Jun 4 03:55:56 GMT 2013
/vol/aus_ntshares/ashares tree - - - - -
/vol/storage1/apps tree - - - - -
/vol/storage1/home tree - - - - -
/vol/storage1/tools tree - - - - -
/vol/storage1/win_shares tree - - - - -
[root@admin storage1]# ssh filer2 quota report
K-Bytes Files
Type ID Volume Tree Used Limit Used Limit Quota Specifier
----- -------- -------- -------- --------- --------- ------- ------- ---------------
tree 1 storage1 apps 10421344 - 46712 - /vol/storage1/apps
tree 2 storage1 home 123265872 - 796745 - /vol/storage1/home
tree 3 storage1 tools 73659616 - 773186 - /vol/storage1/tools
Shot in the dark, but - any chance you have “actual=…” option in /etc/exports (i.e. client actually mounts some different path)?
From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Jeff Cleverley Sent: Wednesday, June 10, 2015 11:59 PM To: Toasters@teaparty.net Subject: Mystery quota on qtree?
Greetings,
I have a 8.1.2 7-mode cluster and was asked to adjust a couple of quotas. The problem is there doesn't appear to be a quota set on the trees.
If I cd to the top of the volume and do a "df -h .", I get the volume totals. When I go into any of the sub-directories, it shows me different numbers for size allocated and used. The free is consistent at all levels but not the size and used. I've looked at the /etc/quotas, quota report, and viewed it through OnCommand. Nothing shows a quota limit. I've also run pwd-P and the df -h . both show I'm in the same file system and have not followed a symlink. The space reservation is volume and guaranteed, and snap reserve is at 0% utilized and has not grown beyond it's reserve. Below is the best I can give for details.
Thanks,
Jeff
[root@admin storage1]# df -h . ## top level volume Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 2.4T 1.1T 1.3T 45% /net/filer2/vol/storage1 [root@admin storage1]# cd tools [root@admin tools]# df -h . Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 1.4T 71G 1.3T 6% /net/filer2/vol/storage1 [root@admin tools]# cd ../home [root@admin home]# df -h . Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1/home 1.5T 118G 1.3T 9% /net/filer2/vol/storage1/home [root@admin home]# cd .. [root@admin storage1]# df -h win_shares Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 2.2T 843G 1.3T 39% /net/filer2/vol/storage1 [root@admin etc]# cat quotas #Auto-generated by setup Tue Jun 4 03:55:56 GMT 2013 /vol/aus_ntshares/ashares tree - - - - - /vol/storage1/apps tree - - - - - /vol/storage1/home tree - - - - - /vol/storage1/tools tree - - - - - /vol/storage1/win_shares tree - - - - - [root@admin storage1]# ssh filer2 quota report K-Bytes Files Type ID Volume Tree Used Limit Used Limit Quota Specifier ----- -------- -------- -------- --------- --------- ------- ------- --------------- tree 1 storage1 apps 10421344 - 46712 - /vol/storage1/apps tree 2 storage1 home 123265872 - 796745 - /vol/storage1/home tree 3 storage1 tools 73659616 - 773186 - /vol/storage1/tools
-- Jeff Cleverley IT Engineer 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611
What happens when you mount each of the qtrees directly on some alternate path, and not access it through /net ?
Since the filer has to represent some type of size/quota to your client, it’s just making the ‘Size’ the value of (Qtree Used) + (Volume Available). Over time as more data is written, I would expect that the Size represented in df would eventually show as 2.4T.
From: toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Borzenkov, Andrei Sent: Thursday, June 11, 2015 12:56 AM To: Jeff Cleverley; Toasters@teaparty.net Subject: RE: Mystery quota on qtree?
Shot in the dark, but - any chance you have “actual=…” option in /etc/exports (i.e. client actually mounts some different path)?
From: toasters-bounces@teaparty.netmailto:toasters-bounces@teaparty.net [mailto:toasters-bounces@teaparty.net] On Behalf Of Jeff Cleverley Sent: Wednesday, June 10, 2015 11:59 PM To: <Toasters@teaparty.netmailto:Toasters@teaparty.net> Subject: Mystery quota on qtree?
Greetings,
I have a 8.1.2 7-mode cluster and was asked to adjust a couple of quotas. The problem is there doesn't appear to be a quota set on the trees.
If I cd to the top of the volume and do a "df -h .", I get the volume totals. When I go into any of the sub-directories, it shows me different numbers for size allocated and used. The free is consistent at all levels but not the size and used. I've looked at the /etc/quotas, quota report, and viewed it through OnCommand. Nothing shows a quota limit. I've also run pwd-P and the df -h . both show I'm in the same file system and have not followed a symlink. The space reservation is volume and guaranteed, and snap reserve is at 0% utilized and has not grown beyond it's reserve. Below is the best I can give for details.
Thanks,
Jeff
[root@admin storage1]# df -h . ## top level volume Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 2.4T 1.1T 1.3T 45% /net/filer2/vol/storage1 [root@admin storage1]# cd tools [root@admin tools]# df -h . Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 1.4T 71G 1.3T 6% /net/filer2/vol/storage1 [root@admin tools]# cd ../home [root@admin home]# df -h . Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1/home 1.5T 118G 1.3T 9% /net/filer2/vol/storage1/home [root@admin home]# cd .. [root@admin storage1]# df -h win_shares Filesystem Size Used Avail Use% Mounted on filer2:/vol/storage1 2.2T 843G 1.3T 39% /net/filer2/vol/storage1 [root@admin etc]# cat quotas #Auto-generated by setup Tue Jun 4 03:55:56 GMT 2013 /vol/aus_ntshares/ashares tree - - - - - /vol/storage1/apps tree - - - - - /vol/storage1/home tree - - - - - /vol/storage1/tools tree - - - - - /vol/storage1/win_shares tree - - - - - [root@admin storage1]# ssh filer2 quota report K-Bytes Files Type ID Volume Tree Used Limit Used Limit Quota Specifier ----- -------- -------- -------- --------- --------- ------- ------- --------------- tree 1 storage1 apps 10421344 - 46712 - /vol/storage1/apps tree 2 storage1 home 123265872 - 796745 - /vol/storage1/home tree 3 storage1 tools 73659616 - 773186 - /vol/storage1/tools
-- Jeff Cleverley IT Engineer 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611
David,
It looks like you have the correct answer. I created a qtree and empty quota in a volume and the size was the amount of free space since there wasn't any used in the newly created qtree. I'm guessing they set up the empty quota for the accounting purposes.
Thanks,
Jeff
Since the filer has to represent some type of size/quota to your client, it’s just making the ‘Size’ the value of (Qtree Used) + (Volume Available). Over time as more data is written, I would expect that the Size represented in df would eventually show as 2.4T.
We use entries in the quotas file without limitations so that we can see the folder size without having to span the filesystem using something like treesize. In situations where you need to know this for some reason, turning quotas on but not using them to interrupt writes can be an option.
On Thu, Jun 11, 2015 at 10:06 PM, Jeff Cleverley < jeff.cleverley@avagotech.com> wrote:
David,
It looks like you have the correct answer. I created a qtree and empty quota in a volume and the size was the amount of free space since there wasn't any used in the newly created qtree. I'm guessing they set up the empty quota for the accounting purposes.
Thanks,
Jeff
Since the filer has to represent some type of size/quota to your client, it’s just making the ‘Size’ the value of (Qtree Used) + (Volume Available). Over time as more data is written, I would expect that the Size represented in df would eventually show as 2.4T.
-- Jeff Cleverley IT Engineer 4380 Ziegler Road Fort Collins, Colorado 80525 970-288-4611
Toasters mailing list Toasters@teaparty.net http://www.teaparty.net/mailman/listinfo/toasters
-
Basil -
Borzenkov, Andrei -
Jayanathan, David -
Jeff Cleverley