[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] POOL_HISTORY_MAX_STORAGE seems to be ignored on Windows



Hi!

We are running condor 8.8.0 on Windows cluster and noticed that the history files directory grows indefinitely regardless the settings "POOL_HISTORY_MAX_STORAGE = 50000000":

ÂDirectory of C:\condor\history

03/07/2019Â 07:08 AMÂÂÂ <DIR>ÂÂÂÂÂÂÂÂÂ .
03/07/2019Â 07:08 AMÂÂÂ <DIR>ÂÂÂÂÂÂÂÂÂ ..
12/18/2019Â 05:35 PMÂÂÂÂÂÂÂ 18,616,459 viewhist0.0.new
11/01/2018Â 12:21 AMÂÂÂÂÂÂÂÂ 1,666,782 viewhist0.0.old
12/18/2019Â 05:35 PMÂÂÂÂÂÂÂÂ 3,405,423 viewhist0.1.new
01/08/2019Â 09:29 PMÂÂÂÂÂÂÂÂ 1,666,711 viewhist0.1.old
12/18/2019Â 05:03 PMÂÂÂÂÂÂÂÂ 1,269,576 viewhist0.2.new
12/18/2019Â 05:35 PMÂÂÂÂÂÂ 898,349,280 viewhist1.0.new
10/10/2018Â 10:41 PMÂÂÂÂÂÂÂÂ 1,667,005 viewhist1.0.old
12/18/2019Â 05:35 PMÂÂÂÂÂÂ 225,003,773 viewhist1.1.new
10/12/2018Â 10:17 AMÂÂÂÂÂÂÂÂ 1,668,903 viewhist1.1.old
12/18/2019Â 05:03 PMÂÂÂÂÂÂÂ 56,321,841 viewhist1.2.new
10/18/2018Â 07:37 AMÂÂÂÂÂÂÂÂ 1,676,836 viewhist1.2.old
[...]
ÂÂÂÂÂÂÂÂÂÂÂÂÂ 24 File(s)Â 1,260,128,938 bytesÂ

CollectorLog confirms that all settings are correct:
12/18/19 11:44:17 Configuration: SAMPLING_INTERVAL=60, MAX_STORAGE=50000000, MaxFileSize=1666666, POOL_HISTORY_DIR=C:\condor\history

If I manually delete ".old" files then almost immediately those big files are renamed into ".old". Therefore my guess is that the problem is related to some bug in condor when it rotates history files reached the size limit. Most probably "rename" function is used without prior deleting of old file. This is crucial in Windows compare to Linux since rename simply fails if destination file already exists.

Any ideas if anything else could be a reason?

Thank you!

Alexey