[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] condor_history query to collect all the jobs executed the day before

Hi Carles,

Just a quick thought:

Maybe it would be easier and less error-prone to use the "-since <jobid>" flag to condor_history than messing around with date ranges? If you can easily record the jobid of the last job fetched from the previous poll (day), I think it may work better for you.


On 5/22/2018 1:15 PM, Carles Acosta wrote:
Dear all,

We create log files to fill our accounting through condor_history queries. Everyday we run a condor_history query to collect the jobs finished the day before in a log file. At the beginning, we were using CompletionDate as the endtime of the jobs to determine if the jobs finish the day before, but we have observed that the jobs killed remain with CompletionDate=0 and then, they were not considered. So, in the past, we run something like this:

/usr/bin/condor_history -const "CompletionDate >= $yesterday && CompletionDate < $today" [...]

where $yesterday is "date --date='00:00:00 yesterday' +%s" and today
"date --date='00:00:00 today' +%s".

However, we are interested to collect in our log files all the jobs executed, it does not matter if they finished correctly or were killed. Thus, we are now considering to use "JobStartDate+RemoteWallclockTime && RemoteWallclockTime !=0" as condition, taking into account that all the jobs with RemoteWallclockTime !=0 have to be accounted. What do you think? Or there is a ClassAd attribute similar to CompletionDate that we are missing to know the exact time a job ends (killed or not)?

We are running HTCondor 8.6.10.

Thank you in advance.

Best regards,


Carles Acosta i Silva
PIC (Port d'Informacià CientÃfica)
Campus UAB, Edifici D
E-08193 Bellaterra, Barcelona
Tel: +34 93 581 33 08
Fax: +34 93 581 41 10
AvÃs - Aviso - Legal Notice: http://www.ifae.es/legal.html

HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting

The archives can be found at:

Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685