[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] condor_history query to collect all the jobs executed the day before
- Date: Tue, 22 May 2018 13:40:40 -0500
- From: Todd Tannenbaum <tannenba@xxxxxxxxxxx>
- Subject: Re: [HTCondor-users] condor_history query to collect all the jobs executed the day before
Just a quick thought:
Maybe it would be easier and less error-prone to use the "-since
<jobid>" flag to condor_history than messing around with date ranges?
If you can easily record the jobid of the last job fetched from the
previous poll (day), I think it may work better for you.
On 5/22/2018 1:15 PM, Carles Acosta wrote:
We create log files to fill our accounting through condor_history
queries. Everyday we run a condor_history query to collect the jobs
finished the day before in a log file. At the beginning, we were using
CompletionDate as the endtime of the jobs to determine if the jobs
finish the day before, but we have observed that the jobs killed remain
with CompletionDate=0 and then, they were not considered. So, in the
past, we run something like this:
/usr/bin/condor_history -const "CompletionDate >= $yesterday &&
CompletionDate < $today" [...]
where $yesterday is "date --date='00:00:00 yesterday' +%s" and today
"date --date='00:00:00 today' +%s".
However, we are interested to collect in our log files all the jobs
executed, it does not matter if they finished correctly or were killed.
Thus, we are now considering to use "JobStartDate+RemoteWallclockTime &&
RemoteWallclockTime !=0" as condition, taking into account that all the
jobs with RemoteWallclockTime !=0 have to be accounted. What do you
think? Or there is a ClassAd attribute similar to CompletionDate that we
are missing to know the exact time a job ends (killed or not)?
We are running HTCondor 8.6.10.
Thank you in advance.
Carles Acosta i Silva
PIC (Port d'InformaciÃ CientÃfica)
Campus UAB, Edifici D
E-08193 Bellaterra, Barcelona
Tel: +34 93 581 33 08
Fax: +34 93 581 41 10
AvÃs - Aviso - Legal Notice: http://www.ifae.es/legal.html
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
You can also unsubscribe by visiting
The archives can be found at:
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing Department of Computer Sciences
HTCondor Technical Lead 1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132 Madison, WI 53706-1685