[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] condor_history query to collect all the jobs executed the day before



Hi Todd,

Thank you very much! We will also check "-since" option, although I'm not sure if this option suits our needs.

Cheers,

Carles

On 22 May 2018 at 20:40, Todd Tannenbaum <tannenba@xxxxxxxxxxx> wrote:
Hi Carles,

Just a quick thought:

Maybe it would be easier and less error-prone to use the "-since <jobid>" flag to condor_history than messing around with date ranges? If you can easily record the jobid of the last job fetched from the previous poll (day), I think it may work better for you.

regards,
Todd



On 5/22/2018 1:15 PM, Carles Acosta wrote:
Dear all,

We create log files to fill our accounting through condor_history queries. Everyday we run a condor_history query to collect the jobs finished the day before in a log file. At the beginning, we were using CompletionDate as the endtime of the jobs to determine if the jobs finish the day before, but we have observed that the jobs killed remain with CompletionDate=0 and then, they were not considered. So, in the past, we run something like this:

/usr/bin/condor_history -const "CompletionDate >= $yesterday && CompletionDate < $today" [...]

where $yesterday is "date --date='00:00:00 yesterday' +%s" and today
"date --date='00:00:00 today' +%s".

However, we are interested to collect in our log files all the jobs executed, it does not matter if they finished correctly or were killed. Thus, we are now considering to use "JobStartDate+RemoteWallclockTime && RemoteWallclockTime !=0" as condition, taking into account that all the jobs with RemoteWallclockTime !=0 have to be accounted. What do you think? Or there is a ClassAd attribute similar to CompletionDate that we are missing to know the exact time a job ends (killed or not)?

We are running HTCondor 8.6.10.

Thank you in advance.

Best regards,

Carles

--
Carles Acosta i Silva
PIC (Port d'Informacià CientÃfica)
Campus UAB, Edifici D
E-08193 Bellaterra, Barcelona
Tel: +34 93 581 33 08
Fax: +34 93 581 41 10
http://www.pic.es
AvÃs - Aviso - Legal Notice: http://www.ifae.es/legal.html


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxx.edu with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/



--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing ÂDepartment of Computer Sciences
HTCondor Technical Lead        1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132Â Â Â Â Â Â Â Â Â Madison, WI 53706-1685



--
Carles Acosta i Silva
PIC (Port d'Informacià CientÃfica)
Campus UAB, Edifici D
E-08193 Bellaterra, Barcelona
Tel: +34 93 581 33 08
Fax: +34 93 581 41 10
http://www.pic.esÂ
AvÃs - Aviso - Legal Notice: http://www.ifae.es/legal.html