Re: [HTCondor-users] Measuring Queue Time and Execution Time Condor

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

On 9/24/2013 10:09 AM, Ben Cotton wrote:
> On Mon, Sep 23, 2013 at 7:29 PM, Vishal Shah <vishal.b.shah@xxxxxxxxxxx> wrote:
>
> > Is there a "simple" way to get the queue time and execution time for jobs
> > from condor or would the submission, execution, and termination times have
> > to be parsed from the condor log file?
> Assuming you're only checking completed jobs, you could use the
> following job ad expressions. (Note that there may be better ways to
> do this. If there are, someone will be sure to correct me.)

Putting the below wisdom into a command that spits out
   ClusterID ProcID Owner QueueTime ExecuteTime
(all times in seconds) for all completed jobs submitted from this 
machine, you could just enter (all on one line):

condor_history -constraint "CompletionDate > 0" -af ClusterId ProcId 
Owner "CompletionDate - QDate - CommittedTime" CommittedTime

The "-constraint" flag is used here to ignore jobs that never completed 
(e.g. they were removed).

regards,
Todd

> Queue time (where time spent on incomplete runs (due to eviction, &c)
> is considered time in queue):
>    (EnteredCurrentStatus - QDate) - CommittedTime
>
> Queue time (where time spent on incomplete runs (due to eviction, &c)
> is NOT considered time in queue):
>    (EnteredCurrentStatus - QDate) - RemoteWallClockTime
>
> Execution time (only for the final, presumably successful run):
>    CommittedTime
>
> Execution time (for all runs):
>    RemoteWallClockTime
>
> (Note that both CommittedTime and RemoteWallClockTime included time
> suspended on the host. If you want to remove that, you can use
> 'CommittedTime - CommittedSuspensionTime' and 'RemoteWallClockTime -
> CumulativeSuspensionTime' respectively).
>
> For more inspiration, see Appendix A of the HTCondor manual:
> http://research.cs.wisc.edu/htcondor/manual/latest/12_Appendix_A.html
>
>
> Thanks,
> BC


--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685