[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] How to log Job file transfer time



On Fri, Jul 23, 2010 at 2:31 PM, <kschwarz@xxxxxxxxxxxxxx> wrote:
Is there any way to have the file transfer time logged into the job log file?
For each job I would like to know how much time is spent transfering the files before the program started executing and after program ended execution until the job is terminated.

Not that I know of, but you can look in the shadow log associated with the job and work out approximately how much time was spent transferring files. Condor adds a few lines of debug to the file when file transfers start, when each file is transferred, and when file transfer ends. You can use the time stamps on the lines to get a okay guess at the time spent.

The time will include time spent blocking or sleeping by the shadow since it's likely on a machine that had many more processes than processors, being a scheduler.

- Ian


Cycle Computing, LLC
The Leader in Open Compute Solutions for Clouds, Servers, and Desktops
Enterprise Condor Support and Management Tools

http://www.cyclecomputing.com
http://www.cyclecloud.com