[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Condor-users] Job completion hooks



All,

Here's my issue: on my cluster, I'm handling user notification of job completion instead of letting condor send out those messages - I've automated the process of job submission and file retrieval via a Django website. This process tends to work well - the programs I run are actually scripts, where the first and last lines of the scripts interface with my software and let me know when the job has actually started and stopped. The problem comes in when the generated output files are large and take several minutes to transfer back to the submitting computer; technically the user could receive a completion email and visit the website to download their files before those files have finished transferring.

I've looked into hooks, but the one that seems to run at the latest point in the processing chain - HOOK_JOB_EXIT - runs prior to file transfer. I thought about HOOK_JOB_CLEANUP, but the part in the documentation about running the specified cleanup script instead of Condor's cleanup scripts causes a bit of trepidation regarding that route. Is there any way to run a program once _all_ the steps have completed processing without interfering with Condor's inner workings?

Thanks,
Tyler