[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] run a script when all jobs complete

One fairly straightforward way would be to use DAGMan:

Your jobs don't have any dependencies, but DAGMan allows you to specify a "FINAL" node that gets run after everything else.

There's some other advantages offered by dagman, such as retrying failed jobs, recovery of a partially-completed run, throttling job submission (if you need it), running scripts before and/or after each job, etc.


> -----Original Message-----
> From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf
> Of Justin Killebrew
> Sent: Wednesday, March 07, 2018 2:10 PM
> To: htcondor-users@xxxxxxxxxxx
> Subject: [HTCondor-users] run a script when all jobs complete
> Hello.  I need to run a python (or bash) script when all jobs of a
> particular submission are complete.  Should I use hooks and
> HOOK_JOB_CLEANUP?  If so, could someone point me to a simple example since
> I have not been able to configure it properly.  Is there
> another/better/easier way?
> Running HTCondor 8.6.8 on Rocks 7.0
> Thanks,
> JK
> _____________________________
> Justin Killebrew
> Senior Programmer/Analyst
> Zanvyl Krieger Mind/Brain Institute
> Johns Hopkins University
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/