[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] run a script when all jobs complete



Thanks Zach.  The DAGMan works well and I love single node DAGs.

JK


> On Mar 7, 2018, at 3:21 PM, Zach Miller <zmiller@xxxxxxxxxxx> wrote:
> 
> 
> One fairly straightforward way would be to use DAGMan:
> 	http://research.cs.wisc.edu/htcondor/manual/v8.7/2_10DAGMan_Applications.html
> 
> Your jobs don't have any dependencies, but DAGMan allows you to specify a "FINAL" node that gets run after everything else.
> 
> There's some other advantages offered by dagman, such as retrying failed jobs, recovery of a partially-completed run, throttling job submission (if you need it), running scripts before and/or after each job, etc.
> 
> 
> Cheers,
> -zach
> 
> 
>> -----Original Message-----
>> From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf
>> Of Justin Killebrew
>> Sent: Wednesday, March 07, 2018 2:10 PM
>> To: htcondor-users@xxxxxxxxxxx
>> Subject: [HTCondor-users] run a script when all jobs complete
>> 
>> Hello.  I need to run a python (or bash) script when all jobs of a
>> particular submission are complete.  Should I use hooks and
>> HOOK_JOB_CLEANUP?  If so, could someone point me to a simple example since
>> I have not been able to configure it properly.  Is there
>> another/better/easier way?
>> 
>> Running HTCondor 8.6.8 on Rocks 7.0
>> 
>> Thanks,
>> JK
>> 
>> _____________________________
>> Justin Killebrew
>> Senior Programmer/Analyst
>> Zanvyl Krieger Mind/Brain Institute
>> Johns Hopkins University
>> _______________________________________________
>> HTCondor-users mailing list
>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>> 
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/htcondor-users/
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
>