[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Retry failed nodes in a running DAG


I think as long as the jobs are still queued you can put them back in idle mode thorugh condor_qedit ?


Christoph Beyer
DESY Hamburg

Notkestr. 85
Building 02b, Room 009
22607 Hamburg

mail: christoph.beyer@xxxxxxx

Von: "Vaurynovich, Siarhei" <siarhei.vaurynovich@xxxxxxxxxxxxx>
An: "htcondor-users" <htcondor-users@xxxxxxxxxxx>
Gesendet: Donnerstag, 6. Mai 2021 06:06:43
Betreff: [HTCondor-users] Retry failed nodes in a running DAG




Situation: I have a large DAG of jobs which is in the process of running. A few jobs failed but most of the jobs in the DAG keep running. From the log files, I have figured out the problem and fixed it. Please, let me know if there is a way to tell HTCondor to try again the failed nodes (and all of their CHILD nodes, of course) without killing any of the currently running jobs in the same DAG and without waiting for the whole DAG to fail (and generate a rescue file)?


From the documentation on condor_submit_dag, I can see that the following command might be a good candidate (I have sub-DAGs):


condor_submit_dag -DoRecovery -do_recurse submit_file.dag


Please, let me know if that is what I should do.


Thank you very much for your help,




Trading instructions sent electronically to Bernstein shall not be deemed
accepted until a representative of Bernstein acknowledges receipt
electronically or by telephone.  Comments in this e-mail transmission and
any attachments are part of a larger body of investment analysis. For our
research reports, which contain information that may be used to support
investment decisions, and disclosures see our website at

For further important information about AllianceBernstein please click here

HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting

The archives can be found at: