[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Job standard output gets overwritten after preemption

On 3/27/2019 12:21 PM, David Rebatto wrote:
> Hi,
> I noticed that vanilla jobs restarting after preemption overwrite the 
> output of previous execution.
> Is there a way to instruct them to *append* to output file instead?
> Thanks,
> David

By "output file" above, I assume you mean the job's stdout as defined by 
the "output=filename" line in your submit file?

Are you using HTCondor's file transfer or a shared file system?

If you are using HTCondor's file transfer, the issue is likely the 
output from previous executions is not being transferred back upon 
preemption to the submit machine from the execute machine. I think you 
can achieve what you want by adding the following line to your submit file:
    when_to_transfer_output = ON_EXIT_OR_EVICT