Re: [HTCondor-users] Job standard output gets overwritten after preemption

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

On 3/27/2019 12:21 PM, David Rebatto wrote:
> Hi,
> 
> I noticed that vanilla jobs restarting after preemption overwrite the 
> output of previous execution.
> Is there a way to instruct them to *append* to output file instead?
> 
> Thanks,
> David
> 

By "output file" above, I assume you mean the job's stdout as defined by 
the "output=filename" line in your submit file?

Are you using HTCondor's file transfer or a shared file system?

If you are using HTCondor's file transfer, the issue is likely the 
output from previous executions is not being transferred back upon 
preemption to the submit machine from the execute machine. I think you 
can achieve what you want by adding the following line to your submit file:
    when_to_transfer_output = ON_EXIT_OR_EVICT

regards
Todd