[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Append to Outfile, not overwrite

Joseph Turian wrote:
If a job stops and starts, the Outfile is truncated and restarted.
Instead, can I instruct condor to always APPEND to the file if it exists?


You could maybe try being fancy and using $$([]) notation with something like NumJobStarts (or some other attribute on the job that increments). You wouldn't get a single output file but a numbered set of them that you could concatenate together.

Something along the lines of...

universe = vanilla
executable = /bin/date
output = out.$$([NumJobStarts])
on_exit_remove = false
should_transfer_files = always
when_to_transfer_output = on_exit_or_evict
log = append.log
queue 1

You could also try using stream_output[1].



[1] http://www.cs.wisc.edu/condor/manual/v7.1/condor_submit.html#64952