On 4/18/22 05:03, Stuart Walker wrote:
> I have a slight problem that I wondered if someone could help me with.
> My error, log and output files are set like this in my job submission script:
> outputÂ Â Â Â Â Â Â = /afs/desy.de/user/s/stwalker/luxe-bb-bdsim-model/bdsim-models/beam-halo-model-2022-04-12/t20-halo-from-distr-file/output/out/bdsim-$(Cluster)_$(Process).out
> errorÂ Â Â Â Â Â Â Â= /afs/desy.de/user/s/stwalker/luxe-bb-bdsim-model/bdsim-models/beam-halo-model-2022-04-12/t20-halo-from-distr-file/output/error/bdsim-$(Cluster)_$(Process).error
> logÂ Â Â Â Â Â Â Â Â= /afs/desy.de/user/s/stwalker/luxe-bb-bdsim-model/bdsim-models/beam-halo-model-2022-04-12/t20-halo-from-distr-file/output/log/bdsim-$(Cluster)_$(Process).log
Looking at the log file first, there shouldn't be too many bytes written
to it per job, so I hope that's not a problem for your quota.Â HTCondor
does support safely sharing one big log file for many jobs -- perhaps
that would help with minimizing the number of files or inodes.Â You
Then all the jobs in some workflow that share that log file will safely
append to it.
Now, for the output and error files, I don't think we have a good way in
HTCondor proper to compress them.Â If these jobs are part of a DAG, then
a DAG postscript (which runs on the submit machine) could compress the
files.Â However, I suspect it is better overall to explicitly compress
them as part of the job on the execute side.
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
You can also unsubscribe by visiting
The archives can be found at: