[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] Condor feature suggestion: automatically compressed output files
- Date: Thu, 27 Jul 2006 17:39:49 +0300
- From: Alex Gontmakher <gsasha@xxxxxxxxxxxxxxxxx>
- Subject: Re: [Condor-users] Condor feature suggestion: automatically compressed output files
On Thursday 27 July 2006 17:30, uni-ulm.m.roehm@xxxxxxxxxxxxxxxxxxx wrote:
> I recently asked for a similar feature. For now I just wrote a wrapper
> script which compresses the output before it is returned to the submitting
Well, script has several problems (in addition to the hassle of having an
additional level of scripting in the jobs). If the files generated are very
large and highly redundant, it is possible for the uncompressed version to be
prohibitively large, while the compressed file size would be reasonable.
In addition, our installation stores all the files over NFS - you can see that
compressing them after the fact adds significant overhead which would be
eliminated by compressing on the fly.
BTW., is there some system of bug/feature tracking in place?