[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] Put jobs on hold if output or error files grow large?
- Date: Wed, 23 Jul 2014 15:03:14 -0500
- From: Brian Bockelman <bbockelm@xxxxxxxxxxx>
- Subject: Re: [HTCondor-users] Put jobs on hold if output or error files grow large?
On Jul 23, 2014, at 2:24 PM, Carsten Aulbert <Carsten.Aulbert@xxxxxxxxxx> wrote:
> Hi Brian
> On 07/23/2014 09:21 PM, Brian Bockelman wrote:
>> Would MAX_TRANSFER_OUTPUT_MB be what you are looking for?
>> That places the job on hold if the final output files (all of them in aggregate) are above a certain size.
>> (See http://research.cs.wisc.edu/htcondor/manual/v8.1/3_3Configuration.html)
> I briefly looked at that, but I'm not sure if HTCondor counts this is
> one uses a shared file system or these files are placed on the execute
> nodes local storage. Or will these counted as well?
This only counts the files done through HTCondor file transfer. So, files on a shared file system likely won't be counted.