[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] dagman: Possible to run a "PRE" script on same node as the main program will run?



You may want to check out (concurrency limits):
http://www.cs.wisc.edu/condor/manual/v7.5/3_13Setting_Up.html#36823


On Thu, 2010-07-22 at 12:44 +0200, Carsten Aulbert wrote:
> I have 20k jobs each needing to read in say 5 GB of data from central
> file 
> servers, each job will run for a couple of hours on this data and to
> spare the 
> servers from too much load, I want to limit the number of nodes
> reading from 
> the data servers at any time.

Cheers,
Tim