[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] dagman: Possible to run a "PRE" script on same node as the main program will run?

You may want to check out (concurrency limits):

On Thu, 2010-07-22 at 12:44 +0200, Carsten Aulbert wrote:
> I have 20k jobs each needing to read in say 5 GB of data from central
> file 
> servers, each job will run for a couple of hours on this data and to
> spare the 
> servers from too much load, I want to limit the number of nodes
> reading from 
> the data servers at any time.