[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] slow scheduling of dagman jobs



Hi Patty:

On Thu, 2011-09-08 at 14:40 -0400, Patty Bragger wrote:
> So an average of about 9 jobs/sec, which is faster (but only a little) than
> submitting through dag.  What kind of rates are you guys getting?  Maybe
> this is this normal?
> 

My guess is that the numbers you are seeing and probably pretty normal
(both for dagman and when calling directly from the command line).

We see faster times (real = 0m2.454s, user = 0m1.315s, ~40 jobs/s), but
have a pretty customized config. For instance, we set
SUBMIT_SKIP_FILECHECKS = False
SUBMIT_SEND_RESCHEDULE = False
I would assume that both of these knobs would reduce submit times
(although haven't tested them myself).

Also note that we are running on a 16 core Nehalem machine - so that may
influence comparative results as well.

Cheers,
DJH