Mailing List Archives
Public Access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] slow scheduling of dagman jobs
- Date: Thu, 08 Sep 2011 15:23:25 -0400
- From: "David J. Herzfeld" <herzfeldd@xxxxxxxxx>
- Subject: Re: [Condor-users] slow scheduling of dagman jobs
Hi Patty:
On Thu, 2011-09-08 at 14:40 -0400, Patty Bragger wrote:
> So an average of about 9 jobs/sec, which is faster (but only a little) than
> submitting through dag. What kind of rates are you guys getting? Maybe
> this is this normal?
>
My guess is that the numbers you are seeing and probably pretty normal
(both for dagman and when calling directly from the command line).
We see faster times (real = 0m2.454s, user = 0m1.315s, ~40 jobs/s), but
have a pretty customized config. For instance, we set
SUBMIT_SKIP_FILECHECKS = False
SUBMIT_SEND_RESCHEDULE = False
I would assume that both of these knobs would reduce submit times
(although haven't tested them myself).
Also note that we are running on a 16 core Nehalem machine - so that may
influence comparative results as well.
Cheers,
DJH