Re: [Condor-users] slow scheduling of dagman jobs

["David J. Herzfeld" <herzfeldd@xxxxxxxxx>]

On Thu, 2011-09-08 at 15:23 -0400, David J. Herzfeld wrote:
> Hi Patty:
> 
> On Thu, 2011-09-08 at 14:40 -0400, Patty Bragger wrote:
> > So an average of about 9 jobs/sec, which is faster (but only a little) than
> > submitting through dag.  What kind of rates are you guys getting?  Maybe
> > this is this normal?
> > 
> 
> My guess is that the numbers you are seeing and probably pretty normal
> (both for dagman and when calling directly from the command line).
> 
> We see faster times (real = 0m2.454s, user = 0m1.315s, ~40 jobs/s), but
> have a pretty customized config. For instance, we set
> SUBMIT_SKIP_FILECHECKS = False
> SUBMIT_SEND_RESCHEDULE = False
> I would assume that both of these knobs would reduce submit times
> (although haven't tested them myself).

Sorry, that should be:
SUBMIT_SKIP_FILECHECKS = True
(see 
> http://www.cs.wisc.edu/condor/manual/v7.6/3_3Configuration.html#SECTION004314000000000000000).
Sorry about that.

You should be able to emulate this behavior with the -disable flag to
condor_submit (if you want to try to see if that increases your speed).

Best of luck,
DJH