[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] breadth-first depth-first order control in dagman



On Fri, 17 Nov 2006, [ISO-8859-1] Horvátth Szabolcs wrote:

> Is it possible to control whether new DAG jobs are submitted in
> breadth-first or depth-first order?
> I limit the job submission rate using the maxidle switch and while it
> works nicely in
> limiting the number of idle jobs in the queue, it has the unlikely
> effect of always submitting
> the parent tasks first and only start submitting the child jobs after
> all "first level" parents are submitted.
> With bigger DAG structures this can delay the completion of the first
> "branch" a lot.

I've implemented an option to do this, which will be in 6.9.1.

If you have PRE scripts it's not 100% depth-first, but it's a big step
in that direction, anyhow.  (It was pretty easy to implement this way;
it would have been much more work to make it truly depth-first in all
cases.)

I figure people can try it out and see if 100% depth-first is really
necessary.

Kent Wenger
Condor Team