Re: [Condor-users] ordering jobs

[Nathan Panike <nwp@xxxxxxxxxxx>]

On Wed, May 30, 2012 at 08:19:34PM -0500, Dimitri Maziuk wrote:
> 
> I'm submitting a bunch of 2-node dags: node A is cpu-bound and runs for
> minutes, node B parses node A's output file and writes out the bits I
> want. Node B is short running and i/o bound.
> 
> What seems to happen is condor is scheduling all node As first, then all
> node Bs. I'm wondering if I can get it to run node Bs as soon as their
> parent node As are done and this way perhaps spread the i/o load a bit.
> 
> Setting rank to 1.0 and 2.0 for A and B resp doesn't seem to do
> anything. Do I need to submit them in smaller batches or something?
> 
> Thanks,
> -- 
> Dimitri Maziuk
> Programmer/sysadmin
> BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
> 

Hi Dimitri:

The 7.8.0 version of DAGman will set the job priority according to the
PRIORITY value given in the DAG file.  You can try that if you are using
7.8.0

More directly, setting "priority = 0" for the "A" jobs and "priority =
1" for the "B" jobs will get you what you want, I think. (See
http://research.cs.wisc.edu/condor/manual/v7.8/condor_submit.html)

Also, you could set "DAGMAN_SUBMIT_DEPTH_FIRST = True" in the DAG config
file, but from your description above, it seems like this shouldn't
matter.

Nathan Panike