[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] How to prefer certain nodes for jobs


Two issues. One, it sounds like you're setting
NEGOTIATOR_POST_JOB_RANK on the execute nodes themselves. That's a
negotiator setting, so it won't have any effect if it's set on an
execute node. Secondly, NEGOTIATOR_POST_JOB_RANK is essentially "use
this as a tiebreaker after you've evaluated everything else." If you
want to have a stronger preference, I'd use NEGOTIATOR_PRE_JOB_RANK.

Doing it on the negotiator can make it a little ugly. If you set an
attribute on the execute node (e.g. NodeGroup) that exactly matches
the accounting group name and include that in your STARTD_ATTRS, you
can do something like this on your negotiator:


(note that you don't need to throw a large number multiplier in here
since the magnitude of the rank difference doesn't matter. Also, I
prefer to use =?= over == in these kinds of situations so you don't
end up with an UNDEFINED in your expression. This will make your
comparison case-sensitive, though, so be careful

On Mon, Jul 31, 2017 at 1:26 AM, Sean Crosby <scrosby@xxxxxxxxxxxxxx> wrote:
> We are looking at making certain jobs prefer certain worker nodes based on
> attributes in the job - specifically who submitted the job
> All nodes can run the jobs, but we'd like it if AcctGroup 'A' goes to node
> group 'A' first, and AcctGroup 'B' goes to node group 'B'
> We have tried setting both the RANK and NEGOTIATOR_POST_JOB_RANK to
> something like this
> Worker node group A:
> NEGOTIATOR_POST_JOB_RANK = 1000000 * (TARGET.AcctGroup == 'group_atlas')
> Worker node group B:
> NEGOTIATOR_POST_JOB_RANK = 1000000 * (TARGET.AcctGroup == 'tier3')
> Job classads:
> $ condor_q -long 1090
> AcctGroup = "tier3"
> $ condor_q -long 32
> AcctGroup = "group_atlas"
> For some reason, all the jobs are being scheduled on the group B nodes
> first.
> Is there any reason why the post job rank wouldn't work, or is there some
> other knob to tune? I've set the RANK and NEGOTIATOR_PRE_JOB_RANK to the
> same value on both groups of nodes.
> Sean
> --
> Sean Crosby
> Research Computing
> ARC Centre of Excellence for Particle Physics at the Terascale
> School of Physics | University of Melbourne VIC 3010 Australia
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/

Ben Cotton
Technical Marketing Manager

Cycle Computing
Better Answers. Faster.

twitter: @cyclecomputing