Re: [HTCondor-users] How to prefer certain nodes for jobs

[Ben Cotton <ben.cotton@xxxxxxxxxxxxxxxxxx>]

Sean,

Two issues. One, it sounds like you're setting
NEGOTIATOR_POST_JOB_RANK on the execute nodes themselves. That's a
negotiator setting, so it won't have any effect if it's set on an
execute node. Secondly, NEGOTIATOR_POST_JOB_RANK is essentially "use
this as a tiebreaker after you've evaluated everything else." If you
want to have a stronger preference, I'd use NEGOTIATOR_PRE_JOB_RANK.

Doing it on the negotiator can make it a little ugly. If you set an
attribute on the execute node (e.g. NodeGroup) that exactly matches
the accounting group name and include that in your STARTD_ATTRS, you
can do something like this on your negotiator:

  NEGOTIATOR_PRE_JOB_RANK = (MY.NodeGroup =?= TARGET.AcctGroup)

(note that you don't need to throw a large number multiplier in here
since the magnitude of the rank difference doesn't matter. Also, I
prefer to use =?= over == in these kinds of situations so you don't
end up with an UNDEFINED in your expression. This will make your
comparison case-sensitive, though, so be careful
http://research.cs.wisc.edu/htcondor/manual/v8.6/4_1HTCondor_s_ClassAd.html#SECTION00513400000000000000
)

On Mon, Jul 31, 2017 at 1:26 AM, Sean Crosby <scrosby@xxxxxxxxxxxxxx> wrote:
> We are looking at making certain jobs prefer certain worker nodes based on
> attributes in the job - specifically who submitted the job
>
> All nodes can run the jobs, but we'd like it if AcctGroup 'A' goes to node
> group 'A' first, and AcctGroup 'B' goes to node group 'B'
>
> We have tried setting both the RANK and NEGOTIATOR_POST_JOB_RANK to
> something like this
>
> Worker node group A:
>
> NEGOTIATOR_POST_JOB_RANK = 1000000 * (TARGET.AcctGroup == 'group_atlas')
>
> Worker node group B:
>
> NEGOTIATOR_POST_JOB_RANK = 1000000 * (TARGET.AcctGroup == 'tier3')
>
> Job classads:
>
> $ condor_q -long 1090
> AcctGroup = "tier3"
>
> $ condor_q -long 32
> AcctGroup = "group_atlas"
>
> For some reason, all the jobs are being scheduled on the group B nodes
> first.
>
> Is there any reason why the post job rank wouldn't work, or is there some
> other knob to tune? I've set the RANK and NEGOTIATOR_PRE_JOB_RANK to the
> same value on both groups of nodes.
>
> Sean
>
> --
> Sean Crosby
> Research Computing
> ARC Centre of Excellence for Particle Physics at the Terascale
> School of Physics | University of Melbourne VIC 3010 Australia
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/



-- 
Ben Cotton
Technical Marketing Manager

Cycle Computing
Better Answers. Faster.

http://www.cyclecomputing.com
twitter: @cyclecomputing