While pondering this question, I found what looks like the information you need on page 334 of the 8.4.9 manual â in effect you want a âstrict priorityâ policy for the post-processing DAG nodes:
One possible group quota policy is strict priority. For example, a site prefers physics users to match as many
slots as they can, and only when all the physics jobs are running, and idle slots remain, are chemistry jobs allowed
to run. The default "starvation group order" can be used to implement this. By setting configuration variable
NEGOTIATOR_ALLOW_QUOTA_OVERSUBSCRIPTION to True, and setting the physics quota to a number so
large that it cannot ever be met, such as one million, the physics group will always be the "most starving" group, will
always negotiate first, and will always be unable to meet the quota. Only when all the physics jobs are running will
the chemistry jobs then run.
Your post-job is equivalent to âphysicsâ and everything else is equivalent to âchemistry,â I think.
From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx]
On Behalf Of Szabolcs HorvÃtth
It turned out that we modified the default prio factor to 10 (before the condor default switched to 1000) so I changed all users priority factor to 1000 and set the urgent group's priority to 1. It did help
in shortening the process of the jobs grabbing free slots, but it still takes between 10-15 minutes to do so. Whats interesting is that after these ten minutes lots of slots are allocated to the group, so there is obviously something affected by the group
priority. The might be some unintentional claim / timeout setting behind all this but I don't know what to look for.