Re: [HTCondor-users] Preemption policy configuration trouble

[Jaime Frey <jfrey@xxxxxxxxxxx>]

The p-slot preemption matching code is more complex than the normal matching code, since itâs aggregating multiple slots. To rule out any buggy behavior there, you can try disabling pslot preemption and seeing if your preemption policy works with the under-quota jobs preempting individual dslots of the over-quota jobs.

 - Jaime

On Sep 16, 2021, at 12:36 PM, Jonathan Martin <JMartin@xxxxxxxxxxxx> wrote:

Hi,

 

Iâm working on setting up a preemption policy for the purpose of restoring accounting group quotas. Our pool has a number of accounting groups, with all of them having accept_surplus = True.

 

I had set up a preemption policy that looks like this:

 

PREEMPTION_REQUIREMENTS = ((SubmitterGroupResourcesInUse < SubmitterGroupQuota) && (RemoteGroupResourcesInUse > RemoteGroupQuota)) || ((SubmitterGroup != nice-user) && (RemoteGroup == nice-user))

PREEMPTION_RANK = (RemoteUserPrio * 1000000) - ifThenElse(isUndefined(TotalJobRunTime), 0, TotalJobRunTime)

 

After turning this on, I ran some tests where one of the accounting groups was using 100% of the grid, and then submitted jobs from a different accounting group, but the preemption didnât seem to work. The second batch of jobs would only get matched as jobs from the first batch finished, without preempting running jobs.

 

I tried looking at condor_q âbetter-analyze for the second batch, and couldnât find any smoking guns â any jobs not running just said something to the effect of âthe matchmaker has not yet considered this job.â

 

Some other information: we have setup partitionable slots on all of our execute nodes, and also have this setting turned on: ALLOW_PSLOT_PREEMPTION = True.

 

Finally, we are running HTCondor for Windows version 8.8.12.

 

Appreciate any help with this issue.

 

Jon

 

Jonathan Martin, CFA

Connor, Clark & Lunn Investment Management Ltd.
T: 604-643-5766
Email: jmartin@xxxxxxxxxxxx

 

<image001.png>

Connor, Clark & Lunn Investment Management Ltd. 2300 - 1111 West Georgia Street Vancouver, BC  V6E 4M3

This communication (both the message and any attachments or links) is confidential and only intended for the use of the person or persons to whom it is addressed unless we have expressly authorized otherwise. If you are reading this communication and are not an addressee or authorized representative of an addressee, we hereby notify you that any distribution, copying or other use of it without our express authorization is strictly prohibited. If you have received this communication in error, please delete both the message and any attachments from your system and notify us immediately by e-mail or phone.

 

This communication (both the message and any attachments or links) is confidential and only intended for the use of the person or persons to whom it is addressed unless we have expressly authorized otherwise. It also may contain information that is protected by solicitor-client privilege. If you are reading this communication and are not an addressee or authorized representative of an addressee, we hereby notify you that any distribution, copying or other use of it without our express authorization is strictly prohibited. If you have received this communication in error, please delete both the message and any attachments from your system and notify us immediately by e-mail or phone. In addition, we note that this communication and its transmission of data have not been secured by encryption. Therefore, we are not able to confirm or guarantee that the communication has not been intercepted, amended, or read by an unintended third party.

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/