[HTCondor-users] Preemption policy configuration trouble

[Jonathan Martin <JMartin@xxxxxxxxxxxx>]

Hi,

 

I’m working on setting up a preemption policy for the purpose of restoring accounting group quotas. Our pool has a number of accounting groups, with all of them having accept_surplus = True.

 

I had set up a preemption policy that looks like this:

 

PREEMPTION_REQUIREMENTS = ((SubmitterGroupResourcesInUse < SubmitterGroupQuota) && (RemoteGroupResourcesInUse > RemoteGroupQuota)) || ((SubmitterGroup != nice-user) && (RemoteGroup == nice-user))

PREEMPTION_RANK = (RemoteUserPrio * 1000000) - ifThenElse(isUndefined(TotalJobRunTime), 0, TotalJobRunTime)

 

After turning this on, I ran some tests where one of the accounting groups was using 100% of the grid, and then submitted jobs from a different accounting group, but the preemption didn’t seem to work. The second batch of jobs would only get matched as jobs from the first batch finished, without preempting running jobs.

 

I tried looking at condor_q –better-analyze for the second batch, and couldn’t find any smoking guns – any jobs not running just said something to the effect of “the matchmaker has not yet considered this job.”

 

Some other information: we have setup partitionable slots on all of our execute nodes, and also have this setting turned on: ALLOW_PSLOT_PREEMPTION = True.

 

Finally, we are running HTCondor for Windows version 8.8.12.

 

Appreciate any help with this issue.

 

Jon

 

Jonathan Martin, CFA

Connor, Clark & Lunn Investment Management Ltd.
T: 604-643-5766
Email: jmartin@xxxxxxxxxxxx

 

Connor, Clark & Lunn Investment Management Ltd. 2300 - 1111 West Georgia Street Vancouver, BC  V6E 4M3

This communication (both the message and any attachments or links) is confidential and only intended for the use of the person or persons to whom it is addressed unless we have expressly authorized otherwise. If you are reading this communication and are not an addressee or authorized representative of an addressee, we hereby notify you that any distribution, copying or other use of it without our express authorization is strictly prohibited. If you have received this communication in error, please delete both the message and any attachments from your system and notify us immediately by e-mail or phone.

 

This communication (both the message and any attachments or links) is confidential and only intended for the use of the person or persons to whom it is addressed unless we have expressly authorized otherwise. It also may contain information that is protected by solicitor-client privilege. If you are reading this communication and are not an addressee or authorized representative of an addressee, we hereby notify you that any distribution, copying or other use of it without our express authorization is strictly prohibited. If you have received this communication in error, please delete both the message and any attachments from your system and notify us immediately by e-mail or phone. In addition, we note that this communication and its transmission of data have not been secured by encryption. Therefore, we are not able to confirm or guarantee that the communication has not been intercepted, amended, or read by an unintended third party.