[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] 8.2.9 ALLOW_PSLOT_PREEMPTION



Hi Tom.

We are currently testing the 8.4.0 release in CHTC. Barring any unforseen difficulties during the test period, we expect to release it next Thursday. I have scheduled the 8.2.10 release to go out the following Thursday.

...Tim

On 09/01/2015 03:48 PM, Tom Downes wrote:
TJ:

Wondering if the TBD for 8.2.10 should be the same as 8.4.0 and whether the dates listed for 8.4.0 are what you presently think will happen?


Thanks for both backporting both the feature and the bugfix,

--
Tom Downes
Senior Scientist and Data Center Manager
Center for Gravitation, Cosmology and Astrophysics
University of Wisconsin-Milwaukee
414.229.2678

On Thu, Aug 27, 2015 at 10:23 AM, John (TJ) Knoeller <johnkn@xxxxxxxxxxx> wrote:
the current plan is that 8.2.10 will be the last 8.2 release and it will arrive at about the same time as 8.4.0.
Once 8.4.0 is out, any future 8.2 releases will be security patches only and with luck
there won't be any need for them.

-tj


On 8/26/2015 7:58 PM, Tom Downes wrote:
I had understood an 8.2.10 not to be in the works and that focus was on 8.4.0. Thanks for correcting my understanding.

--
Tom Downes
Senior Scientist and Data Center Manager
Center for Gravitation, Cosmology and Astrophysics
University of Wisconsin-Milwaukee
414.229.2678

On Wed, Aug 26, 2015 at 7:19 PM, Evan Sarmiento <esarmien@xxxxxxxxxxxxx> wrote:
Hi Tom,

According to
This fix is being backported in 8.2.10.

Best,
Evan

Evan Sarmeinto
Front End Systems Software Developer
Harvard-MIT Data Center
Follow us: @hmdcrce


On Wed, Aug 26, 2015 at 8:06 PM, Tom Downes <downes@xxxxxxx> wrote:

Jaime:

Can you define "next release"? 8.3-only or do you consider it a bug in the backported version as well?

--
Tom Downes
Senior Scientist and Data Center Manager
Center for Gravitation, Cosmology and Astrophysics
University of Wisconsin-Milwaukee
414.229.2678

On Wed, Aug 26, 2015 at 9:43 AM, Jaime Frey <jfrey@xxxxxxxxxxx> wrote:
On Aug 25, 2015, at 1:26 PM, Jaime Frey <jfrey@xxxxxxxxxxx> wrote:

On Aug 24, 2015, at 11:49 AM, Evan Sarmiento <esarmien@xxxxxxxxxxxxx> wrote:

Hi All,

I installed HTCondor 8.2.9 and turned on ALLOW_PSLOT_PREEMPTION by setting it to True on all my startds, schedds, and the negotiator. I have two startds configured as such:

ALLOW_PSLOT_PREEMPTION = True
NEGOTIATOR_USE_SLOT_WEIGHTS = true
NUM_SLOTS_TYPE_1 = 1
SLOT_TYPE_1 = 100%
SLOT_TYPE_1_PARTITIONABLE = True
SLOT_WEIGHT = Cpus
STARTD_SLOT_ATTRS = 

However, when enabled, I can’t get *any* pre-emption to occur. The Negotiator doesn’t even attempt to pre-empt any jobs.

When I turn off ALLOW_PSLOT_PREEMPTION, I can pre-empt like jobs that use the same resources as expected.

Has anyone else run into this?

I dug into the source code a little and it appears like jobs that want pslot preemption need ‘WantPslotPreemption’ in the ClassAd request, just to make sure, I made a job like this and even set nice_user so it could defenitley be pre-empted by any other job, but, no pre-emption occurs.


executable = /usr/bin/yes
universe = vanilla
output = /dev/null
error = /dev/null
log = /dev/null
nice_user = True
+WantPslotPreemption = True
queue 11

Any ideas?

First, the easy part: The WantPslotPreemption attribute is inserted by the schedd into the job ads that it sends to the negotiator to indicate that it understands a pslot preemption match, which involves claiming multiple slots on the execute machine. You shouldn’t set it in your submit file.

What form of preemption are you expecting that’s not occurring with pslot preemption enabled, user priority-based or startd rank-based? I just did a quick test with startd rank-based preemption and it worked in my test pool.

There’s a bug in the code that prevents pslot preemption from working for user priority-based preemption. Currently, it only works for preemption based on startd rank. We’ll fix that in the next release.

Thanks and regards,
Jaime Frey
UW-Madison HTCondor Project


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/



_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/



_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/



_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

-- 
Tim Theisen
Release Manager
HTCondor & Open Science Grid
Center for High Throughput Computing
Department of Computer Sciences
University of Wisconsin - Madison
4261 Computer Sciences and Statistics
1210 W Dayton St
Madison, WI 53706-1685
+1 608 265 5736