[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] greedy_user ?



Hi Joseph,

 

Thanks for the quick reply!

 

Will this work with parallel universe jobs (DedicatedScheduler)? Because I’m trying what you said right now and it doesn’t seem to work.

 

Job 116 is from user “test”.

Job 117 is from user “test2”.

Job 118 is from user “test2” and “accounting_group_user = pronto” added to submit file.

All 3 jobs are parallel universe.

 

Jobs are set to be Pre-empted after running for 120 seconds (for quick testing purposes): use POLICY: Preempt_if_Runtime_Exceeds( 120 )

Job 116 keeps going back to the running state after being pre-empted.

I would assume Job 118 would start running instead.

 

Is this about FIFO? If so, is there any way to change it?

 

Also, I have dynamic partitionable slots configured:

 

DedicatedScheduler = "DedicatedScheduler@sms1"

STARTD_ATTRS = \$(STARTD_ATTRS), DedicatedScheduler

START = True

SUSPEND = False

CONTINUE = True

PREEMPT = False

KILL = False

WANT_SUSPEND = False

WANT_VACATE = False

RANK = Scheduler =?= \$(DedicatedScheduler)

use FEATURE: PartitionableSlot( 1, auto )

 

 

 

 

Thanks!

 

Martin

 

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of JOSEPH RYAN REUSS via HTCondor-users
Sent: September 15, 2023 2:32 PM
To: htcondor-users@xxxxxxxxxxx
Cc: JOSEPH RYAN REUSS <jrreuss@xxxxxxxx>
Subject: Re: [HTCondor-users] greedy_user ?

 

Hi Martin!

 

Condor assigns fair share by user, which is not necessarily a human, so let's create a high priority user that a human can utilize so jobs can get high priority. You would need to set 'accounting_group_user = <some_user>' in your submit file to override the default user selected and select <some_user> instead. You can then set the priority of that user by running 'condor_userprio -setfactor <some_user> <priority number>' on the AP you are submitting the job from. 

 

Here's the documentation for reference:

 


From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Beaumont, Martin <Martin.Beaumont@xxxxxxxxxxxxxxx>
Sent: Friday, September 15, 2023 12:56 PM
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: [HTCondor-users] greedy_user ?

 

Hi,

 

We sometimes have urgent jobs where we’d want them to bypass all other jobs as soon as possible. Something like a reversed nice_user (greedy_user?).

 

Now that I know how to Hold or Preempt jobs with a timelimit, I’d like a way for an urgent job to be put at the front of the queue, regardless of other users, fair-share, priorities, weights, quotas, job universe, etc. The system would then wait for enough resources to be free and launch that job before every other regular job from the queue.

 

Is there a configuration that could enable such behavior?

 

Thanks!

 

Martin