[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Fair Resource Allocation question

Thanks a lot - I'll give it a shot.
From: Ian Chesal [mailto:ichesal@xxxxxxxxxxxxxxxxxx]
Sent: Wednesday, August 22, 2012 07:05 PM
To: Condor-Users Mail List <condor-users@xxxxxxxxxxx>
Subject: Re: [Condor-users] Fair Resource Allocation question
On Wednesday, 22 August, 2012 at 11:48 AM, Yuval Leader wrote:

Thanks Ian for the prompt and clear reply. Few more questions:

1.      Is there an easy way to control and set the EUP, per each user, prior to the negotiation cycle ? for example, I would like to ensure that all users have the same EUP.

You can manipulate it with condor_userprio: http://research.cs.wisc.edu/condor/manual/v7.6/condor_userprio.html#79484

Trying to do that before a negotiation cycle would be hard to impossible.

You could set PRIORITY_HALFLIFE to 1, so accumulated use decays very rapidly when a user's use changes. This would ensure EUP tracks current, real time use very closely.

If what you want is not a fair share division of resources as Condor defines fair sharing, then you should look at accounting groups. From what you're describing you want four groups, each with a soft quota of 50. Accounting groups are definitely the path of least resistance to achieving this.

2.      How can the negotiation cycle be disabled from being activated automatically (probably in ../ etc/condor_config file) and how can it be triggered manually at the command line.

You can't disable the negotiator completely aside from not having one start automatically on your central manager and then using 'condor_off -negotiator' and 'condor_on -negotiator' to start and stop it manually.

You could slow down the negotiator so it's never cycling: http://research.cs.wisc.edu/condor/manual/v7.6/3_3Configuration.html#19639 -- try setting NEGOTIATOR_INTERVAL to something absurdly big.

And the try using condor_reschedule to trigger a negotiation cycle whenever you want one: http://research.cs.wisc.edu/condor/manual/v7.6/condor_reschedule.html#70149

Again, if you're fighting Condor like this you're sort of doing it wrong. I'd recommend investigating accounting groups before you try to start manipulating negotiation cycles and EUP like this.

- Ian

Ian Chesal

Cycle Computing, LLC
Leader in Open Compute Solutions for Clouds, Servers, and Desktops
Enterprise Condor Support and Management Tools