[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] a question about machines in the pool and slots handling



Hi Julio,

you might be able to realize it with CONSUMPTION policies [1], with which you could set different slot types each to a specific number of cores but keep them partitionable to also attract smaller jobs without too much waste (but I am not 100% sure).

Cheers,
  Thomas

[1]
SLOT_TYPE_1 = cpu=4
SLOT_TYPE_1_PARTITIONABLE = true ## should make the slot accept jobs with cores between 1 and 4 ##
SLOT_TYPE_1_CONSUMPTION_POLICY = false

https://htcondor.readthedocs.io/en/latest/admin-manual/policy-configuration.html?highlight=condor_negotiator-Side%20Resource%20Consumption%20Policies%20#condor-negotiator-side-resource-consumption-policies

On 23/08/2021 11.41, Valdes, Julio wrote:
Hello:

I have a condor pool with machines having different numbers of CPUs each (Ex: machine A has 16 cpus, machine B 32 cpus and so on).

The scenario is that I want to be able to somehow specify that only 4 CPUS max must be used from machine A, 10 from machine B and so on.

A more elaborated reformulation of the above would be:

How could I write a ClassAd requirement indicating that from machine A I want to use only slots 3, 4 and 5, from machine B slots 23, 25, 27 and 28, say?.

All of that, within a condor submission file.

Is that possible?.

If so, Could anyone provide an example of a requirement (or rank) statement implementing the aforementioned specification?.

I tried to google this issue in many ways, unsuccessfully. I also went through the condor manuals, but I was not able either to find the answer or to understand the material so that I could construct the answer myself.

Any help would be much appreciated.

Thank you in advance

Julio J. Valdés

National Research Council Canada                                    | Conseil National de Recherches Canada

Digital Technologies Research Centre                               | Centre de Recherche en Technologies Numériques

Data Science for Complex Systems Group                        | Science des Données pour les Systèmes Complexes

M-50, 1200 Montreal Road, Ottawa, Ontario K1A 0R6 | M-50, 1200 chemin Montréal, Ottawa, Ontario K1A 0R6

Canada                                                                  | Canada

julio.valdes@xxxxxxxxxxxxxx <mailto:julio.valdes@xxxxxxxxxxxxxx>

tel/tél: (1)613-993-0257


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/


Attachment: smime.p7s
Description: S/MIME Cryptographic Signature