[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] a question about machines in the pool and slots handling



Hello Thomas:

Thank you very much for responding and for considering my problem.
Are those instructions that you sent something that I should add to my condor submission file ( I could send you  the file if you would like to inspect it), or within the (condor_config) file loaded when the condor service starts?.
Thank you

Julio J. Valdés
National Research Council Canada                                    | Conseil National de Recherches Canada 
Digital Technologies Research Centre                               | Centre de Recherche en Technologies Numériques
Data Science for Complex Systems Group                        | Science des Données pour les Systèmes Complexes
M-50, 1200 Montreal Road, Ottawa, Ontario K1A 0R6 | M-50, 1200 chemin Montréal, Ottawa, Ontario K1A 0R6 
Canada                                                                                     | Canada 
julio.valdes@xxxxxxxxxxxxxx
tel/tél: (1)613-993-0257


-----Original Message-----
From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Thomas Hartmann
Sent: Monday, August 23, 2021 8:06 AM
To: htcondor-users@xxxxxxxxxxx
Subject: Re: [HTCondor-users] a question about machines in the pool and slots handling

***ATTENTION*** This email originated from outside of the NRC. ***ATTENTION*** Ce courriel provient de l'extérieur du CNRC

Hi Julio,

you might be able to realize it with CONSUMPTION policies [1], with which you could set different slot types each to a specific number of cores but keep them partitionable to also attract smaller jobs without too much waste (but I am not 100% sure).

Cheers,
   Thomas

[1]
SLOT_TYPE_1 = cpu=4
SLOT_TYPE_1_PARTITIONABLE = true ## should make the slot accept jobs with cores between 1 and 4 ## SLOT_TYPE_1_CONSUMPTION_POLICY = false

https://htcondor.readthedocs.io/en/latest/admin-manual/policy-configuration.html?highlight=condor_negotiator-Side%20Resource%20Consumption%20Policies%20#condor-negotiator-side-resource-consumption-policies

On 23/08/2021 11.41, Valdes, Julio wrote:
> Hello:
>
> I have a condor pool with machines having different numbers of CPUs 
> each
> (Ex: machine A has 16 cpus, machine B 32 cpus and so on).
>
> The scenario is that I want to be able to somehow specify that only 4 
> CPUS max must be used from machine A, 10 from machine B and so on.
>
> A more elaborated reformulation of the above would be:
>
> How could I write a ClassAd requirement indicating that from machine A 
> I want to use only slots 3, 4 and 5, from machine B slots 23, 25, 27 
> and 28, say?.
>
> All of that, within a condor submission file.
>
> Is that possible?.
>
> If so, Could anyone provide an example of a requirement (or rank) 
> statement implementing the aforementioned specification?.
>
> I tried to google this issue in many ways, unsuccessfully. I also went 
> through the condor manuals, but I was not able either to find the 
> answer or to understand the material so that I could construct the answer myself.
>
> Any help would be much appreciated.
>
> Thank you in advance
>
> Julio J. Valdés
>
> National Research Council Canada                                    |
> Conseil National de Recherches Canada
>
> Digital Technologies Research Centre                               |
> Centre de Recherche en Technologies Numériques
>
> Data Science for Complex Systems Group                        | Science
> des Données pour les Systèmes Complexes
>
> M-50, 1200 Montreal Road, Ottawa, Ontario K1A 0R6 | M-50, 1200 chemin 
> Montréal, Ottawa, Ontario K1A 0R6
>
> Canada
>                                                                   | 
> Canada
>
> julio.valdes@xxxxxxxxxxxxxx <mailto:julio.valdes@xxxxxxxxxxxxxx>
>
> tel/tél: (1)613-993-0257
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx 
> with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
>