Re: [HTCondor-users] Limit requested cpu cores and RAM

[David Cohen <cdavid@xxxxxxxxxxxxxxxxxxxxxx>]

Hi,

How can I handle more complex scenario:

I want to limit all users as in the example above (CPU <=10 Mem <=40), on nodes node01 node02.

Except for one group (groupM) that, in addition, has access to "memory node" (node03) and should be able to request all the resources of that node (36 cores and 1TB RAM)

Those jobs (40GB < mem < 1TB) should not be matched to a regular nodes even if it has the requested mem, and jobs that mem < 40 should not match to that node.

I guess this involves both Schedd configuration and Startd classads.

Thanks,

David

On Mon, Nov 9, 2020 at 6:24 PM Guilherme De Sousa <garanha@xxxxxxxxxxxx> wrote:

Thank you so much John! Thatâs exactly what I was looking for!

Â

Best regards,

Â

Guilherme de Sousa Aranha

BANCO DE PORTUGAL
Departamento de Sistemas e Tecnologias de InformaÃÃo /ÂSystems and Information Technology Department
DSITI/ESA - Engenharia de Sistemas Aplicacionais

Rua Francisco Ribeiro, 2Â|Â1150-165ÂLisboa
Ext. 20792
garanha@xxxxxxxxxxxxÂ|Âwww.bportugal.pt

Â

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of John M Knoeller
Sent: 9 de novembro de 2020 15:26
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Limit requested cpu cores and RAM

Â

Hi. Guilherme,Â

Â

You can limit RequestCPUs and RequestMemory the same way you impose other limits on what a user is doing with their

jobs by by configuring a submit SUBMIT_REQUIREMENT in the Schedd.

Â

For example to limit requested CPUs to 10, and requested Memory to 2GB, you could add this to your configuration

Â

SUBMIT_REQUIREMENT_ReqCpus = RequestCpus <= 10

SUBMIT_REQUIREMENT_ReqCpus_REASON = "Jobs should not request more than 10 CPUs"

Â

# memory is requested in Megabytes, so we have to multiply to get GB.

SUBMIT_REQUIREMENT_ReqMem = RequestMemory <= 2*1024

SUBMIT_REQUIREMENT_ReqMem_REASON = "Jobs should not request more than 2 GB of Memory"

Â

SUBMIT_REQUIREMENT_NAMES = ReqCpus ReqMem $(SUBMIT_REQUIREMENT_NAMES)

Â

-tj

Â

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of Guilherme De Sousa
Sent: Monday, November 9, 2020 6:45 AM
To: htcondor-users@xxxxxxxxxxx
Subject: [HTCondor-users] Limit requested cpu cores and RAM

Â

Hi!

Â

Iâve been searching through the mailing list and documentation for this and canât seem to find it..

Â

We have an htcondor pool with partitionable slots and weâd like to limit the number or requested cpus and RAM but canât seem to figure out how to do this..

Â

Can someone point me in the right direction?

Â

Best regards,

Â

Guilherme Sousa

---

Este e-mail dirige-se apenas aos destinatÃrios acima indicados, sendo proibida a sua divulgaÃÃo, total ou parcial, ou o uso ou reenvio nÃo autorizados. Se recebeu este e-mail por engano, por favor notifique o remetente imediatamente via e-mail e exclua-o do seu sistema.
O Banco de Portugal trata os dados pessoais de acordo com os princÃpios e regras decorrentes da legislaÃÃo europeia e nacional, em especial do Regulamento (UE) 2016/679, do Parlamento Europeu e do Conselho, de 27 de abril de 2016. Para mais informaÃÃes consulte a PÃgina do Banco de Portugal sobre proteÃÃo de dados. Em caso de dÃvidas, pode contactar o Encarregado da ProteÃÃo de Dados para o seguinte e-mail: (encarregado.protecao.dados@xxxxxxxxxxxx). Pode tambÃm consultar a Autoridade Nacional da ProteÃÃo de Dados.

This e-mail is intended only for the use of the recipient(s) named above. Any unauthorised disclosure use or dissemination, either in whole or in part, is prohibited. If you have received this e-mail in error, please notify the sender immediately via e-mail and delete this e-mail from your system.
Banco de Portugal processes personal data in line with the principles and rules in European and national legislation, in particular Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016. For further information, see Banco de Portugalâs webpage on data protection. In case of queries, please contact Banco de Portugalâs Data Protection Officer (encarregado.protecao.dados@xxxxxxxxxxxx). You may also contact the Portuguese Data Protection Authority (ComissÃo Nacional de ProteÃÃo de Dados).

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/