[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] Mixing cgroups, partitionable slots, and CPU limits



Greetings experts,

I have a configuration where Iâm mixing cgroups, partitionable slots, CPU affinity, and limiting the number of CPUs available to HTCondor on my workers. However, it seems like my jobs are all being limited to run on a single core. 

I havenât dug into it too deeply, but when the machine is full, âhtopâ shows most of the cores idle and one CPU at 100%. AFAIK, these jobs are very CPU-intensive on other machines.

Is there something obviously wrong in my STARTD config (attached below)? 

(Should I even bother with CPU affinity if Iâm using cgroups? )

Cheers,
Lincoln

NUM_CPUS = 32
ENFORCE_CPU_AFFINITY = true

SLOT_TYPE_1 = 100%
SLOT_TYPE_1_PARTITIONABLE = TRUE
NUM_SLOTS = 1
NUM_SLOTS_TYPE_1 = 1
SlotWeight = Cpus

BASE_CGROUP = htcondor
CGROUP_MEMORY_LIMIT_POLICY = soft