[HTCondor-users] Best Practice method to limit number of slots on a machine

[Lyle Pakula <Lyle@xxxxxxxxxxxxxxxx>]

Hi Everyone,

I'm wondering what people's best practice is to easily limit the number of jobs running on a machine as not to saturate that machine.Â

Our jobs are heavy I/O rather than compute. So when a job is submitted we try to spread it across the cluster using the below rank

# Define Load Balancing on the AE Pool

NEGOTIATOR_PRE_JOB_RANK=( \$(NEGOTIATOR_PRE_JOB_RANK) ) * SlotID

But big jobs will still saturate. So what's the best way to limit the number of slots use on a machine, noting our machines vary from 4-8 cores. Ideally we would limit the number of slots ot sayÂ75% of what the max is. Below is a bit heavy handed.

# DON'T COUNT HYPERTHREADED CPUS AS THIS LEADS TO SATURATIONÂ
COUNT_HYPERTHREAD_CPUS=FALSE

Thanks, Lyle

--

AE CAPITAL
15 William St, Level 19, Melbourne VIC, Australia

p +61 3 9020 7801
m +61 (0)434 872 054

w http://www.aecapital.com.au

AE Capital Pty Limited (ACN 153 242 865) is regulated by the Australian Securities & Investments Commission and is a Corporate Authorised Representative of JFM Pty Limited (ACN 125 150 656), holder of an Australian Financial Services Licence (AFSL 314585). AE Capital Pty Limited is a member of the National Futures Association (ID 0498660).