[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] Limiting number of jobs of specific user to N per node
- Date: Mon, 23 Oct 2017 08:51:09 -0500
- From: Greg Thain <gthain@xxxxxxxxxxx>
- Subject: Re: [HTCondor-users] Limiting number of jobs of specific user to N per node
On 10/23/2017 01:23 AM, Sean Crosby wrote:
We run jobs for the Belle experiment, and at the moment, their jobs
are very IO intensive. If say, on a 12 core node, if all 12 cores are
taken up by Belle jobs, the node suffers heavily from IO problems.
We'd like to limit the number of belle jobs on each node to be (say
e.g.) 4, but keep the other 8 slots to be open for other user jobs.
What's the easiest way to do this?
Machine custom resources are the best way to do this. On the execute
side, you can define how many resources that machine has, in some
arbitrary unit, like this:
MACHINE_RESOURCE_Belle = 4
and in the job ad, the belle jobs should say
Request_belle = 1
which means "only match to machines which have 1 or more belle resources
remaining, and consume 1 for the duration of my job".