[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] Prioritizing certain jobs on a subset of worker nodes



Hello.

Is there a Condor "best practice" to control the share of resources certain jobs get of a subset of a pool's worker nodes? The only solution I can think of involves those worker nodes randomly choosing a RANK expression to prefer certain jobs over others. I wonder if there is something more elegant or centralized.

Here's the context: One of our pools consists of short-lived glide-in worker nodes from a number of different institutions/sites (identifiable by their "Site" attribute). Jobs in the pool belong to one of several classes (again, based on a custom attribute, say, "Class").

We need to control the share of resources that jobs of certain classes get on worker nodes at certain sites. For example, assuming sufficient demand, jobs from Class-A should get 70% of workers/slots at Site-1. The remaining Site-1 resources should be split such that Class-A jobs get twice the resources of Class-B.

I am thinking of implementing this using randomized rank expressions, but even with only 3 groups, it gets pretty messy, so I wonder if people have ideas on how to do this more cleanly.


Thanks very much,

Vlad