We have a need to fill our HTCondor pool breadth-first to improve IO efficiency.
We are using p-slots in our pool, since our jobs come in all sorts of shapes and sizes.
I am a bit lost as to how to configure a pool to fill breadth-first. By default it seems HTCondor fills depth-first.
After some research, I have found this article:
which shows a way to fill the pool breadth-first. However the solution presented has one major drawback for p-slots, which is that each machine can only match one new job per negotiation cycle.
We are looking for a way to fill our pool breadth first, without the limitation of only being able to match one job per negotiation cycle per machine. Does HTCondor have a way to overcome this?
We are using HTCondor 8.4.7. In addition, we are also using concurrency limits and consumption policy is enabled on all machines in the pool.
Any help would be greatly appreciated.
PRIVACY AND CONFIDENTIALITY NOTICE