Re: [HTCondor-users] lower latency scheduling

[Rita <rmorgan466@xxxxxxxxx>]

CLAIM_WORKLIFE is a confusing term. By default its -1, "infinite claim worklife". I suppose I can put this as 10 (?).Â

ÂI have already decreased SCHEDD_INTERVAL to 10 secs and I will do it for NEGOTIATOR_INTERVAL. Does the scheduler/negotiator throttle how many jobs can be scheduled per negotiation?

On Thu, May 25, 2023 at 5:38âPM Cole Bollig via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:

Hi Rita,

Once a Schedd has a claim on Startd resources for a user the Schedd will try to run as many jobs that it can on thoseÂresources up to CLAIM_WORKLIFE seconds. Increasing the CLAIM_WORKLIFE would cause those claims to stay alive longer and get user jobs running once the resources are available again.

If you truly want to just increase the amount of negotiation cycles in the hopes of making more matches to resources, then you could try reducing the SCHEDD_INTERVAL and NEGOTIATOR_INERVAL.

-Cole Bollig

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Rita <rmorgan466@xxxxxxxxx>
Sent: Thursday, May 25, 2023 5:29 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: [HTCondor-users] lower latency scheduling

Â

I am trying to think of ways to lower my scheduling latency. My machines on Azure are relatively powerful. 256 cores, 2TB of memory, fast NVME local disks. I have 30 of them in my HTcondor pool.Â

My job profile is: they are small running jobs. each take like 30s to 5 mins to run. When the user submits the job, I want the scheduler/negotiator to aggressivelyÂmatch. No preemption. What are Âsome knobs we can tune for a setup like this?Â

--

--- Get your facts first, then you can distort them as you please.--

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

--

--- Get your facts first, then you can distort them as you please.--