[HTCondor-users] Jobs take ages to start

[Gaetan Geffroy <gage@xxxxxxxxx>]

Hi,

 

Some of my jobs stay in IDLE for a really long time compared to what I have configured.

On the submit node, I set NEGOTIATOR_INTERVAL to 5 seconds, expecting jobs to start extremely quickly after being submitted.

This is a local pool for test and training purposes, so I actually want the jobs to start and execute almost immediately.

 

When looking at the NegotiatorLog file, it looks like the negotiation cycles are happening as often as intended, yet most of my jobs stay in queue for 5 minutes.

Those are docker universe jobs. Condor_q -better-analyze tells me there are machines capable of running my jobs.

Even weirder, I tried to download one of my docker images as a TAR archive and load manually in Docker, and then the jobs using that image start immediately.

The same jobs using the same image but from a Docker repo take 5 minutes to start.

 

Is there another knob I could turn to speed up the process ?

 

Thanks,

Gaëtan

 

Gaetan Geffroy
Junior Software Engineer, Space

Terma GmbH
Europaarkaden II, Bratustraße 7, 64293 Darmstadt, Germany
T +49 6151 86005 43 (direct)  •  T +49 6151 86005-0
Terma GmbH - Sitz Darmstadt  •  Handelsregister Nr.: HRB 7411, Darmstadt
Geschäftsführer: Poul Vigh / Steen Vejby Sørensen
www.terma.com • Linkedin • Twitter • Instagram • Youtube

---

Attention:
This e-mail (and attachment(s), if any) - intended for the addressee(s) only - may contain confidential, copyright, or legally privileged information or material, and no one else is authorized to read, print, store, copy, forward, or otherwise use or disclose any part of its contents or attachment(s) in any form. If you have received this e-mail in error, please notify me by telephone or return e-mail, and delete this e-mail and attachment(s). Thank you.