Re: [HTCondor-users] condor_shadow start rate

[Ben Cotton <ben.cotton@xxxxxxxxxxxxxxxxxx>]

I have an update on this. I set SHADOW_WORKLIFE = 0 to maximize churn
and submitted a batch of 200 6-second sleep jobs to a 128-slot
cluster. With the same configuration and hardware, an HTCondor 8.0.5
scheduler was starting on average 3.33 shadows/sec. Upgrading the
scheduler to 8.1.5 and keeping everything else the same resulted in a
shadow start rate that averaged 22 shadows/sec (and in the first two
seconds, we started 58 and 46 shadows).

So whatever you've done to improve schedd performance in the devel
series, it's working! The slow starts we're seeing with 8.0 still seem
surprisingly low, but it's good to know that performance is heading in
the right direction.


Thanks,
BC

-- 
Ben Cotton
main: 888.292.5320

Cycle Computing
Leader in Utility HPC Software

http://www.cyclecomputing.com
twitter: @cyclecomputing