Re: [HTCondor-users] HTCondor Concurrency Limits

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

On 9/19/2016 11:35 PM, Jason Liu wrote:
 > This tells me when concurrency limit is enabled, condor is matching one
> job at a time, and the matchmaking cycle is something like 20 seconds to
> 1 minute. In our production cluster we need to push through 100k jobs in
> a day. Obviously matching one job per minute is not very scalable. So I
> am wondering if there is anything I have done wrong here.
>
> We are running condor 8.4.7 on Ubuntu 14.04.
>
> Thanks in advance for any help.

Are your execute nodes (startds) configured to use partitionable slots? 
If so, there are known issues combining concurrency limits and 
partitionable slots, including the behavior you saw above.  We plan to 
improve this in a future release, but for the moment I think you can 
work around these problems by adding the following line to your 
condor_config :

   CONSUMPTION_POLICY = True

I think you will need to do this on all of your execute nodes (startds), 
then do a condor_reconfig or condor_restart.  Try doing this and 
reporting back, I think you will find improvement. For a lot of detail 
about what is happening here, see

  https://htcondor-wiki.cs.wisc.edu/index.cgi/wiki?p=ConsumptionPolicies

regards,
Todd


> Kind Regards
>
> Jason
>
> PRIVACY AND CONFIDENTIALITY NOTICE
> /The information contained in this message is intended for the named
> recipients only. It may contain confidential information and if you are
> not the intended recipient, you must not copy, distribute or take any
> action in reliance on it. If you have received this message in error
> please destroy it and reply to the sender immediately or contact us at
> the above telephone number. /
> VIRUS DISCLAIMER
> /While we take every precaution against presence of computer viruses on
> our system, we accept no responsibility for loss or damage arising from
> the transmission of viruses to e-mail recipients./
>
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/


--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685