[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Set of jobs with limited number of starts per cycle?



Hi Greg,

thanks for thinking about it - I guess it is really not a very obvious
wish ;)

Thing is, that we have been thinking about pleasing our users wanting
immediately seeing their jobs starting but also also be unhappy, when
they see slots not being occupied.
I.e., user A from group X sents a batch of some k jobs and is happy that
his/her (nice_user) jobs all get slots in an quite early morning
cluster. But then user B (also in group X) comes into the office and has
to wait an hour for his/her jobs to start and complains bitterly...

Currently we have quotas by groups implemented as sub-quotas for each &
every user per group would get cumbersome. So my initial hope was if one
could spread the job starts as to emulate a bit of low job start latency.

Cheers and thanks,
  Thomas

On 2018-01-04 22:48, Greg Thain wrote:
> On 01/02/2018 05:30 AM, Thomas Hartmann wrote:
>> Hi,
>>
>> just upping my question ;)
>> There seems to be no easy(?) way to throttle per user the number of
>> brokered jobs per negotiation cycle, or?
> 
> I've been thinking about this a bit, and I don't know that there's a
> good way to do it in condor. First, even if we spread out the matches
> per cycle, the schedd can re-use matches for multiple job in sequence,
> so it might not impact the time machines free up as much as you might
> think.
> 
> Perhaps to get the results you want, you could start jobs as usual, but
> enable preemption so that higher-priority jobs could start more
> quickly. Or, reserve some machines for your higher-priority jobs.
> 
> -greg
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature