[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] jobs with disjoint requirements
- Date: Sun, 25 Oct 2015 14:48:08 +0000
- From: "Krieger, Donald N." <kriegerd@xxxxxxxx>
- Subject: Re: [HTCondor-users] jobs with disjoint requirements
Thanks for getting back so quickly.
So this enables me to essentially create multiple queues for my jobs by specifying disjoint requirements.
" HTCondor will eagerly attempt to match and run all your jobs."
Is this why it's a bad idea to have very large numbers of jobs queued?
Don Krieger, Ph.D.
Department of Neurological Surgery
University of Pittsburgh
> -----Original Message-----
> From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf
> Of Todd Tannenbaum
> Sent: Sunday, October 25, 2015 10:41 AM
> To: HTCondor-Users Mail List
> Subject: Re: [HTCondor-users] jobs with disjoint requirements
> On 10/25/2015 8:39 AM, Krieger, Donald N. wrote:
> > I have two sets of jobs queued to run:
> > (1)Jobs for which the requirements _prohibit_ deployment to machines
> > in subdomain 123.456 .
> > (2)Jobs for which the requirements _require_ deployment to machines in
> > subdomain 123.456 .
> > Suppose there are 5000 of the jobs which require 123.456 at the head
> > of my queue, either because I've set their priority high or because
> > they were queued first.
> > Yet there are no cores available in that subdomain but there are
> > machines available outside it.
> > Will the jobs which prohibit deployment to 123.456 run or do they have
> > to wait till all of the jobs ahead of them which require 123.456 are
> > running first?
> The jobs which prohibit deployment will run; they will not have to wait for jobs
> ahead of them to run first. HTCondor will eagerly attempt to match and run all
> your jobs.
> You can demonstrate this to yourself with a submit file like
> executable = /bin/true
> requirements = false
> requirements = true
> You should observe that the second queued job will run.
> If this is not the behavior you want, i.e. you want your lower priority jobs to wait
> until the higher ones have completed, at first blush I think you'd have to use
> condor_submit_dag (DAGMan).
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> The archives can be found at: