[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] How to limit the number of running jobs on a startd?



Hi Zach,

Indeed, that is the case.
Setting the limit in SLOT_TYPE_1 seems to be doing the trick :)

Cheers,
Jose

El miÃ, 9 dic 2020 a las 16:26, Zach Miller (<zmiller@xxxxxxxxxxx>) escribiÃ:
>
> Hi Jose,
>
>
>
> Are you using partitionable slots then?  If so, then using NUM_CPUS should still do what you'd want so I don't think you need to change anything.
>
>
>
> Where you would run into some more difficulty is if you wanted to limit number of jobs, but some jobs were single core and some were multicore.
>
>
>
>
>
> Cheers,
>
> -zach
>
>
>
>
>
> -----Original Message-----
> From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx>
> Date: Wednesday, December 9, 2020 at 7:01 AM
> To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
> Subject: Re: [HTCondor-users] How to limit the number of running jobs on a startd?
>
> HI Zach,
>
> coming back to this question, you actually pointed out the right
>
> constraint. I didn't realize that jobs are not single core.
>
> So my question actually is not how to limit the number of jobs, but
>
> how to limit the number of cores.
>
>
>
> Are NUM_SLOTS and NUM_SLOT_TYPE the right classads I need to play
>
> with? I don't see a NUM_CORES classads ...
>
>
>
> Cheers,
>
> Jose
>
>
>
>
>
>
>
> El mar, 1 dic 2020 a las 16:41, Zach Miller (<zmiller@xxxxxxxxxxx>) escribiÃ:
>
> >
>
> > Hi Jose,
>
> >
>
> >
>
> >
>
> > Assuming these are single core jobs, you can just set:
>
> >
>
> >     NUM_CPUS = 26
>
> >
>
> >
>
> >
>
> > In the config on your execute machines.  This should work whether you are using static or partitionable slots.
>
> >
>
> >
>
> >
>
> >
>
> >
>
> > Cheers,
>
> >
>
> > -zach
>
> >
>
> >
>
> >
>
> >
>
> >
>
> > -----Original Message-----
>
> > From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx>
>
> > Date: Tuesday, December 1, 2020 at 9:54 AM
>
> > To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
>
> > Subject: [HTCondor-users] How to limit the number of running jobs on a startd?
>
> >
>
> > Hi,
>
> >
>
> >
>
> >
>
> > Is it documented somewhere the options to limit the number of jobs on
>
> >
>
> > a given host?
>
> >
>
> > Let's say, for example, you have a host with 32 slots. By default it
>
> >
>
> > can have 32 concurrent jobs. Are they easy ways to limit that to, for
>
> >
>
> > example, 26 jobs?
>
> >
>
> >
>
> >
>
> > I see there is a classad MAX_JOBS_RUNNING, but it seems to be for the
>
> >
>
> > schedd. Can it be used on the startd?
>
> >
>
> >
>
> >
>
> > Any suggestion is more than welcome.
>
> >
>
> > If documented somewhere, a link would be very helpful.
>
> >
>
> >
>
> >
>
> > Cheers,
>
> >
>
> > Jose
>
> >
>
> > _______________________________________________
>
> >
>
> > HTCondor-users mailing list
>
> >
>
> > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>
> >
>
> > subject: Unsubscribe
>
> >
>
> > You can also unsubscribe by visiting
>
> >
>
> > https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> >
>
> >
>
> >
>
> > The archives can be found at:
>
> >
>
> > https://lists.cs.wisc.edu/archive/htcondor-users/
>
> >
>
> >
>
> >
>
> >
>
> >
>
> > _______________________________________________
>
> > HTCondor-users mailing list
>
> > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>
> > subject: Unsubscribe
>
> > You can also unsubscribe by visiting
>
> > https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> >
>
> > The archives can be found at:
>
> > https://lists.cs.wisc.edu/archive/htcondor-users/
>
>
>
> _______________________________________________
>
> HTCondor-users mailing list
>
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>
> subject: Unsubscribe
>
> You can also unsubscribe by visiting
>
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
>
>
> The archives can be found at:
>
> https://lists.cs.wisc.edu/archive/htcondor-users/
>
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/