[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Multiple job queues



On Friday, 27 January, 2012 at 3:33 AM, Raman Sehgal wrote:
Hello all,

I was wondering if it is possible to have multiple job queues on same machine.
So that user can submit job to the queue depending upon requirement.
You can certainly have multiple condor_schedd daemons on a single host. See: http://blog.cyclecomputing.com/2010/06/multiple-condor-schedulers-on-a-single-host.html 

For example
Some user is having long jobs say it runs for 8 hours,
on the other hand some users are having short jobs
that runs for 1 hour only.
   So if possible can i have two job queue namely "one hour" and "10 hour".
So that the user of short job submit it to "one hour" queue and
long job users submit to "10 hour" queue.

If the job execution time exceeds the time allocated to job queue, then the jobs should
either be resubmitted or killed.
This sort of thing is generally unnecessary with Condor. You can set a per-submission rule that can be used to terminate the jobs in the submission if they violate some policy you want to put in place.

If you really wanted to do it per-schedd instance take a look at the SYSTEM_PERIODIC_REMOVE setting: http://research.cs.wisc.edu/condor/manual/v7.6/3_3Configuration.html#18767

You'd set it to remove >1 hour jobs on one the schedd instances to achieve what you're after. So:

SYSTEM_PERIODIC_REMOVE = JobStatus == 2 && (CurrentTime - EnteredCurrentStatus > 60)

Would remove jobs running for longer than one hour.

Regards,
- Ian 


---
Ian Chesal

Cycle Computing, LLC
Leader in Open Compute Solutions for Clouds, Servers, and Desktops
Enterprise Condor Support and Management Tools

http://www.cyclecomputing.com
http://www.cyclecloud.com
http://twitter.com/cyclecomputing