[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Max Number of Jobs Submission



Natarajan, Senthil wrote:
Hi,
Thanks for the info.
Here Central manager is the only dedicated submit node. And also runs
job.

Suppose if I configure
MAX_JOBS_RUNNING        = 500

It means maximum of 500 jobs can run at any time, but more than 500 jobs
say 2000 jobs can submit to the pool using condor_submit right?

That is correct. You can have 500 jobs running and 50000 in the queue waiting.


Job varies from running less than a minute to 30 minutes and with the
data files around 1 mb.

Is there any way to specify maximum jobs submission at the user level,
for example each user can submit max of 100 jobs?

You can do something like that by defining each user as a group and implementing group quotas, as described here:

http://www.cs.wisc.edu/condor/manual/v6.8/3_4User_Priorities.html#SECTION00447000000000000000


... but the normal behavior of Condor is to try to share machines fairly. As a user uses more resources, his/her priority worsens, and jobs from other users can preempt his/hers. This default behavior is described here:

http://www.cs.wisc.edu/condor/manual/v6.8/3_4User_Priorities.html



Thanks,
Senthil




-----Original Message-----
From: condor-users-bounces@xxxxxxxxxxx
[mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of David A. Kotz
Sent: Thursday, March 22, 2007 12:10 PM
To: Condor-Users Mail List
Subject: Re: [Condor-users] Max Number of Jobs Submission

Without knowing exactly what your jobs are doing, it's hard to tell you exactly, but that central manager, even if it is also the submit node, should be able to handle more jobs than your cluster can run. I allow each of my desktops (I don't have a single submit node) to run 150 jobs,

and I have some dedicated submit nodes with limits of 200 and 500.

The condor_config line below controls the number of running jobs from a single submit node:


##  What's the maximum number of jobs you want a single submit machine
##  to spawn shadows for?
MAX_JOBS_RUNNING        = 150



Natarajan, Senthil wrote:
Hi,

What is the maximum number of jobs can be submitted at any given time,

(i.e) what is the max number of jobs can be queued ?

How to calculate this?

Our Condor pool (condor 6.8.4) central manager is running on RHEL 4.0.

It is a Double dual core Xeon processor (total 8 CPU) of 2.8 GHz and 8

GB Memory.

And pool has around 150 nodes.

Is there any way to set the limit for the max jobs, in order to avoid the crash?

Thanks,

Senthil

.



------------------------------------------------------------------------
_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx
with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at either
https://lists.cs.wisc.edu/archive/condor-users/
http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR

_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at either
https://lists.cs.wisc.edu/archive/condor-users/
http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR

_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at either
https://lists.cs.wisc.edu/archive/condor-users/
http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR