[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Max. amount of Jobs in queue



On the 6.8 series the limit is more like 15K (and slightly lower on XP
verses a server based install).

Hopefully you're on a seven series so the 150K sounds reasonable.

-----Original Message-----
From: condor-users-bounces@xxxxxxxxxxx
[mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Matthew Farrellee
Sent: 27 May 2009 15:11
To: Condor-Users Mail List
Subject: Re: [Condor-users] Max. amount of Jobs in queue

Max Raith wrote:
> Hey Condor Users,
> 
> Condor is set up in a Pool of 5 Windows Machines(Intel Dual Cores).
> So far it works fine and first test runs were successful. Our goal is 
> to run a simulation and an analysis with 150000 input files. The 
> Submisson took a while, but it worked. So we let the Condorpool do its

> work over the night and its still running. So we have some concerns 
> about the maximuam amout of jobs in the scheduler of the central 
> manager. Are there any known restrictions or limits? As I havent used 
> the requeriement statement in the submit file ,  it seems that the 
> order the jobs are executed happends randomly. Can I influnce this 
> behavoir in any way? I would like to have a first in first out 
> principe.
> 
> Thanks in advance
> 
> Best regards
> 
> Max Raith

Have a look at job priorities...

http://www.cs.wisc.edu/condor/manual/v7.3/2_7Priorities_Preemption.html#
SECTION00371000000000000000

And, man condor_submit (search for "priority = <integer>"

The Schedd has a default limit of *running* 200 jobs at a time, but that
won't effect you until you have >200 slots available. A single Schedd
should not have much problem with 150K submitted jobs. Are there
specific concerns?

Best,


matt
_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at: 
https://lists.cs.wisc.edu/archive/condor-users/

----
Gloucester Research Limited believes the information provided herein is reliable. While every care has been taken to ensure accuracy, the information is furnished to the recipients with no warranty as to the completeness and accuracy of its contents and on condition that any errors or omissions shall not be made the basis for any claim, demand or cause for action.
The information in this email is intended only for the named recipient.  If you are not the intended recipient please notify us immediately and do not copy, distribute or take action based on this e-mail.
All messages sent to and from this email address will be logged by Gloucester Research Ltd and are subject to archival storage, monitoring, review and disclosure.
Gloucester Research Limited, 5th Floor, Whittington House, 19-30 Alfred Place, London WC1E 7EA.
Gloucester Research Limited is a company registered in England and Wales with company number 04267560.
----