[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: [condor-users] Big pool one central manager?



We have 930 condor machines hooked up to one single manager/submit node.
We hope to scale up to harness the remaining 2000 machines, and we'll
see how it works using our current set up.

The pool's done over 105,000 hours work in the last 5 months.
The single queue has, on several occasions, contained 5000 jobs. 

We have an 'easy' network and deployment environment- all the computers
are centrally managed- the single point of access and submission works
for us.

There are new installations in the UK which will be larger than ours
with much more complex political and ownership issues. They will be
solving the problem using mulitple smaller pools and flocking.

Paul.



-----Original Message-----
From: owner-condor-users@xxxxxxxxxxx
[mailto:owner-condor-users@xxxxxxxxxxx] On Behalf Of Nick LeRoy
Sent: 23 March 2004 14:33
To: condor-users@xxxxxxxxxxx
Subject: Re: [condor-users] Big pool one central manager?

On Tuesday 23 March 2004 9:27 am, Antti Eskola wrote:
> Dear condor users
>
> I was wondering if there are any guidelines ot experiences with big
> condor pools?
> Lets assume i am building a condor pool which includes 500
workstations
> - is it better to make 5 different pools of 100 workstations that
flock
> to each other
> - or can i just make one pool which includes 500 workstations?
> 	could there be any problems with the central manager
> 	if there are so many workstations in the pool?
>
> please guide me to a web page with information about this or reply me
> about your experiences with "big" pools

There are at least several pools in existence that are large than this
with a 
single central manager.  In fact, one of them is here at UW CS.  At the 
current moment, our pool has 930 VMs reporting to it.  There are larger
pools 
in the wild.

For large pools such as this, the central manager is typically not the 
bottleneck.

-Nick

-- 
           <<< The matrix has you. >>>
 /`-_    Nicholas R. LeRoy               The Condor Project
{     }/ http://www.cs.wisc.edu/~nleroy  http://www.cs.wisc.edu/condor
 \    /  nleroy@xxxxxxxxxxx              The University of Wisconsin
 |_*_|   608-265-5761                    Department of Computer Sciences
Condor Support Information:
http://www.cs.wisc.edu/condor/condor-support/
To Unsubscribe, send mail to majordomo@xxxxxxxxxxx with
unsubscribe condor-users <your_email_address>


Condor Support Information:
http://www.cs.wisc.edu/condor/condor-support/
To Unsubscribe, send mail to majordomo@xxxxxxxxxxx with
unsubscribe condor-users <your_email_address>