[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] Submission of large numbers of jobs
- Date: Wed, 11 Jul 2012 09:52:44 +0100
- From: Brian Candler <B.Candler@xxxxxxxxx>
- Subject: Re: [Condor-users] Submission of large numbers of jobs
On Wed, Jul 11, 2012 at 08:18:03AM +0000, Ian Cottam wrote:
> a colleague here tried multiple scheds and there are some complications.
> (I can send you his email if you like.)
> In the end we (so far) just have one a big machine for submitting and a
> smaller one for matchmaking. Many of our users submit tens of thousands of
> jobs at the same time, and occasionally 100,000.
That's great, we'll keep it simple then.
> I guess the other thing is how may slots/cores you have as that is the
> maximum number of shadow processes that will run. We only have around 2000
> so that too works out ok.
We have 7 boxes with 48 cores / 96GB each, so much smaller than your setup.