[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Submission of large numbers of jobs

On Wed, Jul 11, 2012 at 08:18:03AM +0000, Ian Cottam wrote:
>  a colleague here tried multiple scheds and there are some complications.
> (I can send you his email if you like.)
> In the end we (so far) just have one a big machine for submitting and a
> smaller one for matchmaking. Many of our users submit tens of thousands of
> jobs at the same time, and occasionally 100,000.

That's great, we'll keep it simple then.

> I guess the other thing is how may slots/cores you have as that is the
> maximum number of shadow processes that will run. We only have around 2000
> so that too works out ok.

We have 7 boxes with 48 cores / 96GB each, so much smaller than your setup.