Re: [Condor-users] Absolute beginner using Condor with C# seeks mentor

["Matt Hope" <matthew.hope@xxxxxxxxx>]

On Sun, Mar 9, 2008 at 9:05 PM,  <hughchristensen@xxxxxxxxxxx> wrote:
>
>
>
>
> Can anyone advise a new user on setting up a very basic distributed grid to
> process jobs which are created in C# (visual studio 2008, NET 3.5 on windows
> XP/Vista)?
>
>
>
> I am wanting to link together 3-4 old Dell machines in a local network (to
> act as the executing machines), then use Condor to allow me to use these to
> process a large number of separate (statistical) calculations (each one
> taking c. 30 seconds on a 2GHz Pentium 4), which have been generated on my
> desktop (the submit machine).  I am under the impression that all the
> messages from submit will have to go via another machine (central manager/
> checkpoint server).
>

I'm afraid an out the box condor install is not the right tool for
this job principally due to

> each one taking c. 30 seconds

The overheads from scheduling/negotiation/transfer would almost
certainly at least halve your throughput. You could tweak things and
use third party add ins to mitigate it but you may as well just start
with a more appropriate tool. Perhaps something like MapReduce might
work for you, I believe a .Net implementation exists via apache?

Matt