[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] MPI Setup



sorry, i forgot to add the link to the short condor-mpi primer I mentioned in my previous email:

http://www.astro.washington.edu/roskar/astronomy/condor-mpi.html

it mostly pertains to the parallel gravity code we use here, but maybe you'll find parts of it useful.


-----------------------------------------
Rok Roskar
University of Washington
Department of Astronomy

On Feb 2, 2006, at 5:26 PM, rnayar@xxxxxxxx wrote:

Thanks for the great tip and help, I was wondering if I was going to need to set up password-less ssh login but it looks like condor takes care of all that using its own version of RSH. So essentially you just need to modify your
global config file with the paramaters as you stated

DedicatedScheduler = "DedicatedScheduler@xxxxxxxxxxxxxxxxxxxxxxxxxxxx"
STARTD_EXPRS = $(STARTD_EXPRS), DedicatedScheduler
MPI_CONDOR_RSH_PATH = /net/condor/sbin

So far my test setup is 2 computers both running FC3 and the headnode's /home is mounted automatically when ever a client accesses its own home. My next task
was to get MPI up and running.

thanks for your help, I'll let you guys know if i run into anything weird.

Danny










Quoting "Junaid N. Sahibzada" <sjunaidn@xxxxxxxxx>:

Hi Rok

  can you tell me if MPICH2 works with condor 6.7?

  also, i am having trouble setting up a ring. i have individual mpds
running on all machines but they dont seem to know about each other.

  also, can you tell me if i need to setup a ring while using condor?

  and why are you saying that i dont need MPI on condor?

  regards

Rok Roskar <roskar@xxxxxxxxxxxxxxxxxxxx> wrote:  I've put together a
condor-MPI tutorial for the particular code that we
use here. It doesn't really involve much about the specifics of the
condor administrative end though... I've set it up here, so that MPI
jobs behave in the same way as single-processor jobs, which means that
they can get preempted, evicted etc. The MPI "cluster" is actually a
set of 18 computer lab desktop machines, linked together with a
high-speed network. This was accomplished very easily by simply
including the following lines:

DedicatedScheduler = "DedicatedScheduler@xxxxxxxxxxxxxxxxxxxxxxxxxxxx"
STARTD_EXPRS = $(STARTD_EXPRS), DedicatedScheduler
MPI_CONDOR_RSH_PATH = /net/condor/sbin

Note that the last line is not specified in the manual, and the first
line has regular quotes, not two single quotes like in the manual. Also
note that I didn't change any policies for these resources, all types
of job universes abide by the same rules.

I then had to recompile my code using mpich - the mpich download page
actually has a condor version.

That was it. I do have passwordless ssh logins configured, but I don't
even think you need that to run mpi in condor.

Rok

-----------------------------------------
Rok Roskar
University of Washington
Department of Astronomy

On Feb 2, 2006, at 3:02 PM, rnayar@xxxxxxxx wrote:

Hello everyone, for those of you who actually got MPI jobs up and
running can
you give us a greater insight as to how you accomplished this? Through
the
installation of MPI, any type of configurations (i.e. passwordless ssh
logins
etc). I've noticed that alot of people seem to be running MPI apps
perhaps we
should throw together some sort of "How to MPI" thread.

thanks

Danny
_______________________________________________
Condor-users mailing list
Condor-users@xxxxxxxxxxx
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

_______________________________________________
Condor-users mailing list
Condor-users@xxxxxxxxxxx
https://lists.cs.wisc.edu/mailman/listinfo/condor-users



Junaid N. Sahibzada
Cell # (+61) 404 998 494
284/9 Crystal St. Waterloo, 2017, NSW, Australia
International Student MSc Internetworking, UTS, Australia
Bachelor of Information Technology, NUST, Pakistan














			
---------------------------------
 Yahoo! Mail - Helps protect you from nasty viruses.


_______________________________________________
Condor-users mailing list
Condor-users@xxxxxxxxxxx
https://lists.cs.wisc.edu/mailman/listinfo/condor-users