Re: [HTCondor-users] multicore and multinode run

[Jason Patton <jpatton@xxxxxxxxxxx>]

The scripts themselves are a bit complicated, but unless your job is
very complicated, they should hopefully not be difficult to use. For
example, you would change your submit file from:

universe = parallel
executable = /opt/openmpi/bin/mpirun
arguments = mpihello
log = hellompi.log
output = hellompi.out
error = hellompi.err
machine_count = 2
queue

to

universe = parallel
executable = openmpiscript
arguments = mpihello
log = hellompi.log
output = hellompi.out
error = hellompi.err
machine_count = 2
queue


I'm guessing your condor pool uses a shared filesystem? If not, you
may need to transfer your mpihello program, too:
transfer_input_files = mpihello

You should copy openmpiscript from the examples directory to the
directory that you're submitting the job from. The only change within
openmpiscript would be to point it to your Open MPI install directory,
so set MPDIR=/opt/openmpi
(Alternatively, you can add OPENMPI_INSTALL_PATH=/opt/openmpi to your
execute machines' condor configs, and by default openmpiscript will
read that config)

Jason

On Wed, Jan 24, 2018 at 10:48 AM, Mahmood Naderan <nt_mahmood@xxxxxxxxx> wrote:
> Mine is 8.6.8.
> I looked at the examples/mp1script and examples/mp2script however they look
> complicated!
> Simply I want to give the executable, arguments (my mpi program), some log
> files and cores/nodes.
>
> I appreciate if you send me some other examples.
>
>
> Regards,
> Mahmood
>
>
> On Tuesday, January 23, 2018, 11:11:06 PM GMT+3:30, Jason Patton
> <jpatton@xxxxxxxxxxx> wrote:
>
>
> Unlike slurm or PBS/Torque, HTCondor is not natively supported by Open
> MPI as a launcher, so mpirun needs some help to set up the correct
> environment. If your version of condor is new enough (v8.6+), there's
> a bundled openmpiscript that should work for many cases.
>
> The script should be in your examples directory (just like the
> condor_config.local.dedicated_resource config example). On my machine,
> this is:
> /usr/share/doc/condor-8.7.6/examples/
>
> See
> http://research.cs.wisc.edu/htcondor/manual/current/2_9Parallel_Applications.html
> for instructions on how to use the openmpiscript (MPI Applications
> subheading under the Submission Examples heading).
>
> There was a nice improvement made to openmpiscript (and its helper
> scripts) in v8.7.4 which may also be used with the v8.6.x condor
> versions. Let me know if you're interested in the updated scripts and
> I can get them to you off list.
>
> Jason
>