[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Running programs that are already installed on all machines in the pool

On 8/17/07, Mills, Ashley, VF-Group <Ashley.Mills@xxxxxxxxxxxx> wrote:
> Hello,
> I would like to run Executable=bash with different scripts as inputs.
> bash is already installed, as part of cygwin on all of the machines in
> the pool. Thus I want condor to use the bash on each machine and pass
> one of the queued scripts. Is this possible?
> More generally is it possible to tell condor to look for the executable
> on the machine that a queued job is running on, rather than copying the
> executable over to the machine?
> Note that if you use a submit script that specifies bash as the
> executable it will simply complain giving "ERROR: failed to tranfer
> executable file".

We skip the whole complex process with locally installed scripting
environments by having a batch file be our executable.

This then knows how to launch BASH (and can do whatever fancy tricks
are needed to make it wok on different machines). We submit the bash
script as an input file so it is always relative to the scratch
directory where the job runs which makes several assumptions people
often make valid.

The overhead of transferring a 1 KB batch file isn't so bad.

The requirement that the cygwin install is accessible to all users is
also important!