[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] Problems submitting jobs from windows to Linux and vice versa
- Date: Thu, 15 May 2008 11:35:22 -0500
- From: Todd Tannenbaum <tannenba@xxxxxxxxxxx>
- Subject: Re: [Condor-users] Problems submitting jobs from windows to Linux and vice versa
Alex Alas wrote:
We can submit jobs from both platforms, but jobs run local and are
not submitted to the condor pool for processing. Condor_status shows
processors being matched and claimed but the confirmation e-mails
show that is only running on the computer were the jobs are
We want to deploy condor jobs across multiple platforms, but the file
system structure will be different. i.e. Condor installed in
Is there a path variable you can add to the description file or
config file to take into account different directory structures?
Not sure I understand your specific issue, so I'll just type for a bit
and discuss some solutions. If I stumble across your problem and answer
it, great, if not, please ask more specifically (with an example). :).
So it doesn't matter so much where the Condor binaries are installed.
What matters is if there is a shared file system between the nodes in
your pool or not.
If you DO have a shared file system, and you want Condor to use it, then
all machines should be configured with the same FILESYSTEM_DOMAIN
setting, e.g. in condor_config put
FILESYSTEM_DOMAIN = earthdata.com.
You could enter a command like
condor_status -format "%s\t" Name -format "%s\n" FileSystemDomain
to see all the machines in your pool and what they are reporting as
their file system domain. If you submit a job telling Condor you want a
shared file system, the Condor will only run your job on a machine where
the submit file system domain == the execute file system domain. This
may explain why your jobs only run on the submission machine.
Now, lets say that your Windows machines are all on a shared network
filesystem, and all your Linux machines also share a _different_ network
filesystem. For instance, all your Win32 boxes mount network drives off
some NT server, and all your Linux boxes mount some NFS servers. In
this case, you'd want to put into condor_config on your Win32 boxes
FILESYSTEM_DOMAIN = windows.earthdata.com
and your linux boxes have in condor_config:
FILESYSTEM_DOMAIN = linux.earthdata.com
You can specify a FileSystemDomain in the Requirements section of your
submit description file.
If you DON'T have a shared filesystem, you can ask Condor to move the
files are for you. The uninspired name for this in Condor-lingo is
"Condor's File Transfer Mechanism".
For more info and examples, see sections 2.5.3 and 2.5.4 of the Condor
Manual - a URL is
Or perhaps you want the job to have a different initial working
directory based upon where it lands? Or ?