[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Condor Problem with Environment



You are trying to run an executable on a different machine to where it was built.
This will only work if it can get access to all the shared object libraries it needs.

You must therefore choose from the following options:
1. Link statically so there are no further dependencies on dynamic libraries
   (not always possible for 3rd party products), or at least link statically against
   the libraries that are not either "at-hand" to take with job, or already on target machine.
2. Use some sort of shared filestore (NFS for instance) combined with environment variables
   so that these dynamic libraries can be "seen" from executable machine.
3. If the set of libraries will be frequently accessed and infrequently updated - copy them
   across to (at least a subset of) your executable machines so that they are accessible
   by your condor jobs (this may leave a large permanent footprint on condor execute nodes,
   also if you only put it on a few machines, they will need special ClassAds stating that
   these particular libraries are already there).
4. Take all the libraries with you every time - they then need listing in the
   transfer_input_files directive

or some combination of above

Cheers

JK

> -----Original Message-----
> From: condor-users-bounces@xxxxxxxxxxx
> [mailto:condor-users-bounces@xxxxxxxxxxx]On Behalf Of 
> Natarajan, Senthil
> Sent: Friday, May 12, 2006 5:06 PM
> To: Condor-Users Mail List
> Subject: Re: [Condor-users] Condor Problem with Environment
> 
> 
> I tried with environment = LD_LIBRARY_PATH="."   
> It didn't work. I had the values for this in the shell environment
> though.
> 
> There are hundreds of files in different directories, do we 
> need to put
> those in transfer_input_files. Does condor won't copy the 
> current files
> in the shell environment to the execution node? (if you use 
> getenv=true,
> then what exactly getenv does)
> 
> 
> -----Original Message-----
> From: condor-users-bounces@xxxxxxxxxxx
> [mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of o c
> Sent: Friday, May 12, 2006 11:50 AM
> To: Condor-Users Mail List
> Subject: Re: [Condor-users] Condor Problem with Environment
> 
> Have you tried putting something like this in the
> submit files?
> 
> Transfer_Input_Files = mylib1.so,mylib2.so
> environment = LD_LIBRARY_PATH="."
> 
> --- "Natarajan, Senthil" <senthil@xxxxxxxx> wrote:
> 
> > Hi,
> > 
> > I have a C job, it needs some libraries to run. I
> > installed those
> > libraries on the job submitting node (Central
> > manager), so if I run that
> > job on that node just standalone (with out
> > submitting to condor) it is
> > running fine. If I submit the job to condor and I am
> > getting error from
> > the execution node saying that it didn't find the
> > library. 
> > 
> > I did used getenv = true in the job description but
> > it didn't work. It
> > is cumbersome to install the libraries in all the
> > execution node, which
> > I don't have access. In this scenario is it possible
> > to submit the job
> > to condor and make it work, or the only option is
> > install the libraries
> > in the execution node (but that's not possible in my
> > case). Please let
> > me know.
> > 
> > Thanks,
> > 
> > Senthil
> > 
> >  
> > 
> >   
> > 
> > > _______________________________________________
> > Condor-users mailing list
> > Condor-users@xxxxxxxxxxx
> >
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> 
> Send instant messages to your online friends
> http://uk.messenger.yahoo.com 
> _______________________________________________
> Condor-users mailing list
> Condor-users@xxxxxxxxxxx
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> _______________________________________________
> Condor-users mailing list
> Condor-users@xxxxxxxxxxx
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>