Re: [Condor-users] Output files not being returned upon completion.

["Sanjay Vivek" <smv99r@xxxxxxxxxxxxxxx>]

Hi all,

Unfortunately, I'm still
stuck with the same problem but I think I've narrowed it down somewhat. What
I tried out was copying the contents of the temporary file in Condor at
condor/execute/dir_xxxx  to a separate directory and running it from there.
And it worked just fine. Basically, I just ran the
"C:\WINNT\system32\cmd.exe /Q /C condor_exec.bat finalus1.ief" whereby
finalus1.ief is the argument file. So this means that the executable runs
fine when it's run on it's own but Condor doesn't seem to execute it though.
Is this something to do with the permissions set by Condor? I've checked all
the files and the permissions are set for everyone. As far as I can tell,
Condor actually runs the executable but it doesn't execute it. I'm not
entirely sure why though cos all the files which are required to run the
executable are copied over to the temporary directory and it should just
run. And it does run when I copy the contents over to a separate directory.
I'm guessing it's something to do with the permissions given to or by
Condor. Can you think of anything else I should be doing? BTW, I'm running
everything on my own machine via Personal Condor.I'm running everything on a
Windows 2000 machine. I've also attached the StarteLog file too. My updated
submit file is shown below but there's not much change really.
 Thanks again!

executable                 = test_isis.bat
universe                     = vanilla
arguments                  = finalus1.ief
transfer_files              = always
transfer_input_files     = isis.set,GLUE1.dat
output                        = test.out
getenv                        = true
error                          = test.error
log                             = test.log
queue

----- Original Message ----- 
From: "Jaime Frey" <jfrey@xxxxxxxxxxx>
To: "Condor-Users Mail List" <condor-users@xxxxxxxxxxx>
Sent: Monday, March 21, 2005 10:06 PM
Subject: Re: [Condor-users] Output files not being returned upon completion.


> On Mon, 21 Mar 2005, Sanjay Vivek wrote:
>
> > I'm currently working on Condor 6.7 and it isn't transferring output
> > files upon job completion. The job seems to be running and executing
> > fine but it doesn't return the output files. The executable should
> > return a bunch of output files in the same path. I'm not too sure what's
> > going wrong but hopefully someone out there can point me in the right
> > direction. My submit file is desribed below. Thanks again!
> >
> > executable                     = test_isis.cmd
> > universe                        = vanilla
> > arguments                     = finalus1.ief
> > input                             = finalus1.ief
> > should_transfer_files       = YES
> > when_to_transfer_output = ON_EXIT
> > output                           = test.out
> > error                            = test.error
> > log                               = test.log
> > queue
>
> Is your program creating file with simple filenames or with filenames that
> contain paths? Condor creates a directory to run your job in and only
> transfers back files created in that directory (not even files in
> subdirectories).
>
> Try submitting a shell script like the following with the same file
> transfer options:
>
> #!/bin/sh
> /bin/date > data1
> /bin/pwd  > data2
>
> If data1 and data2 don't show up, then we know it's not something specific
> to your application.
>
> Is the condor execute directory on the execute machine on a shared
> filesystem? (Log into the execute machine and run 'condor_config_val
> execute') This can cause problems if there's any clock skew between the
> execute machine and the file server.
>
> You can also try explicitly stating what output files to transfer back
> using transfer_output_files in your submit file.
>
> +----------------------------------+---------------------------------+
> |            Jaime Frey            |  Public Split on Whether        |
> |        jfrey@xxxxxxxxxxx         |  Bush Is a Divider              |
> |  http://www.cs.wisc.edu/~jfrey/  |         -- CNN Scrolling Banner |
> +----------------------------------+---------------------------------+
> _______________________________________________
> Condor-users mailing list
> Condor-users@xxxxxxxxxxx
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users


4/1 12:22:00 ******************************************************
4/1 12:22:00 Using config file: C:\Condor\condor_config
4/1 12:22:00 Using local config files: C:\Condor/condor_config.local
4/1 12:22:00 DaemonCore: Command Socket at <152.78.65.117:3153>
4/1 12:22:00 Setting resource limits not implemented!
4/1 12:22:02 Communicating with shadow <152.78.65.117:3146>
4/1 12:22:02 Submitting machine is "pockets.ecs.soton.ac.uk"
4/1 12:22:03 File transfer completed successfully.
4/1 12:22:04 Starting a VANILLA universe job with ID: 111.0
4/1 12:22:04 IWD: C:\Condor/execute\dir_468
4/1 12:22:04 Output file: C:\Condor/execute\dir_468\test.out
4/1 12:22:04 Error file: C:\Condor/execute\dir_468\test.error
4/1 12:22:04 Renice expr "10" evaluated to 10
4/1 12:22:04 About to exec C:\WINNT\system32\cmd.exe /Q /C condor_exec.bat finalus1.ief
4/1 12:22:04 Create_Process succeeded, pid=3712
4/1 12:26:33 Got SIGQUIT.  Performing fast shutdown.
4/1 12:26:33 ShutdownFast all jobs.
4/1 12:26:39 Process exited, pid=3712, status=0
4/1 12:26:44 Last process exited, now Starter is exiting
4/1 12:26:44 **** condor_starter (condor_STARTER) EXITING WITH STATUS 0