Re: [Condor-users] retrieving output subdirectories

["Ian Chesal" <ICHESAL@xxxxxxxxxx>]

> If I put the tarring of subdirectory output files just after
condor_submit in
> a shell script, it will not find them, will it?

Correct. You need to, as part of the command you told Condor to execute,
bundle up the output for return. So if you were telling condor to run
'myapp', now you're going to write a script, lets call it myscript.bash,
that is:

	#!/usr/bin/env bash
	maypp
	tar cvfz myapp.tar.gz `find . -newer time_stamp_file`

and tell Condor to run myscript.bash instead of myapp.

(I have to say I'm not 100% certain that second line will work. Bash
scripting isn't something I do all that often.)

> How must I tar all the output files (including the subdirectories)
just
> after process completion, but just before moving the output files and
> removing the execute directory?

Instead of removing everything from the output directory except the
tarball you can tell Condor what files to return. In this case you'd
tell it to ignore everything except for the stderr, stdout and your
mayapp.tar.gz file. See:

http://www.cs.wisc.edu/condor/manual/v6.8/condor_submit.html

Seach for 'transfer_output_files' on that page to see how you tell
Condor *which* files you want it to return.

- Ian


Confidentiality Notice.  This message may contain information that is confidential or otherwise protected from disclosure.
If you are not the intended recipient, you are hereby notified that any use, disclosure, dissemination, distribution, 
or copying of this message, or any attachments, is strictly prohibited.  If you have received this message in error, 
please advise the sender by reply e-mail, and delete the message and any attachments.  Thank you.