[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] retrieving output subdirectories
- Date: Mon, 04 Feb 2008 18:04:33 +0100
- From: Javier Forment <jforment@xxxxxxxxxxxx>
- Subject: Re: [Condor-users] retrieving output subdirectories
Great... Thanks to everybody... I will try it...
On Mon, 2008-02-04 at 11:24 -0500, Ian Chesal wrote:
> > If I put the tarring of subdirectory output files just after
> condor_submit in
> > a shell script, it will not find them, will it?
> Correct. You need to, as part of the command you told Condor to execute,
> bundle up the output for return. So if you were telling condor to run
> 'myapp', now you're going to write a script, lets call it myscript.bash,
> that is:
> #!/usr/bin/env bash
> tar cvfz myapp.tar.gz `find . -newer time_stamp_file`
> and tell Condor to run myscript.bash instead of myapp.
> (I have to say I'm not 100% certain that second line will work. Bash
> scripting isn't something I do all that often.)
> > How must I tar all the output files (including the subdirectories)
> > after process completion, but just before moving the output files and
> > removing the execute directory?
> Instead of removing everything from the output directory except the
> tarball you can tell Condor what files to return. In this case you'd
> tell it to ignore everything except for the stderr, stdout and your
> mayapp.tar.gz file. See:
> Seach for 'transfer_output_files' on that page to see how you tell
> Condor *which* files you want it to return.
> - Ian
> Confidentiality Notice. This message may contain information that is confidential or otherwise protected from disclosure.
> If you are not the intended recipient, you are hereby notified that any use, disclosure, dissemination, distribution,
> or copying of this message, or any attachments, is strictly prohibited. If you have received this message in error,
> please advise the sender by reply e-mail, and delete the message and any attachments. Thank you.
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> The archives can be found at: