[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] retrieving output subdirectories

Great... Thanks to everybody... I will try it...

On Mon, 2008-02-04 at 11:24 -0500, Ian Chesal wrote:
> > If I put the tarring of subdirectory output files just after
> condor_submit in
> > a shell script, it will not find them, will it?
> Correct. You need to, as part of the command you told Condor to execute,
> bundle up the output for return. So if you were telling condor to run
> 'myapp', now you're going to write a script, lets call it myscript.bash,
> that is:
> 	#!/usr/bin/env bash
> 	maypp
> 	tar cvfz myapp.tar.gz `find . -newer time_stamp_file`
> and tell Condor to run myscript.bash instead of myapp.
> (I have to say I'm not 100% certain that second line will work. Bash
> scripting isn't something I do all that often.)
> > How must I tar all the output files (including the subdirectories)
> just
> > after process completion, but just before moving the output files and
> > removing the execute directory?
> Instead of removing everything from the output directory except the
> tarball you can tell Condor what files to return. In this case you'd
> tell it to ignore everything except for the stderr, stdout and your
> mayapp.tar.gz file. See:
> http://www.cs.wisc.edu/condor/manual/v6.8/condor_submit.html
> Seach for 'transfer_output_files' on that page to see how you tell
> Condor *which* files you want it to return.
> - Ian
> Confidentiality Notice.  This message may contain information that is confidential or otherwise protected from disclosure.
> If you are not the intended recipient, you are hereby notified that any use, disclosure, dissemination, distribution, 
> or copying of this message, or any attachments, is strictly prohibited.  If you have received this message in error, 
> please advise the sender by reply e-mail, and delete the message and any attachments.  Thank you.
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> The archives can be found at: 
> https://lists.cs.wisc.edu/archive/condor-users/