[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] retrieving output subdirectories



Hi,

This has been a very interesting thread but assumes Linux execute
computers. Has anyone done similar work in the Windows space?

Regards
Robin

-----Original Message-----
From: condor-users-bounces@xxxxxxxxxxx
[mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Javier Forment
Sent: Tuesday, 5 February 2008 6:05 a.m.
To: Condor-Users Mail List
Subject: Re: [Condor-users] retrieving output subdirectories

Great... Thanks to everybody... I will try it...


On Mon, 2008-02-04 at 11:24 -0500, Ian Chesal wrote:
> > If I put the tarring of subdirectory output files just after
> condor_submit in
> > a shell script, it will not find them, will it?
> 
> Correct. You need to, as part of the command you told Condor to
execute,
> bundle up the output for return. So if you were telling condor to run
> 'myapp', now you're going to write a script, lets call it
myscript.bash,
> that is:
> 
> 	#!/usr/bin/env bash
> 	maypp
> 	tar cvfz myapp.tar.gz `find . -newer time_stamp_file`
> 
> and tell Condor to run myscript.bash instead of myapp.
> 
> (I have to say I'm not 100% certain that second line will work. Bash
> scripting isn't something I do all that often.)
> 
> > How must I tar all the output files (including the subdirectories)
> just
> > after process completion, but just before moving the output files
and
> > removing the execute directory?
> 
> Instead of removing everything from the output directory except the
> tarball you can tell Condor what files to return. In this case you'd
> tell it to ignore everything except for the stderr, stdout and your
> mayapp.tar.gz file. See:
> 
> http://www.cs.wisc.edu/condor/manual/v6.8/condor_submit.html
> 
> Seach for 'transfer_output_files' on that page to see how you tell
> Condor *which* files you want it to return.
> 
> - Ian
> 
> 
> Confidentiality Notice.  This message may contain information that is
confidential or otherwise protected from disclosure.
> If you are not the intended recipient, you are hereby notified that
any use, disclosure, dissemination, distribution, 
> or copying of this message, or any attachments, is strictly
prohibited.  If you have received this message in error, 
> please advise the sender by reply e-mail, and delete the message and
any attachments.  Thank you.
> 
> 
> 
> 
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx
with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> The archives can be found at: 
> https://lists.cs.wisc.edu/archive/condor-users/

_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at: 
https://lists.cs.wisc.edu/archive/condor-users/