[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Transfer files between jobs in DAG



On Sun, May 12, 2013 at 09:31:02AM +0100, Brian Candler wrote:
> So I think that
> 
>     transfer_input_files = foo/bar
> 
> (without a trailing slash) will do what you want, but I've not tested it
> myself.

Yes, it works. If I create

foo/bar/a1
foo/bar/a2
foo/baz/a3
foo/baz/a4

and then use "transfer_input_files = foo", the whole tree is transferred and
recreated on the target host in the same structure.

$ cat test.sub
Universe = vanilla
Executable = test.sh
Output = test.out
Error = test.err
Log = test.log
Transfer_Input_Files = foo
Should_Transfer_Files = yes

$ cat test.sh
#!/bin/sh
echo "Args:"
for i in "$@"; do
  echo "'$i'"
done
cat $_CONDOR_JOB_AD
pwd
ls -lR

Regards,

Brian.