[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] sep/delim/escape for queue vars in file



I'm trying to do something like this

initialdir=$(dirname)
executable=$(exename)
transfer_input_files=$(infiles)
queue dirname,exename,infiles from /workflows/job_f.txt

where job_f.txt is along the lines of

abc,abc.sh,f1.txt,f2.txt,f3.txt
mmm,mmm.sh,f1.txt,f2.txt
xyz,xyz.sh,f2.txt

Which seems to do what I expect with everything after the 2nd comma being bundled into the infiles variable.

Then I came to transfer_output_files where I need a 2nd list and how to deliniate them properly.  transfer_input_files is comma separated, transfer_output_files is comma separated, the job file is comma separated. 

Is there a way to do this?

e.g. if abc.sh produces about 50 output files and I only want 2 (abc.converg, abc.final), what do I put into the abc line to acheive this? assuming that subsequent lines are different thus needing their own values.

delimiter?
abc,abc.sh,?f1.txt,f2.txt,f3.txt?,?abc.converg,abc.final?

separator? eg space
abc,abc.sh,f1.txt f2.txt f3.txt,abc.converg abc.final

escape?
abc,abc.sh,f1.txt\,f2.txt\,f3.txt,abc.converg\,abc.final

klint.