[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Process list of files



On 12/5/2014 7:52 PM, Roger Herikstad wrote:
...
for s in $( ls <some file pattern> ); do <some setup>; echo "cd
$PWD;
<some command with arguments> $s" | qsub <sge arguments>; done

I tend to submit these things as dags even if there's no parent-child dependencies in there. Your shell one-liner then becomes 2 files: the job submit file w/ "<some command> $(INFILE)" and the dag submit file w/
job my_1 <submit file>
vars my_1 INFILE="filename"

See condor_submit_dag in TFM.

Dima