[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] condor_submit_dag independent child processes
- Date: Wed, 20 Sep 2017 12:20:11 +0200
- From: Labounek RenÃ <xlabou01@xxxxxxxxxxxxxxxxxx>
- Subject: Re: [HTCondor-users] condor_submit_dag independent child processes
Small correction. I have switched processes mprage_seg and mprage2nii,
because I have not deleted one output file from previous testing run.
The first mprage_seg is executed. After its finishing, mprage2nii
Other words, it is not paralelized optimally, because only 2 threads
are executed in time when 3 independent threads can be executed.
Cituji Labounek RenÃ <xlabou01@xxxxxxxxxxxxxxxxxx>:
Dear HT-condor Users,
I am trying to optimally paralelize our data processing pipeline via
condor and I have found one issue which I am not able to solve...
In my file.dag, I have 6 different processes and following PARRENT
and CHILD edges:
PARENT data_convert CHILD dmri_preproc mprage_bet
PARENT mprage_bet CHILD mprage_seg mprage2mni
PARENT dmri_preproc mprage_seg CHILD mprage2diff
After data_convert, both CHILD precosses (dmri_preproc and
mprage_bet) start. Process dmri_preproc takes much more time than
other processes. Process mprage_bet is finished much earlier. When
mprage_bet is finnished, the process mprage2mni is started first and
mprage_seg is started after mprage2nii is finished and not
imediatelly when mprage_bet is finished.
and i have enough free threads in my pool to be able to compute all
three processes at once.
Does somebody have an idea why it behaves in that way. mprage_seg
and mprage2mni should be independent on themselves.
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
You can also unsubscribe by visiting
The archives can be found at: