Hello,
My name is Dmitry and our company is currently looking at different solutions for our cluster. We are using Torque at the moment and not very unhappy with it.
HTCondor seems very attractive specifically because of DAG functionality that we would utilize a lot.
But the workflows that we have may require dynamic DAGs meaning that the graph may change it's structure during runtime and there is no way for us to know it before we start.
For example node A generates number of files which is unknown before we start. After the job is done we process these files in parallel and the number of jobs should be equal to the number of files - each job processing one file. Then after this n jobs are done the DAG may continue and have other jobs to run.
![[Computer Systems Lab]](https://www-auth.cs.wisc.edu/pics/csl_logo.gif){kind=logo}