Re: [HTCondor-users] scheduler universe and dagman

["Nathan W. Panike" <nathan.panike@xxxxxxxxx>]

You can just do condor_submit_dag 1.dag 2.dag 3.dag ...

to run a bunch of DAGs under the single DAGMan process.

Running 60 different DAGMan jobs presents a problem as the DAGMan
processes do not (inter)communicate, so trying to set settings that
optimize throughput while minimizing load on the schedd is difficult
to manually tune.

Another option is to write a "master" dag and include all the DAG
files with SPLICE commands.

See the manual at

http://research.cs.wisc.edu/htcondor/manual/v8.1/2_10DAGMan_Applications.html


On Tue, Apr 8, 2014 at 8:06 AM, Keith Brown <keith6014@xxxxxxxxx> wrote:
> I have a set of 60 different DAGs (condor_dagman) and it seems its hitting
> the scheduler heavily. Unfortunately, I can't consolidate it into one dag
> since that will take considerable amount of time.
>
> is there dagman option to not schedule jobs so aggressively?  or poll the
> scheduler every few seconds?
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/



-- 
Nathan Panike