[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] submitting all jobs with DAGMan

On 04/28/2010 11:13 AM, Ian Chesal wrote:
> On Wed, Apr 28, 2010 at 9:55 AM, R. Kent Wenger <wenger@xxxxxxxxxxx
> <mailto:wenger@xxxxxxxxxxx>> wrote:
>     Another idea along these lines -- I had thought of adding a feature
>     to allow condor_submit_dag to work directly with the submit files
>     (without a DAG file) for the case where you just want to use DAGMan
>     to throttle independent jobs.  Maybe something like this:
>      condor_submit_dag -sub A.sub B.sub C.sub ...
>     Would people find this useful?  (All it would mean is that you
>     wouldn't have to bother to make the degenerate DAG file.)
> I think that would be useful.
> Mag, if you need global throttling for independent jobs of a certain
> type you can look in to resource limits in Condor. I'm trying to find a
> link to documentation about this, but I can't seem to locate it in the
> index of the 7.2 or 7.4 docs. I know Condor now has global counters you
> can use to represent resources (like licenses) that jobs will "claim"
> and decrement if they run. You could use these to throttle concurrency...
> - Ian


The section bounced around.