[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] submitting all jobs with DAGMan



On 04/28/2010 11:13 AM, Ian Chesal wrote:
> On Wed, Apr 28, 2010 at 9:55 AM, R. Kent Wenger <wenger@xxxxxxxxxxx
> <mailto:wenger@xxxxxxxxxxx>> wrote:
> 
>     Another idea along these lines -- I had thought of adding a feature
>     to allow condor_submit_dag to work directly with the submit files
>     (without a DAG file) for the case where you just want to use DAGMan
>     to throttle independent jobs.  Maybe something like this:
> 
>      condor_submit_dag -sub A.sub B.sub C.sub ...
> 
>     Would people find this useful?  (All it would mean is that you
>     wouldn't have to bother to make the degenerate DAG file.)
> 
> 
> I think that would be useful.
> 
> Mag, if you need global throttling for independent jobs of a certain
> type you can look in to resource limits in Condor. I'm trying to find a
> link to documentation about this, but I can't seem to locate it in the
> index of the 7.2 or 7.4 docs. I know Condor now has global counters you
> can use to represent resources (like licenses) that jobs will "claim"
> and decrement if they run. You could use these to throttle concurrency...
> 
> - Ian

http://www.cs.wisc.edu/condor/manual/v7.2/3_13Setting_Up.html#35848
http://www.cs.wisc.edu/condor/manual/v7.4/3_13Setting_Up.html#35598
http://www.cs.wisc.edu/condor/manual/v7.5/3_13Setting_Up.html#36409

The section bounced around.