[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] submitting all jobs with DAGMan



On Wed, Apr 28, 2010 at 9:55 AM, R. Kent Wenger <wenger@xxxxxxxxxxx> wrote:
Another idea along these lines -- I had thought of adding a feature to allow condor_submit_dag to work directly with the submit files (without a DAG file) for the case where you just want to use DAGMan to throttle independent jobs.  Maybe something like this:

 condor_submit_dag -sub A.sub B.sub C.sub ...

Would people find this useful?  (All it would mean is that you wouldn't have to bother to make the degenerate DAG file.)

I think that would be useful.

Mag, if you need global throttling for independent jobs of a certain type you can look in to resource limits in Condor. I'm trying to find a link to documentation about this, but I can't seem to locate it in the index of the 7.2 or 7.4 docs. I know Condor now has global counters you can use to represent resources (like licenses) that jobs will "claim" and decrement if they run. You could use these to throttle concurrency...

- Ian