[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] PyDagman - a convenience library for writing DAGs

 I'm writing to announce a Python package I've written to simplify the programmatic creation of DAG files in Python.  The package is called PyDagman, and is available on github at https://github.com/brandentimm/pydagman

This is neat (and simple), thank you.

I also wrote a library with a similar aim:

However it's a lot more complex, because what I wanted was for each DAG node to be a python function invocation. So it pickles the arguments to each deferred function call, stores them in an input file, and each node job calls the appropriate function with the appropriate args.

The code is not as clean as it could be - especially if you want to write out multiple DAGs.