Re: [Condor-users] Dag log changes in 8.1?

[Armen Babikyan <armenb@xxxxxxxxxx>]

Hello,

I'd really like to have a DAG progress analysis feature as well - I run 
several experiments (really just multi-level dags) that are several 
hours (and even days) long, and if there's an easy facility to see how 
far I am through one of these experiments (even a rough guess), that 
would be great.

Actually, instead of a count of how many idle/running/held/completed 
jobs there are, if the attribute can contain a list of the job IDs used, 
I can get a more accurate idea of how far along my multi-level dag is 
progress-wise.

Thanks!

 - Armen

Horvátth Szabolcs wrote:
> Hi,
>
> R. Kent Wenger wrote:
> > Hmm -- even in the "old days" the -condorlog file was not the file
> > that DAGMan writes to.  Condorlog was the file that the node jobs
> > write to; now there can be multiple user logs for the node jobs.
> > The log file for the dagman job itself is specified in the submit
> > file:
> >
> >     log = <some file name>
> >  
> I needed the log file that all jobs of the DAG write into. I'm aware
> that jobs can specify multiple
> log files but don't use this feature. In the "old days" it was a
> restriction that we and out scripts
> got used to. :)
>
> > Can you explain in a little more detail what you're trying to do 
> with this?
> >  
> I'm using this file to create a quick DAG progress analysis by parsing
> the file: how many idle/running/held/completed
> jobs are in this specific dag and - since I add the total number of dag
> jobs as a custom attribute - calculate
> the progress as a percentage value. It would be great if all this data
> was available on the dagman job
> as attributes but for now I calculate it for myself using this log file.
>
> Cheers,
> Szabolcs
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at either
> https://lists.cs.wisc.edu/archive/condor-users/
> http://www.opencondor.org/spaces/viewmailarchive.action?key=CONDOR


--
Armen Babikyan
MIT Lincoln Laboratory
armenb@xxxxxxxxxx . 781-981-1796