Re: [Condor-users] Is DAGMan the answer to my question?

[Hoover Sam <shoover@xxxxxxxxxxx>]

Sounds good, I'll try it with 100 jobs and see how it works.

Thanks,
Sam

On Feb 19, 2009, at 3:37 PM, R. Kent Wenger wrote:

> On Thu, 19 Feb 2009, Hoover Sam wrote:
>
> > I want to run a large batch of jobs, lets say around 10,000 on my  
> > private
> > condor pool, then have a single email notification sent when all  
> > 10,000 jobs
> > are finished. I do not want to get 10,000 emails, one for each job  
> > that
> > completes.
> >
> > The number of jobs changes, I build the condor.submit files on the  
> > fly and
> > submit them all at once after the submit files are built.
> >
> > I could see building a single jobfile.dag file with the 10,000 jobs  
> > as
> > parent, then just one child to send an email notification, but was  
> > hoping for
> > a simpler solution. Perhaps this is the simplest solution, but I'm  
> > new to
> > Condor so I thought I'd ask.
>
> There is a simpler solution -- if you make such a DAG, you'll get a
> notification email (by default) when the DAGMan job itself  
> finishes.  So
> you don't need to add any "extra" job just to get the email.
>
> (Also, in your DAG file, don't specify any parent/child  
> relationships --
> I'm assuming that you want all 10,000 jobs to run in parallel as  
> much as
> possible, and you're just using DAGMan for the email notification.)
>
> Kent Wenger
> Condor Team
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx  
> with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/