[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] HTCondor and COVID-19



Hi Thomas,

A long, long time ago in a galaxy far away, we did the same thing for Einstein@Home.  It wasn't as pleasant as it predated containers and we had to mangle the environment ourselves...

I recall a lot of the difficulty was in saving the client's state / cached files and making it so it could restart from where it left off when it got preempted.  Then, HTCondor could simply reschedule the same job over-and-over.

How do you approach maintaining state in your batch job example?

Brian

> On Mar 27, 2020, at 11:55 AM, Thomas Hartmann <thomas.hartmann@xxxxxxx> wrote:
> 
> Hi all,
> 
> we have been playing a bit wrapping the BOINC client into a Singularity container:
>  https://confluence.desy.de/display/grid/BOINC+user+computing
> A script creates hopefully reasonable configurations for desktop or batch job use cases and starts the BOINC client pulling Rosetta@home payloads.
> 
> A lot of things are hard coded, ugly and very alpha, so your millage may vary and there might be dragons...
> 
> Cheers,
>  Thomas
> 
> On 27/03/2020 04.11, Craig Parker wrote:
>> Hi all,
>> Just an idle shower thought here after thinking about the folding@home success with picking up extra CPU cycles around the world for COVID-19 research.  Is there any way to utilise or donate our Condor grids for this kind of public benefit?
>> Hope everyone is well and staying safe :)
>> Cheers, Craig
>> _______________________________________________
>> HTCondor-users mailing list
>> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/htcondor-users/
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/