Re: [Condor-users] Condor deployment on multiple distributed resources

[Derek Weitzel <dweitzel@xxxxxxxxxxx>]

Hi Sergio,

There has been recent developments to help with your use case.  Specifically to not run anything on the remote cluster, and to control everything from the client side.  This is the BLAHP over SSH work: https://condor-wiki.cs.wisc.edu/index.cgi/tktview?tn=2421

This BLAHP over SSH allows you to submit jobs through the SSH interface to a cluster.  No middleware needed on the remote clusters.

Additionally, we have built software on top of the BLAHP over SSH to create a condor overlay on the different resources, called BOSCO (BLAHP over SSH Condor Overlay).  But this is Beta, at best.

If you're interested in trying this software, drop me a line.

If all you have is a hammer...
Derek Weitzel
Graduate Research Assistant
University of Nebraska Holland Computing Center

On Jun 5, 2012, at 6:15 AM, sergio.maffioletti@xxxxxxxxxx wrote:

> Hi
> 
> probably this subject has been already discussed previously, but being new to the mailing list, I take the liberty of asking again
> 
> we're getting 'cold feet' on the grid technologies and we'd like to explore alternative possibilities for accessing distributed resources
> in a manner that allow us to reduce the operational overhead footprint at the individual sites and, at the same time, that would give us also access to private/public cloud infrastructures as a mean to expand the resource portfolio
> 
> in this context, we'd like to understand whether and how condor could be used as a central component to achieve this level of integration/aggregation
> 
> more specifically:
> - how condor could/should be deployed in order to aggregate various distributed computing clusters each of them controlled by a different incarnation of a batch system (SGE, LSF, PBS, Slurm)
> - what components needs to be deployed ? (please do not tell me we need to deploy globus on each site... :)
> - is it possible to avoid deploy anything at the individual site level ?
> - what would be the authentication mechanism in this case ?
> - how private/public cloud resources could be integrated ?
> - how the whole thing would be used from the client side ?
> 
> the usage idea would be to develop application-specific tools on top of such infrastructure, thus it it also very important to minimise the number of component deployed (if possible)
> 
> thanks for any hint
> 
> Cheers
> Sergio :)
> 
> sergio.maffioletti@xxxxxxxxxx
> GC3: Grid Computing Competence Center
> http://www.gc3.uzh.ch/
> University of Zurich
> Winterthurerstrasse 190
> CH-8057 Zurich Switzerland
> Tel: +41 44 635 4222
> Fax: +41 44 635 6888
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/