Re: [HTCondor-users] HTCondor Cluster within Slurm Job

[Thomas Hartmann <thomas.hartmann@xxxxxxx>]

maybe a different scale but CMS is running their global HTCondor pool 
ontop the various LRMSes in the Grid (probably not well suited to 
isolated HPCs,  I guess)
https://iopscience.iop.org/article/10.1088/1742-6596/898/5/052031

On 29/09/2021 22.21, Michael Pelletier via HTCondor-users wrote:
> Iâm interested in this idea as well - the bulk of the HPC in the 
> combined companies is now Slurm, and thatâs intended to be the supported 
> standard (alas), so having a bridge capability would be useful.
>
> It seems like itâd be some sort of variant of HTCondor-CE with âpilotâ 
> jobs.
>
> *Michael V Pelletier*_
>
> Principal Engineer
> *
> **Raytheon Technologies*
>
> Digital Technology
>
> HPC Support Team
>
> ____
>
> *From:* HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> *On Behalf 
> Of *Leslie Hart - NOAA Federal via HTCondor-users
> *Sent:* Wednesday, September 29, 2021 3:49 PM
> *To:* htcondor-users@xxxxxxxxxxx
> *Cc:* Leslie Hart - NOAA Federal <leslie.b.hart@xxxxxxxx>
> *Subject:* [External] [HTCondor-users] HTCondor Cluster within Slurm Job
>
> Hi,
>
> Is it possible (and is there an existing recipe) to start up a "private" 
> HTCondor Cluster within a Slurm job. We have users who would like to 
> allocate a number of nodes and then use those nodes as an HT cluster for 
> the duration of the job. Ideally, we could supply a few commands that 
> they would use at the beginning and end of their Slurm batch job to 
> start and shutdownÂthe cluster (the middle would be comprised of a 
> series of HTCondor jobs, of course. e.g. HTCondorStart (would figure out 
> the nodes that Slurm has allocated and create the cluster). HTCondorWait 
> (would wait until all HTCondor jobs completer) and HTCondorFinish (would 
> gracefully shut down HTCondor).
>
>
> Thanks,
>
> Leslie Hart
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature