[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Backfill on an OpenStack system



Hi all,

dropping this here since it's likely to be viable for this use-case.

At KIT (WLCG Tier1 and university Tier3) we developed COBalD/TARDIS [0] to integrate resources into an HTCondor pool from various providers [1]. There's a medium-sized list of backends we support, but most importantly we use OpenStack in production for a while now.

If you have any questions, just let me know â many of us also watch this list, but apparently we're not so fast in responding here...

Cheers,

Matthias

[0]https://cobald-tardis.readthedocs.io/en/latest/
[1]https://www.epj-conferences.org/articles/epjconf/abs/2020/21/epjconf_chep2020_07038/epjconf_chep2020_07038.html

On 05.09.21 11:38, jcaballero.hep@xxxxxxxxx wrote:
Hi Matt,

The cloud team at RAL does what you are looking for. Asking in the TB
Support list may be helpful as well.

Cheers,
Jose



El sÃb, 4 sept 2021 a las 22:58, West, Matthew
(<M.T.West@xxxxxxxxxxxx>) escribiÃ:
Hi Tim,

I will chat with the GridPP folks this week if I can grab someone's attention as they just had their yearly project meeting.

One could just run the HTCondor startd on the bare machines and not fuss with trying to pack things into a VM, but I also wanted to standardize AMAP a setup for workstation pools as well. There are a bunch of systems all over campus that could be wrangled into use and I feel it might be an easier sell than asking for brand-new hardware for HTC.

Cheers,
Matt
________________________________
From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Steven C Timm <timm@xxxxxxxx>
Sent: Saturday, September 4, 2021 8:18 PM
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Backfill on an OpenStack system

CAUTION: This email originated from outside of the organisation. Do not click links or open attachments unless you recognise the sender and know the content is safe.

There are 2 ways it can be done.  One is to install the optional EC2 openstack emulator
and use the aws features of htcondor to launch virtual machines.
The other way is the so called "VAC" system in which there is a daemon running on each cloud
node to self-launch a VM that was developed by GridPP in the UK.. basically the idea that the VM's
launch out of the "vacuum" and join a htcondor pool.  The latter can run on any pool, doesn't necessarily
need openstack.

I am fairly new to running openstack myself so am not sure if they have the equivalent of VM's that
can be pre-empted. but if you have a startd you could use htcondor to condor_off the startd if the
VM is needed back and have the VM then programed to exit.

HTCondor at one point was going to add a feature to talk directly to the OpenStack "Nova" API but
I don't think that it is functional yet,.

Steve Timm

________________________________
From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of West, Matthew <M.T.West@xxxxxxxxxxxx>
Sent: Saturday, September 4, 2021 1:20 PM
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: [HTCondor-users] Backfill on an OpenStack system

Hi All,

Here at Exeter, IT is setting up an OpenStack system to support researchers who want DRAM heavy bespoke workstation-like environments. Because I don't expect the system to be full up with active users 24/7, I am wondering what the optimal way to setup an HTCondor pool on it to run jobs as backfill. Would this be similar to how you would do it for any other spare resources: have a VM start up on a node and announce itself to the collector daemon as an available worker if idle conditions of the machine are met?

It reminds me of the method to expand one's resources into corporate cloud servers but I am not sure what tools are useful in this case.

Cheers,
Matt
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/