[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] K8s usage in the HTCondor community



Good Friday afternoon,

Because I like introducing CNCF folks to this community, Adam McArthur is an employee in G-Research's OSS team <https://opensource.gresearch.com/>. He is trying to understand how projects using HTCondor, amongst other traditional batch schedulers, leverage Kubernetes to deploy containers/pods for either compute hosts or services.

Of particular interest is whether k8s is still being used it it's traditional stateless manner and if not, why?

From my interactions with folks in the CNCF Batch (compute) Working Group, there seems to be some friction between how cloudy folks envision "scheduling" and what we view it as. Each side seems skeptical of the other's design philosophy and there is a bit of cross talk going on.

IIRC, the Path Facilities use Kubernetes to manage/deploy their local compute resources, correct? If anyone else uses k8s for container deployment of HTCondor daemons or for other production services, we'd love to hear more about it.

Cheers,
Matt

P.S. - Any faults in the descriptions of either k8s or htcondor deployments are purely my own.

--
Matthew T. West
DevOps & HPC SysAdmin
University of Exeter, Research IT
www.exeter.ac.uk/research/researchcomputing/support/researchit
57 Laver Building, North Park Road, Exeter, EX4 4QE, United Kingdom