Re: [HTCondor-users] build local HTCondor rpm with pip dependencies

[Tim Theisen <tim@xxxxxxxxxxx>]

Hello Benoit,

I have a couple of ideas I'd like to explore today. I'll have my answer for your tomorrow.

...Tim

On 11/3/23 16:05, Benoit Roland wrote:

Dear Tim, dear all,

I have tried to build a python3-flaat rpm.

But there are two packages on which flaat depends, aarc-entitlement and liboidcagent, which do not have rpms either.

Would it be fine, instead of specifying the requirements:

%package credmon-mytoken
Summary: Mytoken credmon for HTCondor
...
Requires: python3-flaat
Requires: python3-cryptography
...

to rather ship flaat with HTCondor directly, including it in a %files section?

Thanks a lot in advance for your answer and help!

Cheers,
Benoit

On 31/10/2023 09:55, Benoit Roland wrote:

Hello Tim,

thanks a lot for your answer.

I started to go in this direction [1] using a few tools I found online, but it seems to me that flaat depends itself
on some other "pip packages" which do not always have their "rpm equivalents".

So I think I will need a bit more time.

Thanks a lot again!

Cheers,
Benoit

[1] https://github.com/benoitroland/C4P-HTCondor/blob/devel/build-flaat-rpm.sh

On 30/10/2023 17:20, Tim Theisen wrote:

Hello Benoit

RPM and pip are two different packaging systems.

It is not recommended to use pip as root. It is more of a user environment tool.

Yum (or dnf) manages dependencies against other RPM packages. So, the most logical thing would be to say the your new RPM depends on the 'python3-flaat' RPM. However, flaat is not packaged with RPM. Perhaps, you'd like to make an RPM for it?

...Tim

On 10/30/23 03:19, Benoit Roland wrote:

Dear all,

with Tim's advice, I have build a local HTCondor rpm corresponding to the PR [1].

I am building the rpm within the CentOS7 container.

I have modified the condor spec file to include the new executables and corresponding configuration.

The rpm building seems to be successful, and I got at the end a collection of rpms [2].

To test the rpm, I wanted to make an installation using "yum localinstall" followed by the list of rpms [2].

At this level, I got some issue with some dependencies installed via pip (flaat and cryptography).

I guess that "yum" can not detect packages installed via pip.

On the other end, some other packages, like the "credmon-oauth" and the "credmon-vault", are also specifying pip-installed dependencies
in the condor spec file. So there should be some way to circumvent this issue.

Thanks a lot in advance for your help!

Cheers,
Benoit

[1] https://github.com/htcondor/htcondor/pull/1857

[2] condor-upgrade-checks-23.2.0-0.202310300137.el7.x86_64.rpm condor-debuginfo-23.2.0-0.202310300137.el7.x86_64.rpm condor-vm-gahp-23.2.0-0.202310300137.el7.x86_64.rpm condor-23.2.0-0.202310300137.el7.x86_64.rpm condor-devel-23.2.0-0.202310300137.el7.x86_64.rpm  minicondor-23.2.0-0.202310300137.el7.x86_64.rpm condor-annex-ec2-23.2.0-0.202310300137.el7.x86_64.rpm condor-kbdd-23.2.0-0.202310300137.el7.x86_64.rpm python2-condor-23.2.0-0.202310300137.el7.x86_64.rpm condor-credmon-mytoken-23.2.0-0.202310300137.el7.x86_64.rpm condor-tarball-23.2.0-0.202310300137.el7.x86_64.rpm python3-condor-23.2.0-0.202310300137.el7.x86_64.rpm condor-test-23.2.0-0.202310300137.el7.x86_64.rpm

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

-- 
Tim Theisen (he, him, his)
Release Manager
HTCondor & Open Science Grid
Center for High Throughput Computing
Department of Computer Sciences
University of Wisconsin - Madison
4261 Computer Sciences and Statistics
1210 W Dayton St
Madison, WI 53706-1685
+1 608 265 5736

-- 
Tim Theisen (he, him, his)
Release Manager
HTCondor & Open Science Grid
Center for High Throughput Computing
Department of Computer Sciences
University of Wisconsin - Madison
4261 Computer Sciences and Statistics
1210 W Dayton St
Madison, WI 53706-1685
+1 608 265 5736