Yes, this is essentially correct.
The python bindings must be version matched to the HTCondor libraries, especially libcondor_utils_X_Y_Z.so and libclassad.so.X.Y.Z
If you ship the versions of these libraries that you build, then the bindings will work just fine even if they donât match the version of the HTCondor you are trying to talk
to. If you donât intend to ship these files then you will need to exactly match the installed HTCondor version.
You cannot compile just the python bindings or even just the tools â although you can get away with turning off many of the optional features. Have a look at the minimal_build_configure_args
near the top of /nmi_tools/glue/SubmitInfo.pm. These are arguments you can pass to ./configure_uw to turn off parts of the build.
-tj
From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx]
On Behalf Of L Kreczko
Sent: Thursday, December 8, 2016 7:30 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] virtualenv, pip and htcondor (python)
Hi all,
Since my work on an HTCondor task implementation for Spotify's Luigi [1], this topic is again becoming of interest.
In order to do 'pip install htcondor', htcondor would need a setup.py that compiles the HTCondor Python bindings and distributes the libraries htcondor.so and classad.so the same way the condor-python RPM does.
As I understand from the instructions [2] all I need to call in the setup.py is
1) match code to the installed condor version
4) point python to the two libraries it needs to install.
Is this a safe way? Is it possible to compile just the python bindings (I am asking because I cannot build condor on 16.04 [3])?
Do htcondor.so and classad.so need to be compiled in the same version as the condor install or does some wiggle-room exist?
On 10 July 2015 at 15:27, L Kreczko <L.Kreczko@xxxxxxxxxxxxx> wrote:
Hi Tom, hi Brian,
Thanks a lot for your answers. Good to see that I am not the only one trying this :).
As for Tom's solution: that looks neat. The only problem is that the auto-completion possibly won't work in the IDE. Have to try it out.
@Brian: Yes, I was thinking of that, but after the first attempt to compile failed, I did not want to spend more time it for now. Maybe later.
I am also experimenting with conda (http://conda.pydata.org/docs/) for environment setup, but this is something further down the line after the first rush of analyses this year.
If I manage to come up with something that will work on, say,
travis-ci.org, I will let you know.
I am currently trying to use the htcondor python bindings in our code, but I could not find a good way to make this possible.
The experiment framework sets up a separate python version (2.7) that is newer than the OS default. On top of that our code uses virtualenv (https://github.com/pypa/virtualenv)
that allows you to create an isolated python environment.
While the htcondor python bindings are available for the OS python (2.6) they are not for anything above.
So, is it possible to setup htcondor via pip or similar?
A possible solution is to symlink the OS libraries to the virtualenv installation, but there must be a better way than this:
ln -s /usr/lib64/python2.6/site-packages/htcondor.so external/vpython/lib/python2.7/site-packages/htcondor.so
ln -s /usr/lib64/python2.6/site-packages/classad.so external/vpython/lib/python2.7/site-packages/classad.so
You can always recompile HTCondor and point it to an alternate python install. Thatâs what I do when I need to use a non-OS python.
However, Iâm stumped on how it could be converted to something I can upload into PyPI. Suggestions?
Brian
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to
htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/
|
![[Computer Systems Lab]](https://www-auth.cs.wisc.edu/pics/csl_logo.gif){kind=logo}