| Hi,
To elaborate - if you see a suspected threading issue in the python client, I would consider it a bug and should be reported. There have been threading bugs in the past and I'm sure there will be some in the future.
The level of concurrency for writes (e.g., qedit, submit, act, etc) is very low -- only one process can proceed at a time. If you have a lot of submits to perform, it makes sense to do it from one thread / process. Doing it from two threads will simply cause each thread to take twice as long to finish (potentially causing timeouts).
For *reads* (queries, location lookups), a higher level of concurrency is likely OK.
Brian
The bindings themselves are thread safe as far as we know, but the HTCondor daemons are not multithreaded. In particular, you *cannot* have multiple python threads sending commands to the same HTCondor daemon simultaneously. You should design your python programs so that only one thread does job submission for any given schedd, or you are very likely to have intermittent failures of submission and disconnection by the schedd. You can *probably* get away with multiple threads doing queries to the collector or schedd at the same time, but even then I would encourage you to try and avoid this. -tj Hello Biruk, I am a new user of the python bindings of ht condor. I primarily use it via multiprocessing module, and have seen no issues so far. Here is the source code for python bindings: https://github.com/htcondor/htcondor/tree/master/src/python-bindingsThere are some synchronization mechanisms, but I am not aware of any thread safety guarantees. (I could be wrong though). Hello, Is the Python htcondor module guaranteed to be thread-safe?
This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient, you should delete this message and are hereby notified that any disclosure, copying, or distribution of this message, or the taking of any action based on it, is strictly prohibited.
|
![[Computer Systems Lab]](https://www-auth.cs.wisc.edu/pics/csl_logo.gif){kind=logo}