[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] reporting bugs in condor-python bindings



Hi Xin,

The Python bindings in HTCondor v8.6.x only support Python 2. There were known issues using Python 3, which I am happy to say we think we have fixed starting with HTCondor v8.7.3+.

So first off, if you want to use Python 3 with HTCondor, you should be using HTCondor 8.7.x (where x=3 or greater), not HTCondor v8.6.

If you download the precompiled binaries from the UW-Madison HTCondor repo, currently in the RPM you only get the Python bindings for the default version of Python installed with the OS. So for instance, if you grab the binaries for Red Hat 7 the RPM will only contain the bindings for Python 2, if you grab binaries for the latest Fedora it should contain the bindings for Python 3. We are working on including the bindings for both Python 2 and 3 in the RPMs/DEBs but are not there yet.

This begs the question of what to do TODAY to get the HTCondor bindings for Python 3 if you are running on a system like Red Hat 7... you have two choices:

1. Use PIP. This is probably the easiest option (by far), i.e. "pip install htcondor". PIP should have bindings for HTCondor v8.7 for Python 2.6, 2.7, 3.3, and 3.4. All Linux only for now. Also the bindings in PIP don't yet have every option compiled into them that the UW binaries do (like support for Kerberos, GSI, etc), so they may not yet be robust enough for every environment, but should be fine for most people. See this thread in htcondor-users: http://bit.ly/2zfRp2m

    2. Compile from source in your own environment.


Details on all the changes to get HTCondor v8.7 to pass our regression tests with Python 3 is detailed here:
  https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=6326

Overall tracking on our work to support Python 3 is here:
  https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=4146

Hope the above helps,
Todd




On 10/17/2017 10:41 AM, Xin Wang wrote:
Further clarification: I’m now setting up my daemon without using htcondor python binding, and the daemon no longer shows mysterious hang or segfault.

*From:* Xin Wang
*Sent:* Tuesday, October 17, 2017 11:24 AM
*To:* 'HTCondor-Users Mail List' <htcondor-users@xxxxxxxxxxx>; 'htcondor-admin@xxxxxxxxxxx' <htcondor-admin@xxxxxxxxxxx>
*Cc:* Andrew Georgiev <AGeorgiev@xxxxxxxxxxxxx>
*Subject:* reporting bugs in condor-python bindings

I was trying to use htcondor to distribute jobs to a pool of machines, and would like to get the job status update and take proper actions as soon as the state update happens. For this purpose, I use htcondor python bindings to implement a simple daemon. Essentially I use htcondor.submit() to submit tasks, and use htcondor.read_events to read the update.

Initially I compiled htcondor 8.6.6 manually to get a python bindings for python 3.6. The daemon worked properly for a couple of hours but then would hang mysteriously at impossible places and I have to use “kill -9” to kill the process (it does not respond to kill) every single time.

The followings are a few examples, and the last line is where the python script hangs.

condorserver.py(152):                 for job in jobs:

condorserver.py(153):                     if job[0].lower() == "submit":

_strptime.py(560):     return time.struct_time(tt[:time._STRUCT_TM_ITEMS])

condorlog.py(30):         if ctime < self.ctime:

condorlog.py(34):         return now, ctime

condorserver.py(236):                 print("DEBUG-6 add ({}, {}, {}, {}, {}) to updates".format(tag, task, timestamp, tsupdate, status), flush=True)

condorserver.py(193):         for event in myevents:

I sensed that the manually compiled modules may malfunction, so I tried the python bindings installed by RPM. It also had issues. Instead of hanging, it crashed (at a place where a new list is being created in python):

condorserver.py(205):                     print(batch)

condorserver.py(206):                     params = list()

*** glibc detected *** python: corrupted double-linked list: 0x0000000002617b80 ***

======= Backtrace: =========

/lib64/libc.so.6[0x3ded675f4e]

/lib64/libc.so.6[0x3ded679066]

/usr/lib64/libpython2.6.so.1.0[0x3df5aa1b79]

/usr/lib64/libpython2.6.so.1.0[0x3df5a79e3b]

/usr/lib64/libpython2.6.so.1.0[0x3df5a90d5d]

/usr/lib64/libpython2.6.so.1.0[0x3df5a70aef]

/usr/lib64/libpython2.6.so.1.0[0x3df5a78277]

/usr/lib64/libpython2.6.so.1.0(PyDict_SetItem+0xa7)[0x3df5a7ace7]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x547c)[0x3df5ad5c0c]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalCode+0x32)[0x3df5ad7722]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x54f2)[0x3df5ad5c82]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x5304)[0x3df5ad5a94]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x5304)[0x3df5ad5a94]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalCode+0x32)[0x3df5ad7722]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x54f2)[0x3df5ad5c82]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalFrameEx+0x5304)[0x3df5ad5a94]

/usr/lib64/libpython2.6.so.1.0(PyEval_EvalCodeEx+0x927)[0x3df5ad7647]

/usr/lib64/libpython2.6.so.1.0[0x3df5a6aca0]

/usr/lib64/libpython2.6.so.1.0(PyObject_Call+0x53)[0x3df5a43c63]

/usr/lib64/libpython2.6.so.1.0[0x3df5afeb7e]

/usr/lib64/libpython2.6.so.1.0(Py_Main+0x793)[0x3df5aff4c3]

/lib64/libc.so.6(__libc_start_main+0xfd)[0x3ded61ed5d]

python[0x400649]

======= Memory map: ========

00400000-00401000 r-xp 00000000 fd:01 793246 /usr/bin/python

00600000-00602000 rw-p 00000000 fd:01 793246 /usr/bin/python

01b8e000-02641000 rw-p 00000000 00:00 0 [heap]

3cae800000-3cae9b9000 r-xp 00000000 fd:01 835543 /usr/lib64/libcrypto.so.1.0.1e

3cae9b9000-3caebb8000 ---p 001b9000 fd:01 835543  /usr/lib64/libcrypto.so.1.0.1e

3caebb8000-3caebd3000 r--p 001b8000 fd:01 835543 /usr/lib64/libcrypto.so.1.0.1e

3caebd3000-3caebdf000 rw-p 001d3000 fd:01 835543 /usr/lib64/libcrypto.so.1.0.1e

3caebdf000-3caebe3000 rw-p 00000000 00:00 0

3caec00000-3caf006000 r-xp 00000000 fd:01 835546 /usr/lib64/libcondor_utils_8_6_6.so

3caf006000-3caf206000 ---p 00406000 fd:01 835546 /usr/lib64/libcondor_utils_8_6_6.so

3caf206000-3caf229000 rw-p 00406000 fd:01 835546 /usr/lib64/libcondor_utils_8_6_6.so

3caf229000-3caf230000 rw-p 00000000 00:00 0

3caf400000-3caf491000 r-xp 00000000 fd:01 830692 /usr/lib64/libclassad.so.8.6.6

3caf491000-3caf690000 ---p 00091000 fd:01 830692 /usr/lib64/libclassad.so.8.6.6

3caf690000-3caf694000 rw-p 00090000 fd:01 830692 /usr/lib64/libclassad.so.8.6.6

3caf800000-3caf862000 r-xp 00000000 fd:01 835544                 /usr/lib64/libssl.so.1.0.1e

3caf862000-3cafa61000 ---p 00062000 fd:01 835544 /usr/lib64/libssl.so.1.0.1e

3cafa61000-3cafa65000 r--p 00061000 fd:01 835544 /usr/lib64/libssl.so.1.0.1e

3cafa65000-3cafa6c000 rw-p 00065000 fd:01 835544 /usr/lib64/libssl.so.1.0.1e

3cafc00000-3cafc10000 r-xp 00000000 fd:01 831719 /usr/lib64/libglobus_gsi_credential.so.1.6.9

3cafc10000-3cafe10000 ---p 00010000 fd:01 831719 /usr/lib64/libglobus_gsi_credential.so.1.6.9

3cafe10000-3cafe11000 rw-p 00010000 fd:01 831719 /usr/lib64/libglobus_gsi_credential.so.1.6.9

3cb0000000-3cb000b000 r-xp 00000000 fd:01 831718       /usr/lib64/libglobus_gsi_callback.so.0.5.8

3cb000b000-3cb020a000 ---p 0000b000 fd:01 831718 /usr/lib64/libglobus_gsi_callback.so.0.5.8

3cb020a000-3cb020b000 rw-p 0000a000 fd:01 831718 /usr/lib64/libglobus_gsi_callback.so.0.5.8

3cb0400000-3cb041f000 r-xp 00000000 fd:01 831721 /usr/lib64/libglobus_gssapi_gsi.so.4.7.25

3cb041f000-3cb061e000 ---p 0001f000 fd:01 831721 /usr/lib64/libglobus_gssapi_gsi.so.4.7.25

3cb061e000-3cb0620000 rw-p 0001e000 fd:01 831721 /usr/lib64/libglobus_gssapi_gsi.so.4.7.25

3cb0c00000-3cb0c04000 r-xp 00000000 fd:01 835545 /usr/lib64/libglobus_openssl_error.so.0.3.5

3cb0c04000-3cb0e03000 ---p 00004000 fd:01 835545 /usr/lib64/libglobus_openssl_error.so.0.3.5

3cb0e03000-3cb0e04000 rw-p 00003000 fd:01 835545 /usr/lib64/libglobus_openssl_error.so.0.3.5

3cb1000000-3cb1008000 r-xp 00000000 fd:01 831717 /usr/lib64/libglobus_oldgaa.so.0.5.8

3cb1008000-3cb1208000 ---p 00008000 fd:01 831717 /usr/lib64/libglobus_oldgaa.so.0.5.8

3cb1208000-3cb1209000 rw-p 00008000 fd:01 831717 /usr/lib64/libglobus_oldgaa.so.0.5.8

3cb1800000-3cb1805000 r-xp 00000000 fd:01 831716 /usr/lib64/libglobus_gsi_cert_utils.so.0.9.11

3cb1805000-3cb1a04000 ---p 00005000 fd:01 831716           /usr/lib64/libglobus_gsi_cert_utils.so.0.9.11

3cb1a04000-3cb1a05000 rw-p 00004000 fd:01 831716 /usr/lib64/libglobus_gsi_cert_utils.so.0.9.11

3cb1c00000-3cb1c02000 r-xp 00000000 fd:01 831715 /usr/lib64/libglobus_openssl.so.0.4.6

3cb1c02000-3cb1e01000 ---p 00002000 fd:01 831715 /usr/lib64/libglobus_openssl.so.0.4.6

3cb1e01000-3cb1e02000 rw-p 00001000 fd:01 831715 /usr/lib64/libglobus_openssl.so.0.4.6

3cb2000000-3cb2004000 r-xp 00000000 fd:01 831714 /usr/lib64/libglobus_proxy_ssl.so.1.4.7

3cb2004000-3cb2204000 ---p 00004000 fd:01 831714 /usr/lib64/libglobus_proxy_ssl.so.1.4.7

3cb2204000-3cb2205000 rw-p 00004000 fd:01 831714 /usr/lib64/libglobus_proxy_ssl.so.1.4.7

3dece00000-3dece20000 r-xp 00000000 fd:01 408732 /lib64/ld-2.12.so

3ded01f000-3ded020000 r--p 0001f000 fd:01 408732 /lib64/ld-2.12.so

3ded020000-3ded021000 rw-p 00020000 fd:01 408732 /lib64/ld-2.12.so

3ded021000-3ded022000 rw-p 00000000 00:00 0

3ded200000-3ded283000 r-xp 00000000 fd:01 408744 /lib64/libm-2.12.so

3ded283000-3ded482000 ---p 00083000 fd:01 408744 /lib64/libm-2.12.so

3ded482000-3ded483000 r--p 00082000 fd:01 408744 /lib64/libm-2.12.so

3ded483000-3ded484000 rw-p 00083000 fd:01 408744 /lib64/libm-2.12.so

3ded600000-3ded78a000 r-xp 00000000 fd:01 408733 /lib64/libc-2.12.so

3ded78a000-3ded98a000 ---p 0018a000 fd:01 408733 /lib64/libc-2.12.so

3ded98a000-3ded98e000 r--p 0018a000 fd:01 408733    /lib64/libc-2.12.so

3ded98e000-3ded98f000 rw-p 0018e000 fd:01 408733 /lib64/libc-2.12.so

3ded98f000-3ded994000 rw-p 00000000 00:00 0

3deda00000-3deda17000 r-xp 00000000 fd:01 408734 /lib64/libpthread-2.12.so

3deda17000-3dedc17000 ---p 00017000 fd:01 408734 /lib64/libpthread-2.12.so

3dedc17000-3dedc18000 r--p 00017000 fd:01 408734 /lib64/libpthread-2.12.so

3dedc18000-3dedc19000 rw-p 00018000 fd:01 408734 /lib64/libpthread-2.12.so

3dedc19000-3dedc1d000 rw-p 00000000 00:00 0

3dede00000-3dede02000 r-xp 00000000 fd:01 408739 /lib64/libdl-2.12.so

3dede02000-3dee002000 ---p 00002000 fd:01 408739 /lib64/libdl-2.12.so

3dee002000-3dee003000 r--p 00002000 fd:01 408739 /lib64/libdl-2.12.so

3dee003000-3dee004000 rw-p 00003000 fd:01 408739 /lib64/libdl-2.12.so

3dee200000-3dee215000 r-xp 00000000 fd:01 408741 /lib64/libz.so.1.2.3

3dee215000-3dee414000 ---p 00015000 fd:01 408741 /lib64/libz.so.1.2.3

3dee414000-3dee415000 r--p 00014000 fd:01 408741             /lib64/libz.so.1.2.3

3dee415000-3dee416000 rw-p 00015000 fd:01 408741 /lib64/libz.so.1.2.3

3dee600000-3dee607000 r-xp 00000000 fd:01 408735 /lib64/librt-2.12.so

3dee607000-3dee806000 ---p 00007000 fd:01 408735 /lib64/librt-2.12.so

3dee806000-3dee807000 r--p 00006000 fd:01 408735 /lib64/librt-2.12.so

3dee807000-3dee808000 rw-p 00007000 fd:01 408735 /lib64/librt-2.12.so

3deea00000-3deea1d000 r-xp 00000000 fd:01 408742 /lib64/libselinux.so.1

3deea1d000-3deec1c000 ---p 0001d000 fd:01 408742 /lib64/libselinux.so.1

3deec1c000-3deec1d000 r--p 0001c000 fd:01 408742 /lib64/libselinux.so.1

3deec1d000-3deec1e000 rw-p 0001d000 fd:01 408742 /lib64/libselinux.so.1

3deec1e000-3deec1f000 rw-p 00000000 00:00 0

3def200000-3def216000 r-xp 00000000 fd:01 393310 /lib64/libresolv-2.12.so

3def216000-3def416000 ---p 00016000 fd:01 393310 /lib64/libresolv-2.12.so

3def416000-3def417000 r--p 00016000 fd:01 393310 /lib64/libresolv-2.12.so

3def417000-3def418000 rw-p 00017000 fd:01 393310                   /lib64/libresolv-2.12.so

3def418000-3def41a000 rw-p 00000000 00:00 0

3defe00000-3defe26000 r-xp 00000000 fd:01 408745 /lib64/libexpat.so.1.5.2

3defe26000-3df0025000 ---p 00026000 fd:01 408745   /lib64/libexpat.so.1.5.2

3df0025000-3df0028000 rw-p 00025000 fd:01 408745 /lib64/libexpat.so.1.5.2

3df0a00000-3df0a04000 r-xp 00000000 fd:01 831723 /usr/lib64/libglobus_callout.so.0.3.13

3df0a04000-3df0c04000 ---p 00004000 fd:01 831723 /usr/lib64/libglobus_callout.so.0.3.13

3df0c04000-3df0c05000 rw-p 00004000 fd:01 831723 /usr/lib64/libglobus_callout.so.0.3.13

3df1600000-3df1647000 r-xp 00000000 fd:01 831712 /usr/lib64/libglobus_common.so.0.16.0

3df1647000-3df1847000 ---p 00047000 fd:01 831712 /usr/lib64/libglobus_common.so.0.16.0

3df1847000-3df184a000 rw-p 00047000 fd:01 831712 /usr/lib64/libglobus_common.so.0.16.0

3df184a000-3df184c000 rw-p 00000000 00:00 0

3df1a00000-3df1a16000 r-xp 00000000 fd:01 408746 /lib64/libgcc_s-4.4.7-20120601.so.1

3df1a16000-3df1c15000 ---p 00016000 fd:01 408746 /lib64/libgcc_s-4.4.7-20120601.so.1

3df1c15000-3df1c16000 rw-p 00015000 fd:01 408746 /lib64/libgcc_s-4.4.7-20120601.so.1

3df2e00000-3df2e60000 r-xp 00000000 fd:01 831711          /usr/lib64/libvomsapi.so.1.0.0

3df2e60000-3df3060000 ---p 00060000 fd:01 831711 /usr/lib64/libvomsapi.so.1.0.0

3df3060000-3df3063000 rw-p 00060000 fd:01 831711 /usr/lib64/libvomsapi.so.1.0.0

3df3a00000-3df3ae8000 r-xp 00000000 fd:01 792176 /usr/lib64/libstdc++.so.6.0.13

3df3ae8000-3df3ce8000 ---p 000e8000 fd:01 792176 /usr/lib64/libstdc++.so.6.0.13

3df3ce8000-3df3cef000 r--p 000e8000 fd:01 792176                  /usr/lib64/libstdc++.so.6.0.13

3df3cef000-3df3cf1000 rw-p 000ef000 fd:01 792176 /usr/lib64/libstdc++.so.6.0.13

3df3cf1000-3df3d06000 rw-p 00000000 00:00 0

3df4a00000-3df4a15000 r-xp 00000000 fd:01 795149              /usr/lib64/libgomp.so.1.0.0

3df4a15000-3df4c14000 ---p 00015000 fd:01 795149 /usr/lib64/libgomp.so.1.0.0

3df4c14000-3df4c15000 rw-p 00014000 fd:01 795149 /usr/lib64/libgomp.so.1.0.0

3df4e00000-3df4e03000 r-xp 00000000 fd:01 408750 /lib64/libcom_err.so.2.1

3df4e03000-3df5002000 ---p 00003000 fd:01 408750 /lib64/libcom_err.so.2.1

3df5002000-3df5003000 r--p 00002000 fd:01 408750 /lib64/libcom_err.so.2.1

3df5003000-3df5004000 rw-p 00003000 fd:01 408750 /lib64/libcom_err.so.2.1

3df5200000-3df52db000 r-xp 00000000 fd:01 408751 /lib64/libkrb5.so.3.3

3df52db000-3df54db000 ---p 000db000 fd:01 408751 /lib64/libkrb5.so.3.3

3df54db000-3df54e5000 r--p 000db000 fd:01 408751 /lib64/libkrb5.so.3.3

3df54e5000-3df54e7000 rw-p 000e5000 fd:01 408751 /lib64/libkrb5.so.3.3

3df5600000-3df5602000 r-xp 00000000 fd:01 408747 /lib64/libkeyutils.so.1.3

3df5602000-3df5801000 ---p 00002000 fd:01 408747 /lib64/libkeyutils.so.1.3

3df5801000-3df5802000 r--p 00001000 fd:01 408747 /lib64/libkeyutils.so.1.3

3df5802000-3df5803000 rw-p 00002000 fd:01 408747 /lib64/libkeyutils.so.1.3

3df5a00000-3df5b5d000 r-xp 00000000 fd:01 817253                /usr/lib64/libpython2.6.so.1.0

3df5b5d000-3df5d5c000 ---p 0015d000 fd:01 817253 /usr/lib64/libpython2.6.so.1.0

3df5d5c000-3df5d98000 rw-p 0015c000 fd:01 817253 /usr/lib64/libpython2.6.so.1.0

3df5d98000-3df5da6000 rw-p 00000000 00:00 0

3df5e00000-3df5e29000 r-xp 00000000 fd:01 408749 /lib64/libk5crypto.so.3.1

3df5e29000-3df6029000 ---p 00029000 fd:01 408749 /lib64/libk5crypto.so.3.1

3df6029000-3df602a000 r--p 00029000 fd:01 408749 /lib64/libk5crypto.so.3.1

3df602a000-3df602b000 rw-p 0002a000 fd:01 408749 /lib64/libk5crypto.so.3.1

3df602b000-3df602c000 rw-p 00000000 00:00 0

3df6200000-3df6241000 r-xp 00000000 fd:01 408752 /lib64/libgssapi_krb5.so.2.2

3df6241000-3df6441000 ---p 00041000 fd:01 408752 /lib64/libgssapi_krb5.so.2.2

3df6441000-3df6442000 r--p 00041000 fd:01 408752 /lib64/libgssapi_krb5.so.2.2

3df6442000-3df6444000 rw-p 00042000 fd:01 408752 /lib64/libgssapi_krb5.so.2.2

3dfc600000-3dfc609000 r-xp 00000000 fd:01 790304 /usr/lib64/libltdl.so.7.2.1

3dfc609000-3dfc808000 ---p 00009000 fd:01 790304 /usr/lib64/libltdl.so.7.2.1

3dfc808000-3dfc809000 rw-p 00008000 fd:01 790304 /usr/lib64/libltdl.so.7.2.1

3dfdc00000-3dfdc02000 r-xp 00000000 fd:01 393306 /lib64/libutil-2.12.so

3dfdc02000-3dfde01000 ---p 00002000 fd:01 393306 /lib64/libutil-2.12.so

3dfde01000-3dfde02000 r--p 00001000 fd:01 393306 /lib64/libutil-2.12.so

3dfde02000-3dfde03000 rw-p 00002000 fd:01 393306                   /lib64/libutil-2.12.so

3e00000000-3e0002c000 r-xp 00000000 fd:01 408759 /lib64/libpcre.so.0.0.1

3e0002c000-3e0022c000 ---p 0002c000 fd:01 408759 /lib64/libpcre.so.0.0.1

3e0022c000-3e0022d000 rw-p 0002c000 fd:01 408759 /lib64/libpcre.so.0.0.1

7f71a0000000-7f71a0021000 rw-p 00000000 00:00 0

7f71a0021000-7f71a4000000 ---p 00000000 00:00 0

7f71a4000000-7f71a4021000 rw-p 00000000 00:00 0

7f71a4021000-7f71a8000000 ---p 00000000 00:00 0

7f71a8000000-7f71a8021000 rw-p 00000000 00:00 0

7f71a8021000-7f71ac000000 ---p 00000000 00:00 0

7f71ac6f1000-7f71ac6fe000 r-xp 00000000 fd:01 831722 /usr/lib64/libglobus_gss_assist.so.3.7.15

7f71ac6fe000-7f71ac8fd000 ---p 0000d000 fd:01 831722 /usr/lib64/libglobus_gss_assist.so.3.7.15

7f71ac8fd000-7f71ac8fe000 rw-p 0000c000 fd:01 831722 /usr/lib64/libglobus_gss_assist.so.3.7.15

7f71ac8fe000-7f71ac90f000 r-xp 00000000 fd:01 831720 /usr/lib64/libglobus_gsi_proxy_core.so.0.7.9

7f71ac90f000-7f71acb0e000 ---p 00011000 fd:01 831720 /usr/lib64/libglobus_gsi_proxy_core.so.0.7.9

7f71acb0e000-7f71acb0f000 rw-p 00010000 fd:01 831720 /usr/lib64/libglobus_gsi_proxy_core.so.0.7.9

7f71acb0f000-7f71acb1b000 r-xp 00000000 fd:01 831713 /usr/lib64/libglobus_gsi_sysconfig.so.1.5.9

7f71acb1b000-7f71acd1a000 ---p 0000c000 fd:01 831713       /usr/lib64/libglobus_gsi_sysconfig.so.1.5.9

7f71acd1a000-7f71acd1b000 rw-p 0000b000 fd:01 831713 /usr/lib64/libglobus_gsi_sysconfig.so.1.5.9

7f71acd1b000-7f71acd1c000 ---p 00000000 00:00 0

7f71acd1c000-7f71ad71c000 rw-p 00000000 00:00 0

7f71ad71c000-7f71ad71d000 ---p 00000000 00:00 0

7f71ad71d000-7f71ae11d000 rw-p 00000000 00:00 0

7f71ae11d000-7f71ae120000 r-xp 00000000 fd:01 808204 /usr/lib64/python2.6/lib-dynload/_hashlib.so

7f71ae120000-7f71ae31f000 ---p 00003000 fd:01 808204 /usr/lib64/python2.6/lib-dynload/_hashlib.so

7f71ae31f000-7f71ae321000 rw-p 00002000 fd:01 808204 /usr/lib64/python2.6/lib-dynload/_hashlib.so

7f71ae321000-7f71ae323000 r-xp 00000000 fd:01 793824                   /usr/lib64/python2.6/lib-dynload/fcntlmodule.so

7f71ae323000-7f71ae523000 ---p 00002000 fd:01 793824 /usr/lib64/python2.6/lib-dynload/fcntlmodule.so

7f71ae523000-7f71ae525000 rw-p 00002000 fd:01 793824     /usr/lib64/python2.6/lib-dynload/fcntlmodule.so

7f71ae525000-7f71ae529000 r-xp 00000000 fd:01 793840 /usr/lib64/python2.6/lib-dynload/selectmodule.so

7f71ae529000-7f71ae729000 ---p 00004000 fd:01 793840 /usr/lib64/python2.6/lib-dynload/selectmodule.so

7f71ae729000-7f71ae72b000 rw-p 00004000 fd:01 793840 /usr/lib64/python2.6/lib-dynload/selectmodule.so

7f71ae72b000-7f71ae72f000 r-xp 00000000 fd:01 793804 /usr/lib64/python2.6/lib-dynload/_localemodule.so

7f71ae72f000-7f71ae92f000 ---p 00004000 fd:01 793804 /usr/lib64/python2.6/lib-dynload/_localemodule.so

7f71ae92f000-7f71ae930000 rw-p 00004000 fd:01 793804 /usr/lib64/python2.6/lib-dynload/_localemodule.so

7f71ae930000-7f71ae934000 r-xp 00000000 fd:01 808226 /usr/lib64/python2.6/lib-dynload/termios.so

7f71ae934000-7f71aeb34000 ---p 00004000 fd:01 808226 /usr/lib64/python2.6/lib-dynload/termios.so

7f71aeb34000-7f71aeb36000 rw-p 00004000 fd:01 808226 /usr/lib64/python2.6/lib-dynload/termios.so

7f71aeb36000-7f71aeb40000 r-xp 00000000 fd:01 408748 /lib64/libkrb5support.so.0.1

7f71aeb40000-7f71aed3f000 ---p 0000a000 fd:01 408748 /lib64/libkrb5support.so.0.1

7f71aed3f000-7f71aed40000 r--p 00009000 fd:01 408748 /lib64/libkrb5support.so.0.1

7f71aed40000-7f71aed41000 rw-p 0000a000 fd:01 408748 /lib64/libkrb5support.so.0.1

7f71aed41000-7f71aed48000 r-xp 00000000 fd:01 808209 /usr/lib64/python2.6/lib-dynload/_ssl.so

7f71aed48000-7f71aef47000 ---p 00007000 fd:01 808209 /usr/lib64/python2.6/lib-dynload/_ssl.so

7f71aef47000-7f71aef49000 rw-p 00006000 fd:01 808209 /usr/lib64/python2.6/lib-dynload/_ssl.so

7f71aef49000-7f71aef54000 r-xp 00000000 fd:01 808207 /usr/lib64/python2.6/lib-dynload/_socketmodule.so

7f71aef54000-7f71af154000 ---p 0000b000 fd:01 808207 /usr/lib64/python2.6/lib-dynload/_socketmodule.so

7f71af154000-7f71af158000 rw-p 0000b000 fd:01 808207 /usr/lib64/python2.6/lib-dynload/_socketmodule.so

7f71af158000-7f71af164000 r-xp 00000000 fd:01 393246 /lib64/libnss_files-2.12.so

7f71af164000-7f71af364000 ---p 0000c000 fd:01 393246 /lib64/libnss_files-2.12.so

7f71af364000-7f71af365000 r--p 0000c000 fd:01 393246 /lib64/libnss_files-2.12.so

7f71af365000-7f71af366000 rw-p 0000d000 fd:01 393246 /lib64/libnss_files-2.12.so

7f71af366000-7f71af370000 r-xp 00000000 fd:01 393250 /lib64/libnss_nis-2.12.so

7f71af370000-7f71af56f000 ---p 0000a000 fd:01 393250                     /lib64/libnss_nis-2.12.so

7f71af56f000-7f71af570000 r--p 00009000 fd:01 393250 /lib64/libnss_nis-2.12.so

7f71af570000-7f71af571000 rw-p 0000a000 fd:01 393250 /lib64/libnss_nis-2.12.so

7f71af571000-7f71af587000 r-xp 00000000 fd:01 408772 /lib64/libnsl-2.12.so

7f71af587000-7f71af786000 ---p 00016000 fd:01 408772 /lib64/libnsl-2.12.so

7f71af786000-7f71af787000 r--p 00015000 fd:01 408772 /lib64/libnsl-2.12.so

7f71af787000-7f71af788000 rw-p 00016000 fd:01 408772 /lib64/libnsl-2.12.so

7f71af788000-7f71af78a000 rw-p 00000000 00:00 0

7f71af78a000-7f71af792000 r-xp 00000000 fd:01 393242 /lib64/libnss_compat-2.12.so

7f71af792000-7f71af991000 ---p 00008000 fd:01 393242 /lib64/libnss_compat-2.12.so

7f71af991000-7f71af992000 r--p 00007000 fd:01 393242 /lib64/libnss_compat-2.12.so

7f71af992000-7f71af993000 rw-p 00008000 fd:01 393242 /lib64/libnss_compat-2.12.so

7f71af993000-7f71af9a3000 r-xp 00000000 fd:01 793821 /usr/lib64/python2.6/lib-dynload/datetime.so

7f71af9a3000-7f71afba3000 ---p 00010000 fd:01 793821 /usr/lib64/python2.6/lib-dynload/datetime.so

7f71afba3000-7f71afba7000 rw-p 00010000 fd:01 793821 /usr/lib64/python2.6/lib-dynload/datetime.so

7f71afba7000-7f71afc2c000 r-xp 00000000 fd:01 947393 /usr/lib64/python2.6/site-packages/classad.so

7f71afc2c000-7f71afe2b000 ---p 00085000 fd:01 947393 /usr/lib64/python2.6/site-packages/classad.so

7f71afe2b000-7f71afe31000 rw-p 00084000 fd:01 947393 /usr/lib64/python2.6/site-packages/classad.so

7f71afe31000-7f71afe32000 rw-p 00000000 00:00 0

7f71afe32000-7f71afe7b000 r-xp 00000000 fd:01 834639 /usr/lib64/libpyclassad2.6_8_6_6.so

7f71afe7b000-7f71b007b000 ---p 00049000 fd:01 834639 /usr/lib64/libpyclassad2.6_8_6_6.so

7f71b007b000-7f71b007e000 rw-p 00049000 fd:01 834639 /usr/lib64/libpyclassad2.6_8_6_6.so

7f71b007e000-7f71b01c6000 r-xp 00000000 fd:01 947394                  /usr/lib64/python2.6/site-packages/htcondor.so

7f71b01c6000-7f71b03c6000 ---p 00148000 fd:01 947394 /usr/lib64/python2.6/site-packages/htcondor.so

7f71b03c6000-7f71b03d5000 rw-p 00148000 fd:01 947394  /usr/lib64/python2.6/site-packages/htcondor.so

7f71b03d5000-7f71b03dc000 r-xp 00000000 fd:01 947281 /usr/lib64/python2.6/site-packages/zmq/devices/monitoredqueue.so

7f71b03dc000-7f71b05dc000 ---p 00007000 fd:01 947281    /usr/lib64/python2.6/site-packages/zmq/devices/monitoredqueue.so

7f71b05dc000-7f71b05de000 rw-p 00007000 fd:01 947281 /usr/lib64/python2.6/site-packages/zmq/devices/monitoredqueue.so

7f71b05de000-7f71b05e4000 r-xp 00000000 fd:01 793807 /usr/lib64/python2.6/lib-dynload/_multiprocessing.so

7f71b05e4000-7f71b07e4000 ---p 00006000 fd:01 793807 /usr/lib64/python2.6/lib-dynload/_multiprocessing.so

7f71b07e4000-7f71b07e5000 rw-p 00006000 fd:01 793807                    /usr/lib64/python2.6/lib-dynload/_multiprocessing.so

7f71b07e5000-7f71b07e6000 r-xp 00000000 fd:01 808211 /usr/lib64/python2.6/lib-dynload/_weakref.so

7f71b07e6000-7f71b09e6000 ---p 00001000 fd:01 808211        /usr/lib64/python2.6/lib-dynload/_weakref.so

7f71b09e6000-7f71b09e7000 rw-p 00001000 fd:01 808211 /usr/lib64/python2.6/lib-dynload/_weakref.so

7f71b09e7000-7f71b09ed000 r-xp 00000000 fd:01 947260 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_device.so

7f71b09ed000-7f71b0bed000 ---p 00006000 fd:01 947260 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_device.so

7f71b0bed000-7f71b0bee000 rw-p 00006000 fd:01 947260        /usr/lib64/python2.6/site-packages/zmq/backend/cython/_device.so

7f71b0bee000-7f71b0bf1000 r-xp 00000000 fd:01 947262 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_version.so

7f71b0bf1000-7f71b0df0000 ---p 00003000 fd:01 947262 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_version.so

7f71b0df0000-7f71b0df1000 rw-p 00002000 fd:01 947262 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_version.so

7f71b0df1000-7f71b0df9000 r-xp 00000000 fd:01 947261 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_poll.so

7f71b0df9000-7f71b0ff8000 ---p 00008000 fd:01 947261 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_poll.so

7f71b0ff8000-7f71b0ffa000 rw-p 00007000 fd:01 947261 /usr/lib64/python2.6/site-packages/zmq/backend/cython/_poll.so

7f71b0ffa000-7f71b0fff000 r-xp 00000000 fd:01 947274 /usr/lib64/python2.6/site-packages/zmq/backend/cython/utils.so

7f71b0fff000-7f71b11ff000 ---p 00005000 fd:01 947274 /usr/lib64/python2.6/site-packages/zmq/backend/cython/utils.so

7f71b11ff000-7f71b1200000 rw-p 00005000 fd:01 947274 /usr/lib64/python2.6/site-packages/zmq/backend/cython/utils.so

7f71b1200000-7f71b1207000 r-xp 00000000 fd:01 919897 /usr/lib64/python2.6/site-packages/simplejson/_speedups.so

7f71b1207000-7f71b1407000 ---p 00007000 fd:01 919897 /usr/lib64/python2.6/site-packages/simplejson/_speedups.so

7f71b1407000-7f71b1408000 rw-p 00007000 fd:01 919897 /usr/lib64/python2.6/site-packages/simplejson/_speedups.so

7f71b1408000-7f71b140f000 r-xp 00000000 fd:01 808210 /usr/lib64/python2.6/lib-dynload/_struct.so

7f71b140f000-7f71b160f000 ---p 00007000 fd:01 808210 /usr/lib64/python2.6/lib-dynload/_struct.so

7f71b160f000-7f71b1611000 rw-p 00007000 fd:01 808210 /usr/lib64/python2.6/lib-dynload/_struct.so

7f71b1611000-7f71b1614000 r-xp 00000000 fd:01 793808 /usr/lib64/python2.6/lib-dynload/_randommodule.so

7f71b1614000-7f71b1813000 ---p 00003000 fd:01 793808 /usr/lib64/python2.6/lib-dynload/_randommodule.so

7f71b1813000-7f71b1814000 rw-p 00002000 fd:01 793808 /usr/lib64/python2.6/lib-dynload/_randommodule.so

7f71b1814000-7f71b1818000 r-xp 00000000 fd:01 793816 /usr/lib64/python2.6/lib-dynload/binascii.so

7f71b1818000-7f71b1a18000 ---p 00004000 fd:01 793816 /usr/lib64/python2.6/lib-dynload/binascii.so

7f71b1a18000-7f71b1a19000 rw-p 00004000 fd:01 793816 /usr/lib64/python2.6/lib-dynload/binascii.so

7f71b1a19000-7f71b1a1e000 r-xp 00000000 fd:01 793831 /usr/lib64/python2.6/lib-dynload/mathmodule.so

7f71b1a1e000-7f71b1c1d000 ---p 00005000 fd:01 793831 /usr/lib64/python2.6/lib-dynload/mathmodule.so

7f71b1c1d000-7f71b1c1f000 rw-p 00004000 fd:01 793831 /usr/lib64/python2.6/lib-dynload/mathmodule.so

7f71b1c1f000-7f71b1c32000 r-xp 00000000 fd:01 947272 /usr/lib64/python2.6/site-packages/zmq/backend/cython/socket.so

7f71b1c32000-7f71b1e32000 ---p 00013000 fd:01 947272 /usr/lib64/python2.6/site-packages/zmq/backend/cython/socket.so

7f71b1e32000-7f71b1e36000 rw-p 00013000 fd:01 947272 /usr/lib64/python2.6/site-packages/zmq/backend/cython/socket.so

7f71b1e36000-7f71b1e3e000 r-xp 00000000 fd:01 947266 /usr/lib64/python2.6/site-packages/zmq/backend/cython/context.so

7f71b1e3e000-7f71b203e000 ---p 00008000 fd:01 947266 /usr/lib64/python2.6/site-packages/zmq/backend/cython/context.so

7f71b203e000-7f71b2040000 rw-p 00008000 fd:01 947266 /usr/lib64/python2.6/site-packages/zmq/backend/cython/context.so

7f71b2040000-7f71b204c000 r-xp 00000000 fd:01 947270 /usr/lib64/python2.6/site-packages/zmq/backend/cython/message.so

7f71b204c000-7f71b224c000 ---p 0000c000 fd:01 947270 /usr/lib64/python2.6/site-packages/zmq/backend/cython/message.so

7f71b224c000-7f71b224e000 rw-p 0000c000 fd:01 947270 /usr/lib64/python2.6/site-packages/zmq/backend/cython/message.so

7f71b224e000-7f71b2251000 r-xp 00000000 fd:01 947267 /usr/lib64/python2.6/site-packages/zmq/backend/cython/error.so

7f71b2251000-7f71b2451000 ---p 00003000 fd:01 947267 /usr/lib64/python2.6/site-packages/zmq/backend/cython/error.so

7f71b2451000-7f71b2452000 rw-p 00003000 fd:01 947267 /usr/lib64/python2.6/site-packages/zmq/backend/cython/error.so

7f71b2452000-7f71b2499000 r-xp 00000000 fd:01 791821 /usr/lib64/libpgm-5.1.so.0.0.118

7f71b2499000-7f71b2699000 ---p 00047000 fd:01 791821 /usr/lib64/libpgm-5.1.so.0.0.118

7f71b2699000-7f71b269a000 rw-p 00047000 fd:01 791821 /usr/lib64/libpgm-5.1.so.0.0.118

7f71b269a000-7f71b269e000 rw-p 00000000 00:00 0

7f71b269e000-7f71b26e6000 r-xp 00000000 fd:01 792924 /usr/lib64/libzmq.so.3.0.0

7f71b26e6000-7f71b28e6000 ---p 00048000 fd:01 792924 /usr/lib64/libzmq.so.3.0.0

7f71b28e6000-7f71b28eb000 rw-p 00048000 fd:01 792924 /usr/lib64/libzmq.so.3.0.0

7f71b28eb000-7f71b28f4000 r-xp 00000000 fd:01 947264 /usr/lib64/python2.6/site-packages/zmq/backend/cython/constants.so

7f71b28f4000-7f71b2af3000 ---p 00009000 fd:01 947264 /usr/lib64/python2.6/site-packages/zmq/backend/cython/constants.so

7f71b2af3000-7f71b2af6000 rw-p 00008000 fd:01 947264            /usr/lib64/python2.6/site-packages/zmq/backend/cython/constants.so

7f71b2af6000-7f71b2afa000 r-xp 00000000 fd:01 808216 /usr/lib64/python2.6/lib-dynload/cStringIO.so

7f71b2afa000-7f71b2cf9000 ---p 00004000 fd:01 808216               /usr/lib64/python2.6/lib-dynload/cStringIO.so

7f71b2cf9000-7f71b2cfb000 rw-p 00003000 fd:01 808216 /usr/lib64/python2.6/lib-dynload/cStringIO.so

7f71b2cfb000-7f71b2d0c000 r-xp 00000000 fd:01 808215 /usr/lib64/python2.6/lib-dynload/cPickle.so

7f71b2d0c000-7f71b2f0c000 ---p 00011000 fd:01 808215 /usr/lib64/python2.6/lib-dynload/cPickle.so

7f71b2f0c000-7f71b2f0d000 rw-p 00011000 fd:01 808215 /usr/lib64/python2.6/lib-dynload/cPickle.so

7f71b2f0d000-7f71b2f0e000 rw-p 00000000 00:00 0

7f71b2f0e000-7f71b2f13000 r-xp 00000000 fd:01 793842 /usr/lib64/python2.6/lib-dynload/stropmodule.so

7f71b2f13000-7f71b3112000 ---p 00005000 fd:01 793842     /usr/lib64/python2.6/lib-dynload/stropmodule.so

7f71b3112000-7f71b3114000 rw-p 00004000 fd:01 793842 /usr/lib64/python2.6/lib-dynload/stropmodule.so

7f71b3114000-7f71b311d000 r-xp 00000000 fd:01 793829 /usr/lib64/python2.6/lib-dynload/itertoolsmodule.so

7f71b311d000-7f71b331d000 ---p 00009000 fd:01 793829 /usr/lib64/python2.6/lib-dynload/itertoolsmodule.so

7f71b331d000-7f71b3321000 rw-p 00009000 fd:01 793829 /usr/lib64/python2.6/lib-dynload/itertoolsmodule.so

7f71b3321000-7f71b3329000 r-xp 00000000 fd:01 793834 /usr/lib64/python2.6/lib-dynload/operator.so

7f71b3329000-7f71b3528000 ---p 00008000 fd:01 793834 /usr/lib64/python2.6/lib-dynload/operator.so

7f71b3528000-7f71b352a000 rw-p 00007000 fd:01 793834 /usr/lib64/python2.6/lib-dynload/operator.so

7f71b352a000-7f71b3530000 r-xp 00000000 fd:01 793791 /usr/lib64/python2.6/lib-dynload/_collectionsmodule.so

7f71b3530000-7f71b372f000 ---p 00006000 fd:01 793791 /usr/lib64/python2.6/lib-dynload/_collectionsmodule.so

7f71b372f000-7f71b3731000 rw-p 00005000 fd:01 793791 /usr/lib64/python2.6/lib-dynload/_collectionsmodule.so

7f71b3731000-7f71b3734000 r-xp 00000000 fd:01 808227 /usr/lib64/python2.6/lib-dynload/timemodule.so

7f71b3734000-7f71b3934000 ---p 00003000 fd:01 808227 /usr/lib64/python2.6/lib-dynload/timemodule.so

7f71b3934000-7f71b3936000 rw-p 00003000 fd:01 808227 /usr/lib64/python2.6/lib-dynload/timemodule.so

7f71b3936000-7f71b3938000 r-xp 00000000 fd:01 793799 /usr/lib64/python2.6/lib-dynload/_functoolsmodule.so

7f71b3938000-7f71b3b38000 ---p 00002000 fd:01 793799 /usr/lib64/python2.6/lib-dynload/_functoolsmodule.so

7f71b3b38000-7f71b3b39000 rw-p 00002000 fd:01 793799 /usr/lib64/python2.6/lib-dynload/_functoolsmodule.so

7f71b3b39000-7f71b3b7a000 rw-p 00000000 00:00 0

7f71b3b7c000-7f71b3c7e000 rw-p 00000000 00:00 0

7f71b3c7e000-7f71b9b0f000 r--p 00000000 fd:01 787693            /usr/lib/locale/locale-archive

7f71b9b0f000-7f71b9b50000 rw-p 00000000 00:00 0

7f71b9b82000-7f71b9c09000 rw-p 00000000 00:00 0

7f71b9c27000-7f71b9c2b000 rw-p 00000000 00:00 0

7ffe35e2a000-7ffe35e51000 rw-p 00000000 00:00 0    [stack]

7ffe35f26000-7ffe35f27000 r-xp 00000000 00:00 0 [vdso]

ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]

Aborted (core dumped)

I read the htcondor code for python bindings and I understand that it is essentially use boost python for the bindings. I highly suspect that the htcondor python bindings do not handle memory properly and corrupt the python if they run for a long time. But I do not have any guess regarding to what is leading to the problem.



            Jefferies archives and monitors outgoing and incoming
            e-mail. The contents of this email, including any
            attachments, are confidential to the ordinary user of the
            email address to which it was addressed. If you are not the
            addressee of this email you may not copy, forward, disclose
            or otherwise use it or any part of it in any form
            whatsoever. This email may be produced at the request of
            regulators or in connection with civil litigation. Jefferies
            accepts no liability for any errors or omissions arising as
            a result of transmission. Use by other than intended
            recipients is prohibited. In the United Kingdom, Jefferies
            operates as Jefferies International Limited; registered in
            England: no. 1978621; registered office: Vintners Place, 68
            Upper Thames Street, London EC4V 3BJ. Jefferies
            International Limited is authorized and regulated by the
            Financial Conduct Authority.



_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/



--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685