[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] HTCondor doesn't recognize python uproot library



Hi Normunds,

From the log file, HTCondor ran your code on a different machine than the machine that you submitted the job from. The traceback in the error file suggests that the uproot library is not installed on this other machine. Are you expecting this library to already be installed on all of the other execution machines in this HTCondor pool? Do you recall how uproot was installed on your access point (submit machine)?

Jason Patton



On Wed, Oct 6, 2021 at 4:18 PM Normunds Ralfs Strautnieks <normunds.ralfs.strautnieks@xxxxxxx> wrote:
Hello!
I'm a new lxplus and HTCondor system user, I was trying to create condor jobs for remote python script calculations involving ROOT files and I have ran into a problem I cannot solve by myself. Your help/comments/advice would be greatly appreciated!

The context/problem:
I'm trying to run multiple Condor jobs involving a python script which uses information from remotely accessed ROOT files to perform a physics analysis. For these jobs I'm using a single job for one ROOT file and to be able to read information from these files, I'm using python uproot library. I have created all the needed files for launching jobs: executable file[1], submit file[2], proxy file(copied when initialized GRID certificate) and the python script file itself[3].

When I try to run this job, it submits to condor system, stays idle for a while, then runs, and gives back an error message in error file[4]. Additionally, here are the log[5] and output[6] files it that gives any extra information. Any ideas what could cause it, because I have not had any problems using other python libraries in HTCondor, and this code runs perfectly when launched locally on lxplus.
The condor jobs were submitted from the home directory in lxplus and I use python 2.7 for these jobs, and "kinit" line was run beforehand.

Condor version info:
$CondorVersion: 8.9.11 Dec 28 2020 BuildID: 526068 PackageID: 8.9.11-1 $
$CondorPlatform: x86_64_CentOS7 $


[1] https://github.com/pauris123/CondorFiles/blob/main/my_arguments.sh
[2] https://github.com/pauris123/CondorFiles/blob/main/submit_mp_18_data_extra_N.sub
[3] https://github.com/pauris123/CondorFiles/blob/main/moneyplot_18_data_extra_N.py
[4] https://github.com/pauris123/CondorFiles/blob/main/mp_18_data_extra_N_0.err
[5] https://github.com/pauris123/CondorFiles/blob/main/mp_18_data_extra_N_0.log
[6] https://github.com/pauris123/CondorFiles/blob/main/mp_18_data_extra_N_output_0.out

Thanks in advance!
Best Wishes!
Normunds
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/