Re: [HTCondor-users] No output file with pyROOT, using RECREATE

[romain.bouquet04@xxxxxxxxx]

Hi Nathan,

No I did it in the past using recreate option.

Is the file OutFile.root directly in the directory where there is the script ?

Because imagine you create that file in the directory "output/OutFile.root" then you would need to use
transfer_output_files = output/OutFile.root (instead of transfer_output_files = OutFile.root)

Could you attach your script ?

To see if inside your job, you really creates OutFile.root, you can connect to your job while it is running (it will work only when the job is running) using condor_ssh_to_job

For instance doing condor_q on lxplus I have currently two jobs running
-- Schedd: bigbird09.cern.ch : <188.185.71.142:9618?... @ 01/22/21 14:45:48
OWNER Â BATCH_NAME Â Â SUBMITTED Â DONE Â RUN Â ÂIDLE ÂTOTAL JOB_IDS
bouquet ID: 7150026 Â 1/22 14:29 Â Â Â_ Â Â Â1 Â Â Â_ Â Â Â1 7150026.0
bouquet ID: 7150027 Â 1/22 14:29 Â Â Â_ Â Â Â1 Â Â Â_ Â Â Â1 7150027.0

doing condor_ssh_to_job 7150026.0
I connect to the first one then you can do "ls" if you do not see OutFile.root it is you script that has a problem and other to see what is inside your job

this is what I obtain for example
bouquet.cc Âbuild Âcondor_exec.exe Â_condor_stderr Â_condor_stdout Ânominal1.sh Ârun Âsource Âtmp Âvar

with run is my output directory

(_condor_stderr and _condor_stdout will become the out and err files at the end of the job and condor_exec.exe is the executable)

Best regards,

Romain

LeÂven. 22 janv. 2021 ÃÂ13:12, <lalloue@xxxxxxxxxxxxx> a ÃcritÂ:

Hi Romain,

Thank you very much for the answer!

When I add this line (without the quotes):

transfer_output_files = OutFile.root

I have the following result:

error reading from /pool/condor/dir_*/OutFile.root: (errno 2) No such file or directory; SHADOW failed to receive file(s) from ...

Yet, I'm sure that my pyROOT script creates a file named "OutFile.root".

Maybe the ROOT files created with the "RECREATE" option are not detected by HTCondor?

Best regards,

Nathan LallouÃ

---

From: "romain bouquet04" <romain.bouquet04@xxxxxxxxx>
To: "HTCondor-Users Mail List" <htcondor-users@xxxxxxxxxxx>
Sent: Friday, 22 January, 2021 10:34:24
Subject: Re: [HTCondor-users] No output file with pyROOT, using RECREATE

Hi Nathan,Â

I think you are missing transfer_output_files, put in your condor submit file both lines below:

transfer_output_files = "OutFile.root"

transfer_output_remap = "OutFile.root = myName_$(Process).root"

Because the first line tells condor the name of the output file and the second tells condor to remap it.

I hope it will work,

Best regards,

Romain Bouquet

LeÂven. 22 janv. 2021 ÃÂ10:19, Nathan Lalloue <lalloue@xxxxxxxxxxxxx> a ÃcritÂ:

Dear HTCondor community,

I am trying to run a script in python that makes use of ROOT, named "my_code.py" here.
This code reads the ROOT input file and creates an other one from it, named "OutFile.root", with the following line:

OutFile = ROOT.TFile("OutFile.root", "RECREATE")

Then, I run this script with HTCondor, with the following submit description file:

executable       = my_code.py
arguments       Â= $(myfile)
output         = output/job.$(ClusterId).$(ProcId).out
error         Â= error/job.$(ClusterId).$(ProcId).err
log          Â= log/job.$(ClusterId).log
transfer_input_files  = $(myfile)
transfer_output_remaps = "OutFile.root = myName_$(Process).root"
queue myfile matching *.root

I don't have any apparent error, but when I check in my submit directory, no file is created.
Could you please tell me what I am doing in a wrong way?

Thank you very much in advance.

Best regards,

Nathan
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/