[HTCondor-users] problem using custom Ads in htcondor.Submit object

[Stefano Belforte <stefano.belforte@xxxxxxx>]

Dear experts,
sorry to report a new problem when migrating CMS CRAB to submit via
 schedd.submit(submitObject,...)

We add custom classAds to jobs for use in glideinWMS (which still works)
and we also add one which we use later on to use as a constrain
in condor_q, condor_qedit and other commads.

The latter thing fails. I have managed to reproduce to the problem
to a simple test using local submission with python bindings.

Hopefully lines below are self-explaining, if not, ask me.
Note in particular the output of
 condor_q 9620532 -af:h StefanoAd CRAB_TT
And of course the fact that condor_q -con .. does not select any job

Things look as expected if I put same info in a JDL file and do a plain
condor_submit test.jdl and also if I construct the htcondor.submit()
object passing the full jdl to it via ("""jdl lines"""). There are other
oddities,like if in the example below I change 'ROOT' to 'ROT' output
is different and while -con still fails, condor_q -af returns uniformly
"undefined". I can of course change ROOT to a different string in our 
code, but it would be good to have a rational.

Our "old way" was to use schedd.submit(classAds,...)
and things were OK.

If you prefer to move this to some more interactive channel
(our GH ?) tell me as well.

Thanks a lot
Stefano

belforte@vocms059/T> condor_version
$CondorVersion: 23.0.4 2024-02-08 BuildID: 712251 PackageID: 23.0.4-1 $
$CondorPlatform: x86_64_AlmaLinux9 $

belforte@vocms059/T> cat mytest.py
import htcondor

schedd = htcondor.Schedd()

jdl = htcondor.Submit()
jdl['Universe']   = "scheduler"
jdl['Executable'] = "None"
jdl['Log'] = "myTest.log"

jdl['+StefanoAd'] = "TestString"
jdl['+CRAB_TT'] = "ROOT"

print(jdl)

res = schedd.submit(jdl, count=1)
print(res.cluster())

belforte@vocms059/T> python3 mytest.py
Universe = scheduler
Executable = None
Log = myTest.log
MY.StefanoAd = TestString
MY.CRAB_TT = ROOT

9620532

belforte@vocms059/T> condor_q 9620532 -l|grep StefanoAd
StefanoAd = TestString
belforte@vocms059/T> condor_q 9620532 -l|grep CRAB_TT
CRAB_TT = ROOT
belforte@vocms059/T> condor_q 9620532 -af:h StefanoAd CRAB_TT
StefanoAd CRAB_TT
undefined [ ClusterId = 9620532; ProcId = 0; CRAB_TT = ROOT; StefanoAd = 
TestString ]

belforte@vocms059/T> condor_q -con 'StefanoAd=="TestString"'


-- Schedd: crab3@xxxxxxxxxxxxxxxx : <188.184.103.189:4080?... @ 06/04/24 
12:46:59
 ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD

Total for query: 0 jobs; 0 completed, 0 removed, 0 idle, 0 running, 0 
held, 0 suspended
Total for all users: 79 jobs; 3 completed, 0 removed, 0 idle, 76 
running, 0 held, 0 suspended

belforte@vocms059/T> condor_q -con 'CRAB_TT=="ROOT"'


-- Schedd: crab3@xxxxxxxxxxxxxxxx : <188.184.103.189:4080?... @ 06/04/24 
12:47:16
 ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD

Total for query: 0 jobs; 0 completed, 0 removed, 0 idle, 0 running, 0 
held, 0 suspended
Total for all users: 79 jobs; 3 completed, 0 removed, 0 idle, 76 
running, 0 held, 0 suspended

belforte@vocms059/T>