Re: [HTCondor-users] using the Job Router for ARC CEs

[John M Knoeller <johnkn@xxxxxxxxxxx>]

Hi Maarten.  

condor_submit will be adding the "" automatically when it sees the nordogrid_rsl keyword.
it really does need to be a quoted string. 

Also the job classad attribute name is often different than the submit command that you use to set it.
The job router needs to use the job classad attribute names.  so in this case you would use

eval_set_NordugridRsl = "(queue=plugh)"

or just 

set_NordugridRsl = "(queue=plugh)"

since there is nothing to evaluate here

If you want to know how condor_submit turns submit commands into job classad attributes you can use

   condor_submit <submit-file> -dry-run -

this prints to stdout the job classad(s) that would have been submitted without actually submitting the job(s) to the schedd.

-tj

-----Original Message-----
From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of Maarten Litmaath
Sent: Friday, July 24, 2020 9:58 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] using the Job Router for ARC CEs

No luck yet: once a string, always a string...

________________________________________
From: HTCondor-users [htcondor-users-bounces@xxxxxxxxxxx] on behalf of Maarten Litmaath [Maarten.Litmaath@xxxxxxx]
Sent: 24 July 2020 16:37
To: HTCondor-Users Mail List
Subject: Re: [HTCondor-users] using the Job Router for ARC CEs

Hi all,
I will try using substr() or other suggestions from the classad docs...

________________________________________
From: HTCondor-users [htcondor-users-bounces@xxxxxxxxxxx] on behalf of Maarten Litmaath [Maarten.Litmaath@xxxxxxx]
Sent: 24 July 2020 16:00
To: HTCondor-Users Mail List ‎[htcondor-users@xxxxxxxxxxx]‎
Subject: [HTCondor-users] using the Job Router for ARC CEs

Dear HTCondor users,
I am trying to configure the Job Router for ARC CEs (type "nordugrid"),
but did not manage to get the destination queue specification working.

I tried to imitate what is shown for Globus in the example configuration:

https://htcondor.readthedocs.io/en/latest/grid-computing/job-router.html#an-example-configuration

The Job Router accepts the following, lines folded for clarity:

==========
07/24/20 14:41:19 Parsing JOB_ROUTER_ENTRIES_CMD=[
GridResource = "nordugrid arc-ce.some.domain";
eval_set_GridResource = "nordugrid arc-ce.some.domain";
eval_set_nordugrid_rsl = "(queue=plugh)" ]

07/24/20 14:41:19 JobRouter Note: adding new route '[
set_remote_jobuniverse = 5;
eval_set_nordugrid_rsl = "(queue=plugh)";
MaxIdleJobs = 200; EditJobInPlace = true; MaxJobs = 20000;
GridResource = "nordugrid arc-ce.some.domain";
set_JobUniverse = 9;
eval_set_GridResource = "nordugrid arc-ce.some.domain";
delete_JobLeaseDuration = true;
requirements = target.WantJobRouter is true;
delete_WantJobRouter = true ]'
==========

In the output of "condor_q -l" for a routed job I then see this line:

nordugrid_rsl = "(queue=plugh)"

So far so good, yet the ARC CE reports there is no queue defined:

HoldReason = "globus_ftp_client: the server responded with an error
451 Request has no queue defined."

Indeed, the HTCondor documentation for the "nordugrid" type does
not have double quotes in the "nordugrid_rsl" specification:

https://htcondor.readthedocs.io/en/latest/grid-computing/grid-universe.html#the-nordugrid-grid-type

So, it seems the ARC CE is exactly getting the RHS of that expression
and cannot deal with it.  Right, let's try without the double quotes then:

==========
07/24/20 14:40:19 Parsing JOB_ROUTER_ENTRIES_CMD=[
GridResource = "nordugrid arc-ce.some.domain";
eval_set_GridResource = "nordugrid arc-ce.some.domain";
eval_set_nordugrid_rsl = (queue=plugh) ]

07/24/20 14:40:19 JobRouter CONFIGURATION ERROR:
Ignoring the malformed route entry in JOB_ROUTER_ENTRIES_CMD,
at offset 0 starting here:
[ GridResource = "nordugrid arc-ce.some.domain"; eval_set_GridResource = "no
==========

Now it appears the Job Router cannot accept a bare RHS...

Is there a "trick" to get the correct syntax into the JDL via the Job Router?



I have already tried using a '+' definition in the original JDL instead;
the following is accepted, but has the same issue with the double quotes:

+nordugrid_rsl = "(queue=plugh)"

Without the double quotes it is rejected by condor_submit:

ERROR: Parse error in expression:
        nordugrid_rsl = (queue=plugh)



Thanks for any tips!

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/