Re: [HTCondor-users] submission to Condor CE from a remote submit Condor node

[Thomas Hartmann <thomas.hartmann@xxxxxxx>]

thanks ;)

thing is, that our workgroup servers, that I have been misusing for
testing, are not their own schedulers but do remote submissions to the
actual schedulers. And their the jobs are churned through some job
transforms, which probably do not make things easier ð

So, I tried in the emantime to spawn a very basic VM and setup a simple
schedd there, whose task should only be sending the job to the CE's
collector. Unfortunately, I am now somewhat stuck in how to properly
configure the schedd ð



On 16/07/2020 16.16, Maarten Litmaath wrote:
> Hi Thomas,
> here is how ALICE submit to HTCondor CEs: via local HTCondor instances,
> indicating the target CE and letting the local HTCondor do the hard work...  :-)
> JDL snippet:
> 
> cmd = ...
> output = ...
> error  = ...
> log = ...
> universe = grid
> grid_resource = condor ce.some.domain ce.some.domain:9619
> +TransferOutput = ""
> use_x509userproxy = true
> 
> ________________________________________
> From: HTCondor-users [htcondor-users-bounces@xxxxxxxxxxx] on behalf of Thomas Hartmann [thomas.hartmann@xxxxxxx]
> Sent: 16 July 2020 15:52
> To: HTCondor-Users Mail List
> Subject: [HTCondor-users] submission to Condor CE from a remote submit  Condor node
> 
> Hi again,
> 
> is it actually (easily?) possible to submit from a remote submit node to
> a Condor CE?
> 
> bkg: I am trying to submit jobs based on [1] to a HTCondorCE. I.e.,
> instead of a 'local' vanilla universe job, I want to submit the job as a
> grid-type job to a remote CE defined by 'grid_resource'. However, the
> jobs end up on the 'local' sched/cluster.
> 
> I guess the main problem is, that the submit node is actually a remote
> submitter with the actual schedd being on another host [3].
> 
> Since we have several job transforms on the actual schedds, I suppose
> one would need a transform there to divert grid-type jobs and forward
> them to the Condor CE, or?
> 
> Cheers,
>   Thomas
> 
> 
> [1]
>> cat HTCondorCE.submit
> universe = grid
> use_x509userproxy = true
> # +Owner = undefined
> grid_resource = condor grid-vm08.desy.de grid-vm08.desy.de:9619
> executable = mypayload.sh
> output = stdout
> error = stderr
> log = logs
> ShouldTransferFiles = YES
> WhenToTransferOutput = ON_EXIT
> queue
> 
> 
> [2]
>> condor_submit -debug HTCondorCE.submit
> 07/16/20 15:44:43 Can't open directory "/etc/condor/passwords.d" as
> PRIV_UNKNOWN, errno: 2 (No such file or directory)
> 07/16/20 15:44:43 Failed to decode JWT in keyfile
> '/afs/desy.de/user/h/hartmath/.condor/tokens.d/x509up_u26551'; ignoring.
> 07/16/20 15:44:43 Can't open directory "/etc/condor/passwords.d" as
> PRIV_UNKNOWN, errno: 2 (No such file or directory)
> Submitting job(s)07/16/20 15:44:43 CREDMON: invoking
> /var/lib/condor/util/get_token_cmd
> 07/16/20 15:44:44 CREDMON: storing cred for user hartmath@(null)
> 07/16/20 15:44:44 STORE_CRED: In mode 'add'
> 07/16/20 15:44:44 Can't open directory "/etc/condor/passwords.d" as
> PRIV_UNKNOWN, errno: 2 (No such file or directory)
> 07/16/20 15:44:44 Can't open directory "/etc/condor/passwords.d" as
> PRIV_UNKNOWN, errno: 2 (No such file or directory)
> 07/16/20 15:44:44 Can't open directory "/etc/condor/passwords.d" as
> PRIV_UNKNOWN, errno: 2 (No such file or directory)
> 07/16/20 15:44:44 Can't open directory "/etc/condor/passwords.d" as
> PRIV_UNKNOWN, errno: 2 (No such file or directory)
> .
> 1 job(s) submitted to cluster 7188018.
> 
> [3]
>> grep HOST /etc/condor/config.d/10rsubmit.conf
> CONDOR_HOST = bird-htc-master01.desy.de
> SCHEDD_HOST = bird-htc-sched11.desy.de
> CREDD_HOST = $(SCHEDD_HOST)
> 
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
>

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature