[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] Remote Submit Scheds with grid submission to CondorCE
- Date: Thu, 11 Feb 2021 11:29:13 -0600
- From: Brian Lin <blin@xxxxxxxxxxx>
- Subject: Re: [HTCondor-users] Remote Submit Scheds with grid submission to CondorCE
If there's no local Schedd/Gridmanager but your users have access to
condor_submit, then you can run something like:
condor_submit -remote <CE FQDN> -pool <CE FQDN>:<CE
PORT> <vanilla universe submit file>
This is effectively what condor_ce_trace  and condor_ce_run 
do. However, there are a few caveats to this method of submission:
- HTCondor-CE is designed with pilot jobs in mind, not user jobs.
This doesn't mean that users can't submit their jobs to a CE, it's
just that the CE may be very aggressive in job cleanup in ways that
are unfriendly to end users
- X.509 proxies will be sent initially but renewals will not be
forwarded on (assuming x509userproxy/use_x509userproxy are set
- Users will not to run commands to fetch their output, making this
method particularly ineffective for long workflows
On 2/11/21 11:13 AM, Thomas Hartmann
maybe I am overthinking it, but AFAIS the problem is the remote
submit needing to forward the proxy
The user servers are as remote submitters not running a local
schedd but only forward the jobs to the actual schedulers. I am
not sure, if the X509s are forwarded, or?
On 11/02/2021 18.09, Maarten Litmaath wrote:
could it be as simple as using a JDL like this:
cmd = ...
output = ...
error = ...
log = ...
+TransferOutput = ""
periodic_hold = ...
periodic_remove = ...
universe = grid
grid_resource = condor htc-ce.some.domain
use_x509userproxy = true
environment = ...
That is how ALICE let a local HTCondor service deal with all
the intricacies of handling jobs for remote HTCondor CEs.
Maybe I am missing something?
From: HTCondor-users [htcondor-users-bounces@xxxxxxxxxxx] on
behalf of Thomas Hartmann [thomas.hartmann@xxxxxxx]
Sent: 11 February 2021 17:46
To: HTCondor-Users Mail List
Subject: [HTCondor-users] Remote Submit Scheds with grid
submission to CondorCE
does somebody has maybe already experiences with combining
submission with gridward submission to CondorCEs?
Thing is, that we have a number of nodes for our users, that act
remote submitters to the actual schedulers.
Now it would come handy, not only to submit to the local Condor
allow our users to do submissions into the Grid targeting
Since the Schedd would have to do the authentication through the
proxy X509, it would need to be passed forward like kerberos
And are there other caveats, that might need to be considered in
Maybe somebody has already a working similar setup?
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
You can also unsubscribe by visiting
The archives can be found at: