[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] configuration of a curl option in the curl_plugin



Thanks a lot, Todd, this is really helpful!

I can access the variable I have defined in the jdl file:

environment = "CONDOR_CURL_OPTION_CAPATH=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/etc/grid-security-emi/certificates"

via the job.ad file.

I tested it ,in some hardcoded way.

I would like to implement it now properly, making use of what is already available in "multifile_curl_plugin.cpp."

The function "void MultiFileCurlPlugin::ParseAds()" seems like to be able to make the job [1].

I just modified it to retrieve the variable I am interested in.

I would now need to debug...

I can only see statements of the type "fprintf(stderr, "...");" in the code.

This is useful when I run the plugin in the shell, but not when running it via HTCondor.

Would you now an easy way to retrieve some information from "multifile_curl_plugin.cpp" into a log file?

My attempts with dprintf failed.

Thanks a lot in advance for your help!

Cheers,
Benoit
Â
[1] https://github.com/benoitroland/C4P-HTCondor/blob/main/src/condor_filetransfer_plugins/multifile_curl_plugin.cpp#L978
[2] https://github.com/benoitroland/C4P-HTCondor/blob/main/src/condor_filetransfer_plugins/multifile_curl_plugin.cpp#L1023

On 08/08/2023 00:20, Todd L Miller via HTCondor-users wrote:
But I guess this will only override the environment on the submit node, while the curl_plugin is running on the worker.

ÂÂÂÂIt actually only overrides the environment on the worker, but I don't know if it overrides the environment for the file-transfer plug-in. If it doesn't, the job ad may be made available in the sandbox (which should be the current working directory of the plug-in) with the file name ".job.ad", and you could pull an attribute from there.

- ToddM
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/