[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] local config of FILETRANSFER_PLUGINS not worked



Hi, 

Recently I find that the FILETRANSFER_PLUGINS seem take too much cpu when submit large mount of jobs at the same time and I don't need them like box_plugins, gdrive_plugins. So I add the following lines in my local config file

ENABLE_URL_TRANSFERS = FALSE
FILETRANSFER_PLUGINS=$(LIBEXEC)/curl_plugin, $(LIBEXEC)/data_plugin

without local config file, the condor_config_val -v ENABLE_URL_TRANSFERS FILETRANSFER_PLUGINS gives 

Not defined: ENABLE_URL_TRANSFERS

FILETRANSFER_PLUGINS = /usr/libexec/condor/curl_plugin, /usr/libexec/condor/data_plugin, /usr/libexec/condor/box_plugin.py, /usr/libexec/condor/gdrive_plugin.py, /usr/libexec/condor/onedrive_plugin.py
 # at: <Default>
 # raw: FILETRANSFER_PLUGINS = $(LIBEXEC)/curl_plugin, $(LIBEXEC)/data_plugin, $(LIBEXEC)/box_plugin.py, $(LIBEXEC)/gdrive_plugin.py, $(LIBEXEC)/onedrive_plugin.py

with local config file, the condor_config_val -v ENABLE_URL_TRANSFERS FILETRANSFER_PLUGINS gives 

ENABLE_URL_TRANSFERS = FALSE
 # at: /home/hzhang/.condor/user_config, line 1
 # raw: ENABLE_URL_TRANSFERS = FALSE

FILETRANSFER_PLUGINS = /usr/libexec/condor/curl_plugin, /usr/libexec/condor/data_plugin
 # at: /home/hzhang/.condor/user_config, line 2
 # raw: FILETRANSFER_PLUGINS = $(LIBEXEC)/curl_plugin, $(LIBEXEC)/data_plugin

However, I still find that during condor_submit, several subprocesses of box_plugin.py are called like

4147699 ?        R      0:00 python /usr/libexec/condor/gdrive_plugin.py -classad
4147727 ?        R      0:00 python /usr/libexec/condor/gdrive_plugin.py -classad
4147730 ?        R      0:00 python /usr/libexec/condor/box_plugin.py -classad
4147734 ?        R      0:00 python /usr/libexec/condor/box_plugin.py -classad

Are there anything I do wrong or are there any ways to disable the subprocess of *_plugin.py to be called

Thank you very much!

Zhang