[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] ENABLE_PERSISTENT_CONFIG brake my QUOTA Groups



Hi Ian :-)

here is my local config file on the submitter and Nego

CONDOR_HOST = $(FULL_HOSTNAME)
COLLECTOR_NAME = Personal Condor at $(FULL_HOSTNAME)
START = TRUE
SUSPEND = FALSE
PREEMPT = FALSE
KILL = FALSE
DAEMON_LIST = COLLECTOR, MASTER, NEGOTIATOR, SCHEDD
UID_DOMAIN            = Domain.com
COLLECTOR_NAME        = Domain
ALLOW_READ            = $(ALLOW_READ),  cpu*.Domain.com, appsrv.Domain.com
ALLOW_WRITE           = $(ALLOW_WRITE), cpu*.Domain.com, appsrv.Domain.com
SEC_CLIENT_AUTHENTICATION_METHODS = CLAIMTOBE, NTSSPI, PASSWORD
SEC_DEFAULT_AUTHENTICATION_METHODS = $(SEC_CLIENT_AUTHENTICATION_METHODS)
DAGMAN_LOG_ON_NFS_IS_ERROR = FALSE
FILESYSTEM_DOMAIN = Domain.com
USE_NFS                = True
ALLOW_ADMINISTRATOR = appsrv.Domain.com
NEGOTIATOR_CONSIDER_PREEMPTION = True
CLAIM_WORKLIFE = 0
QUEUE_SUPER_USERS = root, condor, sassy.natan@xxxxxxxxxx, azhar.sharoof@xxxxxxxxxx
NEGOTIATOR_DEBUG = D_FULLDEBUG
NEGOTIATOR_INTERVAL = 30
SCHEDD_INTERVAL = 15
GROUP_QUOTA_ROUND_ROBIN_RATE = 1
GROUP_ACCEPT_SURPLUS = FALSE
NEGOTIATE_ALL_JOBS_IN_CLUSTER = TRUE
NEGOTIATOR_USE_SLOT_WEIGHTS = FALSE
HOSTALLOW_ADMINISTRATOR = appsrv.Domain.com
HOSTALLOW_CONFIG = appsrv.Domain.com
HOSTALLOW_NEGOTIATOR = appsrv.Domain.com
SETTABLE_ATTRS_CONFIG = *
SETTABLE_ATTRS_ADMINISTRATOR = *
QUEUE_ALL_USERS_TRUSTED = False
ENABLE_SOAP = True
ALLOW_SOAP=*
WEB_ROOT_DIR = /etc/condor/web
ENABLE_WEB_SERVER = True
CONDOR_AGENT = /opt/condor_agent/condor_agent
CONDOR_AGENT_ENVIRONMENT = "CONDOR_BIN_PATH=$(BIN)"
DAEMON_LIST = $(DAEMON_LIST), CONDOR_AGENT
CONDOR_AGENT_PORT = 8008
CYCLE_AGENT_PORT = $(CONDOR_AGENT_PORT)
SCHEDD_ATTRS = CONDOR_AGENT_PORT, CONDOR_AGENT_SUBMIT_DIR, CYCLE_AGENT_PORT, $(SCHEDD_ATTRS)
ENABLE_HISTORY_ROTATION = True
MAX_HISTORY_LOG = 4000000
MAX_HISTORY_ROTATIONS = 5
LOCAL_CONFIG_FILE = "$(BIN)/cache_config.py $(LOCAL_DIR)/lib/condor/cached_config 0 0 http://condor:8080/condor/assigned_template/$(FULL_HOSTNAME)" |


However, when commenting the:

# ENABLE_RUNTIME_CONFIG = True
# ENABLE_PERSISTENT_CONFIG = True
# PERSISTENT_CONFIG_DIR = /etc/condor/attributes

The CycleServer gives error when adding group under the Group Menu


Here is the log:

011-09-14 18:38:43,498 INFO [com.cyclecomputing.web.error.LoggingErrorHandler request-1969] - **BEGIN request to /admin/save_group_quotas.s on session 1666C83531BBA15CCB06848A90AB95EE
2011-09-14 18:38:43,504 ERROR [com.cyclecomputing.grid.common.plugin.PluginServlet request-1969] - Error while processing request
java.lang.NumberFormatException: empty String
        at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1012)
        at java.lang.Double.valueOf(Double.java:492)
        at com.cyclecomputing.grid.admin.groupquotas.GroupQuotasUtilities.readDouble(GroupQuotasUtilities.java:255)
        at com.cyclecomputing.grid.admin.groupquotas.GroupQuotasUtilities.decode(GroupQuotasUtilities.java:126)
        at com.cyclecomputing.grid.admin.groupquotas.SaveGroupQuotasController.handle(SaveGroupQuotasController.java:34)
        at com.cyclecomputing.web.ui.OperationController.getStatus(OperationController.java:122)
        at com.cyclecomputing.web.ui.OperationController.handleRequestInternal(OperationController.java:58)
        at org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
        at com.cyclecomputing.web.action.ControllerRestlet.delegate(ControllerRestlet.java:114)
        at com.cyclecomputing.web.action.ControllerRestlet$Resource.handle(ControllerRestlet.java:106)
        at com.cyclecomputing.web.action.ControllerRestlet$Resource.handlePost(ControllerRestlet.java:85)
        at com.cyclecomputing.apex.rest.plugin.FilteredHandler.handle(FilteredHandler.java:92)
        at com.cyclecomputing.apex.rest.plugin.FilteredHandler.handlePost(FilteredHandler.java:57)
        at org.restlet.Finder.handle(Finder.java:357)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at org.restlet.Filter.handle(Filter.java:195)
        at org.restlet.Router.handle(Router.java:504)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at org.restlet.Filter.handle(Filter.java:195)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at org.restlet.Filter.handle(Filter.java:195)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at org.restlet.Filter.handle(Filter.java:195)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at com.noelios.restlet.StatusFilter.doHandle(StatusFilter.java:130)
        at org.restlet.Filter.handle(Filter.java:195)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at org.restlet.Filter.handle(Filter.java:195)
        at com.noelios.restlet.ChainHelper.handle(ChainHelper.java:124)
        at com.noelios.restlet.application.ApplicationHelper.handle(ApplicationHelper.java:112)
        at org.restlet.Application.handle(Application.java:341)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at org.restlet.Filter.handle(Filter.java:195)
        at org.restlet.Router.handle(Router.java:504)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at org.restlet.Filter.handle(Filter.java:195)
        at org.restlet.Router.handle(Router.java:504)
        at org.restlet.Filter.doHandle(Filter.java:150)
        at org.restlet.Filter.handle(Filter.java:195)
        at com.noelios.restlet.ChainHelper.handle(ChainHelper.java:124)
        at org.restlet.Component.handle(Component.java:673)
        at org.restlet.Server.handle(Server.java:331)
        at com.noelios.restlet.ServerHelper.handle(ServerHelper.java:68)
        at com.noelios.restlet.http.HttpServerHelper.handle(HttpServerHelper.java:147)
        at com.noelios.restlet.ext.servlet.ServerServlet.service(ServerServlet.java:881)
        at com.cyclecomputing.grid.common.plugin.PluginServlet.service(PluginServlet.java:115)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        at org.springframework.web.servlet.handler.SimpleServletHandlerAdapter.handle(SimpleServletHandlerAdapter.java:63)
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:857)
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:792)
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:475)
        at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:440)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at com.cyclecomputing.web.error.ErrorHandlerFilter.doFilter(ErrorHandlerFilter.java:63)
        at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:138)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:852)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
        at java.lang.Thread.run(Thread.java:636)
2011-09-14 18:38:43,506 INFO [com.cyclecomputing.web.ui.UserInterfaceView request-1969] - Loaded transform in 0 ms
2011-09-14 18:38:43,525 INFO [com.cyclecomputing.web.ui.AbstractXsltView request-1969] - Transformed in 14 ms
2011-09-14 18:38:43,525 INFO [com.cyclecomputing.web.ui.UserInterfaceView request-1969] - Handled UI portion of response in 20 ms
2011-09-14 18:38:43,525 INFO [org.restlet.Component.LogService request-1969] - 2011-09-14       18:38:43        172.18.0.75     -       172.16.0.5      8080    POST    /admin/save_group_quotas.s      -       500     302     178     26      http://condor:8080      Mozilla/5.0 (Windows NT 6.1) AppleWebKit/535.1 (KHTML, like Gecko) Chrome/13.0.782

The tools seems to make a lot of problems... :-(

I also getting from the cache_util errors about file locking..... so like when restart condor I see in the Nego log that the file return ZERO configuration even that I configure a template an attach to the machine
From the command line the cache_util  return the output of the template and also condor_config_val -dump give it

Thanks


Sassy 

On Wed, Sep 14, 2011 at 5:54 PM, Ian Chesal <ichesal@xxxxxxxxxxxxxxxxxx> wrote:
On Wednesday, 14 September, 2011 at 10:31 AM, Sassy Natan wrote:
Hi,

I'm using the CycleServer with the ENABLE_PERSISTENT_CONFIG=True

However this brake the  Condor QUOTA Groups options.

I don't know why, but when setting this option on - the group stop working.

Can someone drop a comment here?
Hi Sassy,

My suggestion is drop the use of ENABLE_PERSISTENT_CONFIG and instead of using the Grid -> Group Quotas screen to configure groups and quotas in your pool, use a template section.

Write out the Condor config that describes your groups and the quotas in a template section and then apply that section to the template your negotiator uses.

The whole persistent configuration technology is difficult to get working correctly. It can lead to some very confusing behaviour and on the whole it isn't nearly as maintainable as the good old Condor configuration file method for configuring Condor.

Let me know if that doesn't solve your problem.

Regards,
- Ian

---
Ian Chesal

Cycle Computing, LLC
Leader in Open Compute Solutions for Clouds, Servers, and Desktops
Enterprise Condor Support and Management Tools

http://www.cyclecomputing.com
http://www.cyclecloud.com
http://twitter.com/cyclecomputing
 


_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/