[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] Schedd Overloaded??




Hello,

How are you queuing your jobs? Each time condor_submit runs it tells the scheduler to start the negotiation cycle. If you're running the negotiator on the same machine, this could cause trouble.

Here's a presentation that talks about using dagman to keep the queue down, and using SIGNIFICANT_ATTRIBUTES to help the negotiator:
http://www.nesc.ac.uk/talks/438/12th/deploying_large_pools.ppt

Pawel



"Sean Looper" <slooper@xxxxxxxxxxxxxxxxxxxx>
Sent by: condor-users-bounces@xxxxxxxxxxx

07/11/2005 02:36 PM
Please respond to Condor-Users Mail List

       
        To:        "Condor-Users Mail List" <condor-users@xxxxxxxxxxx>
        cc:        
        Subject:        [Condor-users] Schedd Overloaded??



I have a remote schedd with 9000+ jobs.  The schedd is continually running at 100% cpu.  I am hoping to gain some suggestions on how to improve the efficiency of the schedd.  
 
Do I need to split the jobs between schedds on 2 or 3 more machines?  
 
Would it help significantly to move the negotiator and collector to another machine?
 
Are there ways to speed up the schedd so that it does not take as long to run through the job queue?
 
I am using Condor 6.7.7 with a nearly out-of-the-box config.
 
Thanks!
 
Sean_______________________________________________
Condor-users mailing list
Condor-users@xxxxxxxxxxx
https://lists.cs.wisc.edu/mailman/listinfo/condor-users




*************************************************************************
PRIVILEGED AND CONFIDENTIAL: This communication, including attachments, is
for the exclusive use of addressee and may contain proprietary,
confidential and/or privileged information. If you are not the intended
recipient, any use, copying, disclosure, dissemination or distribution is
strictly prohibited. If you are not the intended recipient, please notify
the sender immediately by return e-mail, delete this communication and
destroy all copies.
*************************************************************************