[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] If user submits 'zillion' jobs, will the condor system jam?



On Tue, 1 Dec 2009, Rob wrote:


Hi,

I'm in the process of setting up a condor system in a university library.
A number of students can have access to job submission.

What if a use (willingly or by mistake) submits a zillion jobs to the
master? Will this user be able to jam the condor pool for other users?
If now, how is this prevented, or how can this be prevented?

condor_submit will fall over and break the condor_schedd before it allows
the user to submit a zillion jobs.  you are basically prevented
from extra-high load by timeouts in the condor_schedd.  The limit
is a few thousand jobs, a few tens of thousands of jobs if you are
using the grid universe.  You could start more than that but once they
start finishing you will be in a world of hurt.

I don't want to stop submission of 'zillion' jobs, I only want to prevent
that the system will be running jobs of only that user......


The condor negotiator has the idea of "fair share" so that users who
are not using so many resources at the moment will have better priority
to run the next job, so condor takes care of that automatically.
If you have pre-emption enabled it will even kick off some of the jobs of
the zillion-job user and let some of the other users jobs start before
his jobs even finish.

Steve


Thanks,
Rob.



_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/


--
------------------------------------------------------------------
Steven C. Timm, Ph.D  (630) 840-8525
timm@xxxxxxxx  http://home.fnal.gov/~timm/
Fermilab Computing Division, Scientific Computing Facilities,
Grid Facilities Department, FermiGrid Services Group, Assistant Group Leader.