[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-users] scaling problems with condor_negotiator



On 2/28/07, Smith, Ian <I.C.Smith@xxxxxxxxxxxxxxx> wrote:
Hi,

Does the negotiator treat a cluster as a single entity since all its
component process have the same requirements hence putting a smaller
load on it (I moved from cluster to individual jobs with the wrapper
script).

Been on holiday so only just seen this.

In 6.6 condor can treat clusters differently by considering a false
result for one job/node pair in a cluster a false result for that node
with the entire cluster (with a massive performance boost to
negotiation if enabled and clustering is heavily used).

The new features trialed in later 6.7 releases and added by default in
6.8 attempt to make such manual intervention unnecessary but I can't
remember off the top of my head if they still rely on clustering for
maximum benefit.

If you were previously sharing a job log per cluster note that you
will likely now be having far more file handles open from the submit
machine - though I would not expect that to cause the effect
described.

Matt