[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: [Condor-users] meaning of condor_stats output



this indicates that, for the local pool, at the specified times the specified user had 0 running jobs and 1 queued job.

without a time period I believe it defaults to last hour.

1) do you have multiple pools (even unintentionally)?

2) are you getting stats in a useful time period (i.e. change the time period or run it while the jobs are running)

if you had 3 jobs and 2 machines you might get output like (comments  prefiixed by #)...

1092043363      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    0       0
# submitted your jobs
1092043604      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    0       3
1092043844      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    0       3
# 1 st job starts
1092044084      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    1       2
# 2 nd job starts
1092044190      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    2       1
# 1 st job finishes
1092045060      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    1       1
# 3 rd job starts
1092056011      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    2       0
1092057300      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    2       0
# 3 rd job finishes
1092058760      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    1       0
# 2 nd job finishes
1092059720      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :    0       0

You may find that steps get missed (if changes happen within timescales smaller than the sampling period)

Essentially it is providing snapshots of (a very restricted view of) state at the particular time...

the orgformat lets you see precise time, the percentage view makes graphing and other visual representations easier to do from scripts (though you could achieve the same effect and more without too much effort if you were parsing the output yourself with a full featured language)

Matt

> -----Original Message-----
> From: condor-users-bounces@xxxxxxxxxxx
> [mailto:condor-users-bounces@xxxxxxxxxxx]On Behalf Of Dr Ian C. Smith
> Sent: 10 August 2004 10:58
> To: Condor-Users Mail List
> Subject: RE: [Condor-users] meaning of condor_stats output
> 
> 
> stats on users
> 
> -ian.
> 
> --On 10 August 2004 10:44 +0100 Matt Hope <Matt.Hope@xxxxxxxx> wrote:
> 
> > are you attempting to determine stats on *jobs* or on users.
> >
> > condor_stats seems designed for the latter...
> >
> >> -----Original Message-----
> >> From: condor-users-bounces@xxxxxxxxxxx
> >> [mailto:condor-users-bounces@xxxxxxxxxxx]On Behalf Of Dr 
> Ian C. Smith
> >> Sent: 10 August 2004 10:27
> >> To: Condor-Users Mail List
> >> Subject: Re: [Condor-users] meaning of condor_stats output
> >>
> >>
> >> Hi Alain,
> >>
> >> I'm still totally confused as to how to interpret this. Say I have
> >> submitted three condor jobs during the period in question, which
> >> run for  tr1, tr2 and tr3 seconds and are idle for ti1, ti2 and ti3
> >> seconds how might this appear using -orgformat. An example of
> >> my -orgformat
> >> output looks like
> >>
> >>
> >> > 1092043363      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :
> >>     0       1
> >> > 1092043604      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :
> >>     0       1
> >> > 1092043844      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :
> >>     0       1
> >> > 1092044084      civsp@xxxxxxxxx/coastalre02.liv.ac.uk   :
> >>     0       1
> >> [snip]
> >>
> >> I'd like to create a script to produce usage reports. Is 
> condor_stats
> >> the best way of doing this or would I need to parse the 
> history files
> >> myself (is the format of these documented anywhere).
> >>
> >> thanks,
> >>
> >> -ian.
> >>
> >>
> >> --On 09 August 2004 09:47 -0700 Alain Roy <roy@xxxxxxxxxxx> wrote:
> >>
> >> >
> >> >> Can anyone explain what the output of condor_stats indicates.
> >> >
> >> > The manual page is confusing, but I think that all of the
> >> information is
> >> > there--I apologize for the confusing text.
> >> >
> >> > The output is terse because it is meant for input into a
> >> script that can
> >> > turn the data into pretty graphs. Probably we should 
> make a verbose
> >> > option.
> >> >
> >> >> I've had a read of the man pages but I still can't work
> >> >> it out. For example what does this mean:
> >> >>
> >> >> $ /opt/condor/bin/condor_stats   -userquery
> >> >> tcadmin2@xxxxxxxxx/239032-mstc22.liv.ac.uk
> >> >> 96.62   1       0
> >> >> 96.90   1       0
> >> >> 97.17   0       0
> >> >> 97.45   0       0
> >> >> 97.73   0       0
> >> >> 98.01   0       0
> >> >> 98.28   0       0
> >> >
> >> > I assume that's a subset of the data. You should have
> >> numbers ranging
> >> > from close to zero to close to 100 in the first column.
> >> >
> >> > First column:
> >> >
> >> >> The first column always represents the time, as a 
> percentage of the
> >> >> range  of the query. Thus the first entry will have a
> >> value close to
> >> >> 0.0, while  the last will be close to 100.0. If the
> >> -orgformat option is
> >> >> used, the  time is displayed as number of seconds since
> >> the Unix epoch.
> >> >> The  information in the remainder of the columns depends
> >> on the query
> >> >> type.
> >> >
> >> > You may find it easier to interpret with the -orgformat argument.
> >> >
> >> > Next two columns:
> >> >
> >> >> The information displayed includes the number of running
> >> jobs and the
> >> >> number of idle jobs.
> >> >
> >> > So you have:
> >> >
> >> > time running-jobs idle-jobs
> >> >
> >> > -alain
> >> >
> >> >
> >> > _______________________________________________
> >> > Condor-users mailing list
> >> > Condor-users@xxxxxxxxxxx
> >> > http://lists.cs.wisc.edu/mailman/listinfo/condor-users
> >>
> >>
> >> _______________________________________________
> >> Condor-users mailing list
> >> Condor-users@xxxxxxxxxxx
> >> http://lists.cs.wisc.edu/mailman/listinfo/condor-users
> >>
> >
> >
> > *****************************************************************
> > Gloucester Research Limited believes the information
> > provided herein is reliable. While every care has been
> > taken to ensure accuracy, the information is furnished
> > to the recipients with no warranty as to the completeness
> > and accuracy of its contents and on condition that any
> > errors or omissions shall not be made the basis for any
> > claim, demand or cause for action.
> > *****************************************************************
> >
> > _______________________________________________
> > Condor-users mailing list
> > Condor-users@xxxxxxxxxxx
> > http://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> 
> _______________________________________________
> Condor-users mailing list
> Condor-users@xxxxxxxxxxx
> http://lists.cs.wisc.edu/mailman/listinfo/condor-users
>