Re: [HTCondor-users] accurate way to query the number of jobs globally

[Pek Daniel <pekdaniel@xxxxxxxxx>]

Hi,

Okay, you're right, I can't have more than 100k running jobs at the
moment (which is the current number of jobslots), which reduces the
amount of output. But I think if there's no other alternative with the
user tools, I'm still better off with a little python script which
counts the jobs... It don't have to be 'super-precise', but more like
'10sec precise'. condor_status -schedd is '5minute-precise' :)

At the moment, I need the sum of the running jobs, I don't need any
user-related info.

Thanks,
Daniel

2014-02-28 16:06 GMT+01:00 Steffen Grunewald <Steffen.Grunewald@xxxxxxxxxx>:
> On Fri, Feb 28, 2014 at 03:45:58PM +0100, Pek Daniel wrote:
>> Thanks guys!
>>
>> Steffen: if you have 10 million jobs, then condor_q have to process
>> and stream out to the pipe 10M * 80 (columns per line) = 800MByte of
>> data, and after wc -l have to read the whole thing just to get a
>> single number in the end. It sounds a bit of overshooting. But it's
>> possible that it's the best I can do....
>
> That's where the -constraint enters the stage. (If you actually have
> 10 million slots in your pool, I'd like to see the central manager
> machine...)
> And specifying a username would reduce the number of lies further.
> Speaking of stale information: the time it takes condor_q to run may
> be long enough to give you inaccurate counts as well. TBH I'm not
> aware of any *precise* tool, and I never needed one.
>
>> Tim: that's what you have on condor_status -schedd output is most of
>> the time stale data. For example when I remove all my jobs from the
>> cluster, it still shows wrong numbers for a while (minutes), didn't
>> get updated instantly, even if condor_q -global already shows empty
>> queue.
>
> AFAICT condor_status -schedd won't tell you about users - it's no "one
> size fits all" (even without that delay) - but it provides a nice
> summary of available submit machines almost forgotten :)
>
>
> - S
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/