[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] dynamic hierarchical group quotas clarification / python APÏ ?



Hi,

 

the htcondor doc states :

“Note that a job specifying a value for the AccountingGroup ClassAd attribute that lacks at least one period in the specification will cause the job to not be considered part of a group when negotiating, even if the group name (highest within the hierarchy) has a quota. Furthermore, there will be no warnings that the group quota is not in effect for the job, as this syntax defines group accounting.”

 

A bit further in the doc , it is said “the (…)remaining machine assigned to job submitters in the parent group, group_stat

 

I’d like to ask if it would be possible to give an exemple/clarify this first paragraph ?

I indeed thought the first paragraph might explain the atlas effective quota (0) bellow, but the 2nd paragraph seems to mean that even if the subgroup is wrong, the primary group quota would be used… ?

 

# condor_userprio -all

Last Priority Update:  6/25 14:13

Group                               Effective  Config     Use    Subtree   Effective     Real   Priority   Res   Total Usage       Usage             Last       Time Since Requested

  User Name                           Quota     Quota   Surplus   Quota     Priority   Priority  Factor   In Use (wghted-hrs)    Start Time       Usage Time    Last Usage Resources

----------------------------------- --------- --------- ------- --------- ------------ -------- --------- ------ ------------ ---------------- ---------------- ---------- ----------

group_atlas                              0.00      0.33 Regroup    487.95               1176.82 100000.00   1320   1037210.12  9/10/2014 11:25  6/25/2015 14:13      <now>       1192

  admin@xxxxxxxxxxxxxxx                                                       50000.00     0.50 100000.00      0       908.85  9/10/2014 11:39  6/25/2015 10:15    0+03:58

  pilot@xxxxxxxxxxxxxxx                                                       50000.00     0.50 100000.00      0       880.15  9/10/2014 11:25  6/25/2015 10:22    0+03:51

  production@xxxxxxxxxxxxxxx                                              117682032.00  1176.82 100000.00   1320   1035432.88  9/10/2014 12:07  6/25/2015 14:13      <now>

group_alice                             80.23      0.05 Regroup     80.23                  2.00 100000.00      2    298768.59  2/11/2015 07:47  6/25/2015 14:13      <now>          2

  pilot@xxxxxxxxxxxxxxx                                                       50000.00     0.50 100000.00      0       219.64  2/11/2015 11:25  6/25/2015 10:11    0+04:01

  admin@xxxxxxxxxxxxxxx                                                      200000.00     2.00 100000.00      2    298548.22  2/11/2015 07:47  6/25/2015 14:13      <now>

group_cms                              304.51      0.21 Regroup    304.51                 17.00 100000.00     17    560510.19  9/22/2014 19:10  6/25/2015 14:13      <now>         17

  admin@xxxxxxxxxxxxxxx                                                       50000.00     0.50 100000.00      0       978.47  9/22/2014 19:40  6/25/2015 14:04    0+00:08

  production@xxxxxxxxxxxxxxx                                                  50000.00     0.50 100000.00      0       749.61  9/22/2014 19:20  6/25/2015 09:58    0+04:15

  pilot@xxxxxxxxxxxxxxx                                                     1700119.25    17.00 100000.00     17    558788.19  9/22/2014 19:10  6/25/2015 14:13      <now>

<none>                                1464.00      0.00 yes       1464.00                  0.50 100000.00      0       869.46  7/29/2014 16:27  6/25/2015 14:10    0+00:02          0

  group_ops@xxxxxxxxxxxxxxx                                                   50000.00     0.50 100000.00      0        29.12  7/31/2014 08:26  6/25/2015 10:23    0+03:50

  group_alice@xxxxxxxxxxxxxxx                                                 50000.00     0.50 100000.00      0       180.65  2/11/2015 10:52  6/25/2015 10:07    0+04:05

  group_ops.admin@xxxxxxxxxxxxxxx                                             50000.00     0.50 100000.00      0       652.60  7/30/2014 17:21  6/25/2015 14:10    0+00:02

----------------------------------- --------- --------- ------- --------- ------------ -------- --------- ------ ------------ ---------------- ---------------- ---------- ----------

Number of users: 11                                     Regroup                                             1339   1897368.50                   6/24/2015 14:14    0+23:59

 

 

Now concerning the API : I’d like to graph the user priorities using graphite so that I can tell at once who has the highest priority just looking at one graph – and I’d also like to graph quotas to see how they evolve compared to the priorities to see if anything is not working as expected…

Unfortunately, I don’t see anything in the pyhon (or perl ?) bindings that would enable me to graph quotas (I only see the getPriorities() function…) : any idea ?

 

(condor 8.2 here)

 

Thanks && regards

Frederic