[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] Configuration of Accounting Groups



Hi,

 

I am trying to test/debug my accounting group and fairshare configuration. I have a setup with a HTCondorCE (simple-lc-node0), Batch(simple-lc-node1) and worker (simple-lc-node4)

 

In my CE, I have configured the job router to assign AccountingGroup ClassAd attribute to all incoming jobs. For instance,

```

[root@simple-lc-node0 ~]# condor_q -l 78 | grep -i acc

AccountingGroup = group_alice.alice_lcgadmin

```

I have configured my Batch with the following knobs to create accounting groups:

```

GROUP_AUTOREGROUP = True
PRIORITY_HALFLIFE = 86400
GROUP_ACCEPT_SURPLUS = True
GROUP_NAMES = group_alice, \
   group_alice.alice, \
   group_alice.alice_lcgadmin, \
   group_dteam, \
   group_dteam.dteam, \
   group_dteam.dteam_lcgadmin, \
   group_ops, \
   group_ops.ops, \
   group_ops.ops_lcgadmin
GROUP_QUOTA_DYNAMIC_group_alice = 0.4
GROUP_PRIO_FACTOR_group_alice = 10000.0
GROUP_QUOTA_DYNAMIC_group_alice.alice = 0.5
GROUP_QUOTA_DYNAMIC_group_alice.alice_lcgadmin = 0.5

GROUP_PRIO_FACTOR_group_dteam = 1000.0
GROUP_QUOTA_DYNAMIC_group_dteam = 0.3
GROUP_QUOTA_DYNAMIC_group_dteam.dteam = 0.5
GROUP_QUOTA_DYNAMIC_group_dteam.dteam_lcgadmin = 0.5

GROUP_PRIO_FACTOR_group_ops = 1000.0
GROUP_QUOTA_DYNAMIC_group_ops = 0.3
GROUP_QUOTA_DYNAMIC_group_ops.ops = 0.5
GROUP_QUOTA_DYNAMIC_group_ops.ops_lcgadmin = 0.5

```

I have then restarted condor master to apply these changes.

The collector logs print the following:

```

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_alicesimple-lc-node1.cern.ch >"

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_alice.alicesimple-lc-node1.cern.ch >"

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_alice.alice_lcgadminsimple-lc-node1.cern.ch >"

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_dteamsimple-lc-node1.cern.ch >"

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_dteam.dteamsimple-lc-node1.cern.ch >"

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_dteam.dteam_lcgadminsimple-lc-node1.cern.ch >"

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_opssimple-lc-node1.cern.ch >"

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_ops.opssimple-lc-node1.cern.ch >"

08/10/20 16:05:38 AccountingAd  : Inserting ** "< group_ops.ops_lcgadminsimple-lc-node1.cern.ch >"

```

 

In the HTCondor manual, https://htcondor.readthedocs.io/en/v8_9_7/admin-manual/user-priorities-negotiation.html#accounting-groups-with-hierarchical-group-quotas, it is mentioned that running condor_userprio -quotas can display the accounting groups in effect.

The output of the command on my batch is empty however.

```

[root@simple-lc-node1 ~]# condor_userprio -quotas

Last Priority Update:  8/10 16:10

                               Effective  Config     Use    Subtree  Requested

Group Name                       Quota     Quota   Surplus   Quota   Resources

------------------------------ --------- --------- ------- --------- ----------

------------------------------ --------- --------- ------- --------- ----------

Number of users: 1                                 Regroup

```

 

I was wondering if condor_userprio âquotas is the correct command to check for existing accounting groups or whether I have missed misconfigured my central manager? For the latter, I have gone through the HTCondor puppet module: https://github.com/HEP-Puppet/htcondor/blob/v2.4.3/templates/11_fairshares.config.erb and it seems I have defined the configuration knobs created by the puppet module.

 

I am fairly new to HTCondor, and any advice to point me in the right direction would be super helpful!

 

Thanks,

Mayank