[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Core usage of cluster



Hi Sean,

The condor_q ârun command shows you running jobs, not idle, held, etc.

 

The condor_q ârun âautoformat RequestCpus command shows you the number of CPU cores requested by each job that is currently running.

 

If you add the âCpusâ value to the SYSTEM_JOB_MACHINE_ATTRS configuration value, each job will also include a âMachineAttrCpus0â attribute which will show how many CPU cores the job actually got, though this would be identical to RequestCpus unless youâre using Brian Bockelmanâs supremely clever resizable-jobs trick.

 

( Iâm using that trick here for CST Microwave Studio because that software claims CPU cores based on processor >sockets< with a user-specified maximum core count per socket. Mine currently arenât the same because the default non-matched context of âCpusâ for the CST jobs is 40 but the machine has 48 claimable cores in its two sockets, so MachineAttrCpus0 is 48. )

 

Now, to add each jobâs CPU count together:

 

condor_q ârun âautoformat RequestCpus | paste -s -d+ | bc

 

And thatâs the total number of CPU cores in use by running jobs.

 

Michael V. Pelletier
Information Technology
Digital Transformation & Innovation
Integrated Defense Systems
Raytheon Company

 

From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of Sean Crosby
Sent: Friday, August 24, 2018 7:16 AM
To: condor-users@xxxxxxxxxxx
Subject: [External] [HTCondor-users] Core usage of cluster

 

Hi all,

 

I have come from a Torque/Maui background, where it is easy to show how many cores in the cluster are currently being used

 

[root@agtorque ~]# showq | grep "Active Jobs" -A1

   108 Active Jobs     423 of  452 Processors Active (93.58%)

                        21 of   21 Nodes Active      (100.00%)

 

Is there an easy way to get this info in Condor?

 

I can get slots easily, but that doesn't show how many cores are being used

 

[root@ce1atlas ~]# condor_status -state -total

 

                      Machines Owner Unclaimed Claimed Preempting Matched  Drain

 

                Busy         0     0         0     243          0       0      0

                Idle         0    12        68       0          0       0      0

 

               Total         0    12        68     243          0       0      0

 

Cheers,

Sean