[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Condor Watch Queue Announcement



Hi, David.

 

condor_watch_q from 8.9 can be used to watch jobs in an 8.8 Schedd, but it relies on

fairly extensive changes to the HTCondor helper libraries, so there isnât much chance

the tool itself will ever be back-ported to 8.8.

 

-tj

 

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of David Cohen
Sent: Sunday, December 6, 2020 4:32 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Cc: Eric LIN <zlin245@xxxxxxxx>
Subject: Re: [HTCondor-users] Condor Watch Queue Announcement

 

Hi,

Is there a chance that condor_watch_q will be backported to the 8.8 branch?

I'm in the process of migrating from torque to HTCondor and I'm missing a tool like that to get overall status of system load.

Today I'm using an homemade script that displays other the number of jobs, also how many cores and memory are requested by the jobs:

 

Total of 3310 Jobs Running on 3905 Cores, Using 3182GB of RAM Memory

USER        STATUS      QUEUE        JOBS        CORES      MEM(GB)    
user4       R         N             200         200        800
user5      R         N            1089        1089       1089
user6      R         N             388         388        776
user7        R         S              49          49         98
user1       R         N             350         350        350
pilatl12      R         atlas          15          15          0
pillhb02      R         lhcb            5           5         10
prdatl61      R         atlas        1197        1785          0
user8        R         P               2           9         44
user9         R         N              15          15         15

Total of 3764 Jobs Queued Waiting for 4338 Cores and 5949GB of RAM Memory

USER        STATUS      QUEUE        JOBS        CORES      MEM(GB)    
user7        Q         S            1952        1952       3904
user1       Q         N             893         893        893
pilatl01      Q         atlas           3           3          0
pilatl12      Q         atlas           3          10          0
pillhb02      Q         lhcb           10          10         20
prdatl61      Q         atlas         336         903          0
prdatl78      Q         atlas           1           1          0
prdlhb31      Q         lhcb            1           1          2
user2         Q         S             565         565       1130

 

 

Best,
David

 

 

On Tue, Sep 29, 2020 at 7:05 PM Eric LIN via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:

Hello all,

 

In HTCondor 8.9.8 we released a new tool, condor_watch_q, a live-updating job status tracker that does not repeatedly query the condor_schedd like "watch condor_q" would. condor_watch_q comes bundled with HTCondor itself, and it includes options for colored output, progress bars, and a minimal language for exiting when certain conditions are met. For full details, see the manual page. This tool is very new, and we would appreciate your testing and feedback on it.

 

Here are some screenshots of condor_watch_q in action, showing a few of the different display options:

 

image.png

 

image.png

 

Some more example usages:

 

$ condor_watch_q -h  #  print help message

$ condor_watch_q -users tannenba  # track user tannenba's jobs

$ condor_watch_q -clusters 1234 5678  # track jobs from clusters 1234 and 5678

$ condor_watch_q -users tannenba -clusters 1234 -groupby cluster  # track jobs that belong to tannenba or are in cluster 1234, and group rows by cluster ID

 

Eric Lin will be in charge of this project, for any feedback or inquiries feel free to contact: zlin245@xxxxxxxx

 

Thank you!

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/