Re: [HTCondor-users] ResidentSetSize report on Almalinux 9 and condor 10.5.0//23.0.0//23.0.1

[Carles Acosta <cacosta@xxxxxx>]

Hi Thomas, Greg,

Thank you for your responses.Â

I didn't check memory.peak before and it is comparable to what is reported as MemoryUsage for AlmaLinux9, not CentOs7 (I use a different example for CentOs7 because the other one has finished).

Alma9

[root@td807 ~]# cat /sys/fs/cgroup/htcondor/condor_home_execute_slot1_10\@td807.pic.es/memory.current
2426515456
[root@td807 ~]# cat /sys/fs/cgroup/htcondor/condor_home_execute_slot1_10\@td807.pic.es/memory.peak
9710202880

# condor_q 22018463.0 -af ResidentSetSize_RAW/1024 MemoryUsage RequestMemory RemoteHost
8662 9766 3500 slot1_10@xxxxxxxxxxxx

CentOs7Â

[root@tds410 ~]# cat /sys/fs/cgroup/memory/system.slice/condor.service/condor_home_execute_slot1_24\@tds410.pic.es/memory.usage_in_bytes
3476918272

[root@tds410 ~]# cat /sys/fs/cgroup/memory/system.slice/condor.service/condor_home_execute_slot1_24\@tds410.pic.es/memory.max_usage_in_bytes
7336988672

# condor_q 19602512.0 -af ResidentSetSize_RAW/1024 MemoryUsage RequestMemory RemoteHost
3312 3418 3500 slot1_24@xxxxxxxxxxxxx

Greg, I'm sending you the StarterLog privately.

Thank you again.

Carles

On Wed, 21 Feb 2024 at 16:44, Greg Thain <gthain@xxxxxxxxxxx> wrote:

On 2/21/24 05:10, Carles Acosta wrote:

Hi,

I just want to comment that I continue to observe the memory issue with HTCondor and EL9. I cannot rely on adding MEMORY_EXCEED conditions in HTCondor/AlmaLinux9.Â

Let me show you another example with Atlas jobs, both a top-xaod execution.

Alma9 WNÂ

* HTCondor version 23.0.3

* RES memory according to top: 3 GB

* ResidentSetSize according to condor:

# condor_q 22018463.0 -af ResidentSetSize_RAW/1024 MemoryUsage RequestMemory RemoteHost
8662 9766 3500 slot1_10@xxxxxxxxxxxx

Hi Carles -- this is really odd. Can you send me (directly), the StarterLog.slotXXX that corresponds to this job? Also, I assume that the cgroup memory.peak is roughly the same as memory.current?

-greg

--

Carles Acosta i Silva

PIC (Port d'Informacià CientÃfica)

Campus UAB, Edifici D

E-08193 Bellaterra, Barcelona

Tel: +34 93 581 33 08

Fax: +34 93 581 41 10

http://www.pic.esÂ

AvÃs - Aviso - Legal Notice: Âhttp://legal.ifae.es