[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[HTCondor-users] Start HTCondor service under valgrind.



Hello, 

I'm trying to envistigate why condor_schedd crashed with valgrind but HTCondor daemon just refuses to start. Does it need some options to work correctly under valgrind?
HTCondor 9.0.9 is started inside Ubuntu docker container. When I replaced usual start command (/usr/sbin/condor_master) with valgrind HTCondor process just dies after 1.5 minutes.

Condor start command: valgrind --tool=memcheck --verbose --trace-children=yes --child-silent-after-fork=yes --trace-children-skip=/usr/bin/*,/bin/* --time-stamp=yes /usr/sbin/condor_master
Valgrind complete log:

==00:00:00:00.000 87== Memcheck, a memory error detector
==00:00:00:00.000 87== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al.
==00:00:00:00.000 87== Using Valgrind-3.15.0-608cb11914-20190413 and LibVEX; rerun with -h for copyright info
==00:00:00:00.000 87== Command: /usr/sbin/condor_master
==00:00:00:00.000 87== 
--00:00:00:00.000 87-- Valgrind options:
--00:00:00:00.000 87--    --tool=memcheck
--00:00:00:00.000 87--    --verbose
--00:00:00:00.000 87--    --trace-children=yes
--00:00:00:00.000 87--    --child-silent-after-fork=yes
--00:00:00:00.000 87--    --trace-children-skip=/usr/bin/*,/bin/*
--00:00:00:00.000 87--    --time-stamp=yes
--00:00:00:00.000 87-- Contents of /proc/version:
--00:00:00:00.000 87--   Linux version 5.11.0-43-generic (buildd@lcy02-amd64-036) (gcc (Ubuntu 9.3.0-17ubuntu1~20.04) 9.3.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #47~20.04.2-Ubuntu SMP Mon Dec 13 11:06:56 UTC 2021
--00:00:00:00.000 87-- 
--00:00:00:00.000 87-- Arch and hwcaps: AMD64, LittleEndian, amd64-cx16-lzcnt-rdtscp-sse3-ssse3-avx-avx2-bmi-f16c-rdrand
--00:00:00:00.000 87-- Page sizes: currently 4096, max supported 4096
--00:00:00:00.000 87-- Valgrind library directory: /usr/lib/x86_64-linux-gnu/valgrind
--00:00:00:00.000 87-- Reading syms from /usr/sbin/condor_master
--00:00:00:00.200 87-- Reading syms from /usr/lib/x86_64-linux-gnu/ld-2.31.so
--00:00:00:00.201 87--   Considering /usr/lib/x86_64-linux-gnu/ld-2.31.so ..
--00:00:00:00.201 87--   .. CRC mismatch (computed 975d0390 wanted 30bd717f)
--00:00:00:00.201 87--   Considering /lib/x86_64-linux-gnu/ld-2.31.so ..
--00:00:00:00.202 87--   .. CRC mismatch (computed 975d0390 wanted 30bd717f)
--00:00:00:00.202 87--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/ld-2.31.so ..
--00:00:00:00.400 87--   .. CRC is valid
--00:00:00:00.700 87-- Reading syms from /usr/lib/x86_64-linux-gnu/valgrind/memcheck-amd64-linux
--00:00:00:00.700 87--    object doesn't have a symbol table
--00:00:00:00.700 87--    object doesn't have a dynamic symbol table
--00:00:00:01.000 87-- Scheduler: using generic scheduler lock implementation.
--00:00:00:01.002 87-- Reading suppressions file: /usr/lib/x86_64-linux-gnu/valgrind/default.supp
==00:00:00:01.003 87== embedded gdbserver: reading from /tmp/vgdb-pipe-from-vgdb-to-87-by-???-on-pseven-htcondorsubmit-deploy-57f648bf99-7h7d7
==00:00:00:01.003 87== embedded gdbserver: writing to   /tmp/vgdb-pipe-to-vgdb-from-87-by-???-on-pseven-htcondorsubmit-deploy-57f648bf99-7h7d7
==00:00:00:01.003 87== embedded gdbserver: shared mem   /tmp/vgdb-pipe-shared-mem-vgdb-87-by-???-on-pseven-htcondorsubmit-deploy-57f648bf99-7h7d7
==00:00:00:01.003 87== 
==00:00:00:01.003 87== TO CONTROL THIS PROCESS USING vgdb (which you probably
==00:00:00:01.003 87== don't want to do, unless you know exactly what you're doing,
==00:00:00:01.003 87== or are doing some strange experiment):
==00:00:00:01.003 87==   /usr/lib/x86_64-linux-gnu/valgrind/../../bin/vgdb --pid=87 ...command...
==00:00:00:01.003 87== 
==00:00:00:01.003 87== TO DEBUG THIS PROCESS USING GDB: start GDB like this
==00:00:00:01.003 87==   /path/to/gdb /usr/sbin/condor_master
==00:00:00:01.003 87== and then give GDB the following command
==00:00:00:01.003 87==   target remote | /usr/lib/x86_64-linux-gnu/valgrind/../../bin/vgdb --pid=87
==00:00:00:01.003 87== --pid is optional if only one valgrind process is running
==00:00:00:01.003 87== 
--00:00:00:01.204 87-- REDIR: 0x4022e10 (ld-linux-x86-64.so.2:strlen) redirected to 0x580c9ce2 (???)
--00:00:00:01.599 87-- REDIR: 0x4022be0 (ld-linux-x86-64.so.2:index) redirected to 0x580c9cfc (???)
--00:00:00:02.101 87-- Reading syms from /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_core-amd64-linux.so
--00:00:00:02.101 87--    object doesn't have a symbol table
--00:00:00:02.203 87-- Reading syms from /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so
--00:00:00:02.203 87--    object doesn't have a symbol table
==00:00:00:02.299 87== WARNING: new redirection conflicts with existing -- ignoring it
--00:00:00:02.299 87--     old: 0x04022e10 (strlen              ) R-> (0000.0) 0x580c9ce2 ???
--00:00:00:02.299 87--     new: 0x04022e10 (strlen              ) R-> (2007.0) 0x0483f060 strlen
--00:00:00:02.402 87-- REDIR: 0x401f5f0 (ld-linux-x86-64.so.2:strcmp) redirected to 0x483ffd0 (strcmp)
--00:00:00:02.499 87-- REDIR: 0x4023370 (ld-linux-x86-64.so.2:mempcpy) redirected to 0x4843a20 (mempcpy)
--00:00:00:02.799 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libresolv-2.31.so
--00:00:00:02.799 87--   Considering /usr/lib/x86_64-linux-gnu/libresolv-2.31.so ..
--00:00:00:02.800 87--   .. CRC mismatch (computed 240175c5 wanted 37ae7771)
--00:00:00:02.800 87--   Considering /lib/x86_64-linux-gnu/libresolv-2.31.so ..
--00:00:00:02.801 87--   .. CRC mismatch (computed 240175c5 wanted 37ae7771)
--00:00:00:02.801 87--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libresolv-2.31.so ..
--00:00:00:02.803 87--   .. CRC is valid
--00:00:00:03.101 87-- Reading syms from /usr/lib/libcondor_utils_9_0_9.so
--00:00:00:15.803 87-- Reading syms from /usr/lib/x86_64-linux-gnu/librt-2.31.so
--00:00:00:15.803 87--   Considering /usr/lib/x86_64-linux-gnu/librt-2.31.so ..
--00:00:00:15.803 87--   .. CRC mismatch (computed 7d64f7e7 wanted 7c74e986)
--00:00:00:15.803 87--   Considering /lib/x86_64-linux-gnu/librt-2.31.so ..
--00:00:00:15.803 87--   .. CRC mismatch (computed 7d64f7e7 wanted 7c74e986)
--00:00:00:15.803 87--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/librt-2.31.so ..
--00:00:00:15.899 87--   .. CRC is valid
--00:00:00:16.001 87-- Reading syms from /usr/lib/libclassad.so.9.0.9
--00:00:00:18.200 87-- Reading syms from /usr/lib/condor/libpcre.so.3
--00:00:00:18.200 87--    object doesn't have a symbol table
--00:00:00:18.204 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libdl-2.31.so
--00:00:00:18.298 87--   Considering /usr/lib/x86_64-linux-gnu/libdl-2.31.so ..
--00:00:00:18.299 87--   .. CRC mismatch (computed b5d487d3 wanted 6ef97e7c)
--00:00:00:18.299 87--   Considering /lib/x86_64-linux-gnu/libdl-2.31.so ..
--00:00:00:18.299 87--   .. CRC mismatch (computed b5d487d3 wanted 6ef97e7c)
--00:00:00:18.299 87--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libdl-2.31.so ..
--00:00:00:18.300 87--   .. CRC is valid
--00:00:00:18.400 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1
--00:00:00:18.400 87--    object doesn't have a symbol table
--00:00:00:18.899 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0
--00:00:00:18.899 87--    object doesn't have a symbol table
--00:00:00:18.900 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28
--00:00:00:18.900 87--    object doesn't have a symbol table
--00:00:00:19.502 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libm-2.31.so
--00:00:00:19.502 87--   Considering /usr/lib/x86_64-linux-gnu/libm-2.31.so ..
--00:00:00:19.603 87--   .. CRC mismatch (computed fcb42c76 wanted f6c95789)
--00:00:00:19.603 87--   Considering /lib/x86_64-linux-gnu/libm-2.31.so ..
--00:00:00:19.703 87--   .. CRC mismatch (computed fcb42c76 wanted f6c95789)
--00:00:00:19.703 87--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libm-2.31.so ..
--00:00:00:20.100 87--   .. CRC is valid
--00:00:00:21.601 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0
--00:00:00:21.601 87--    object doesn't have a symbol table
--00:00:00:21.603 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libgcc_s.so.1
--00:00:00:21.603 87--    object doesn't have a symbol table
--00:00:00:21.700 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libpthread-2.31.so
--00:00:00:21.700 87--   Considering /usr/lib/debug/.build-id/e5/4761f7b554d0fcc1562959665d93dffbebdaf0.debug ..
--00:00:00:21.700 87--   .. build-id is valid
--00:00:00:22.502 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libc-2.31.so
--00:00:00:22.502 87--   Considering /usr/lib/x86_64-linux-gnu/libc-2.31.so ..
--00:00:00:22.800 87--   .. CRC mismatch (computed 86b78530 wanted e380f01c)
--00:00:00:22.800 87--   Considering /lib/x86_64-linux-gnu/libc-2.31.so ..
--00:00:00:22.999 87--   .. CRC mismatch (computed 86b78530 wanted e380f01c)
--00:00:00:22.999 87--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libc-2.31.so ..
--00:00:00:24.500 87--   .. CRC is valid
--00:00:00:30.601 87-- REDIR: 0x561b600 (libc.so.6:memmove) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.602 87-- REDIR: 0x561a900 (libc.so.6:strncpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.602 87-- REDIR: 0x561b930 (libc.so.6:strcasecmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.602 87-- REDIR: 0x561a220 (libc.so.6:strcat) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.602 87-- REDIR: 0x561a960 (libc.so.6:rindex) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.603 87-- REDIR: 0x561cdd0 (libc.so.6:rawmemchr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.603 87-- REDIR: 0x5637e60 (libc.so.6:wmemchr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.603 87-- REDIR: 0x56379a0 (libc.so.6:wcscmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.603 87-- REDIR: 0x561b760 (libc.so.6:mempcpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.699 87-- REDIR: 0x561b590 (libc.so.6:bcmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.699 87-- REDIR: 0x561a890 (libc.so.6:strncmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.699 87-- REDIR: 0x561a2d0 (libc.so.6:strcmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.700 87-- REDIR: 0x561b6c0 (libc.so.6:memset) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.700 87-- REDIR: 0x5637960 (libc.so.6:wcschr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.700 87-- REDIR: 0x561a7f0 (libc.so.6:strnlen) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.701 87-- REDIR: 0x561a3b0 (libc.so.6:strcspn) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.701 87-- REDIR: 0x561b980 (libc.so.6:strncasecmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.701 87-- REDIR: 0x561a350 (libc.so.6:strcpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.701 87-- REDIR: 0x561bad0 (libc.so.6:memcpy@@GLIBC_2.14) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.702 87-- REDIR: 0x56390d0 (libc.so.6:wcsnlen) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.702 87-- REDIR: 0x56379e0 (libc.so.6:wcscpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.702 87-- REDIR: 0x561a9a0 (libc.so.6:strpbrk) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.703 87-- REDIR: 0x561a280 (libc.so.6:index) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.703 87-- REDIR: 0x561a7b0 (libc.so.6:strlen) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.703 87-- REDIR: 0x5623d20 (libc.so.6:memrchr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.703 87-- REDIR: 0x561b9d0 (libc.so.6:strcasecmp_l) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.704 87-- REDIR: 0x561b550 (libc.so.6:memchr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.799 87-- REDIR: 0x5637ab0 (libc.so.6:wcslen) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.799 87-- REDIR: 0x561ac60 (libc.so.6:strspn) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.799 87-- REDIR: 0x561b8d0 (libc.so.6:stpncpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.799 87-- REDIR: 0x561b870 (libc.so.6:stpcpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.899 87-- REDIR: 0x561ce10 (libc.so.6:strchrnul) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:30.899 87-- REDIR: 0x561ba20 (libc.so.6:strncasecmp_l) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:31.300 87-- REDIR: 0x56a88e0 (libc.so.6:__memcpy_chk) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:31.301 87-- REDIR: 0x561b470 (libc.so.6:strstr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
--00:00:00:31.803 87-- REDIR: 0x5703490 (libc.so.6:__strrchr_avx2) redirected to 0x483ea10 (rindex)
--00:00:00:32.103 87-- REDIR: 0x5703660 (libc.so.6:__strlen_avx2) redirected to 0x483ef40 (strlen)
--00:00:00:32.202 87-- REDIR: 0x5615260 (libc.so.6:malloc) redirected to 0x483b780 (malloc)
--00:00:00:32.302 87-- REDIR: 0x5615850 (libc.so.6:free) redirected to 0x483c9d0 (free)
--00:00:00:32.304 87-- REDIR: 0x5706af0 (libc.so.6:__memset_avx2_unaligned_erms) redirected to 0x48428e0 (memset)
--00:00:00:32.899 87-- REDIR: 0x56ffc50 (libc.so.6:__memcmp_avx2_movbe) redirected to 0x48421e0 (bcmp)
--00:00:00:33.399 87-- REDIR: 0x56feb60 (libc.so.6:__strcmp_avx2) redirected to 0x483fed0 (strcmp)
--00:00:00:33.504 87-- REDIR: 0x5706670 (libc.so.6:__memcpy_avx_unaligned_erms) redirected to 0x48429f0 (memmove)
--00:00:00:33.601 87-- REDIR: 0x526fb20 (libstdc++.so.6:operator new(unsigned long)) redirected to 0x483bdf0 (operator new(unsigned long))
--00:00:00:34.000 87-- REDIR: 0x5700030 (libc.so.6:__strcasecmp_avx) redirected to 0x483f830 (strcasecmp)
--00:00:00:34.403 87-- REDIR: 0x526dd70 (libstdc++.so.6:operator delete(void*)) redirected to 0x483cf50 (operator delete(void*))
--00:00:00:34.703 87-- REDIR: 0x526fb80 (libstdc++.so.6:operator new[](unsigned long)) redirected to 0x483c510 (operator new[](unsigned long))
--00:00:00:34.800 87-- REDIR: 0x5616c90 (libc.so.6:calloc) redirected to 0x483dce0 (calloc)
--00:00:00:35.003 87-- REDIR: 0x56ff790 (libc.so.6:__rawmemchr_avx2) redirected to 0x4843580 (rawmemchr)
--00:00:00:35.100 87-- REDIR: 0x57032a0 (libc.so.6:__strchrnul_avx2) redirected to 0x4843540 (strchrnul)
--00:00:00:35.703 87-- REDIR: 0x5636560 (libc.so.6:__strstr_sse2_unaligned) redirected to 0x4843c20 (strstr)
--00:00:00:35.803 87-- REDIR: 0x5706650 (libc.so.6:__mempcpy_avx_unaligned_erms) redirected to 0x4843660 (mempcpy)
--00:00:00:36.007 87-- REDIR: 0x561b120 (libc.so.6:__GI_strstr) redirected to 0x4843ca0 (__strstr_sse2)
--00:00:00:36.102 87-- REDIR: 0x56ff4c0 (libc.so.6:__memchr_avx2) redirected to 0x4840050 (memchr)
--00:00:00:36.299 87-- REDIR: 0x5705890 (libc.so.6:__stpcpy_avx2) redirected to 0x4842300 (stpcpy)
--00:00:00:36.400 87-- Reading syms from /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so
--00:00:00:36.400 87--   Considering /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so ..
--00:00:00:36.401 87--   .. CRC mismatch (computed f3c36153 wanted e97e46bb)
--00:00:00:36.401 87--   Considering /lib/x86_64-linux-gnu/libnss_files-2.31.so ..
--00:00:00:36.401 87--   .. CRC mismatch (computed f3c36153 wanted e97e46bb)
--00:00:00:36.401 87--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libnss_files-2.31.so ..
--00:00:00:36.403 87--   .. CRC is valid
--00:00:00:36.700 87-- REDIR: 0x5704ba0 (libc.so.6:__strcpy_avx2) redirected to 0x483f090 (strcpy)
--00:00:00:36.801 87-- REDIR: 0x5703070 (libc.so.6:__strchr_avx2) redirected to 0x483ebf0 (index)
--00:00:00:37.799 87-- REDIR: 0x5704f30 (libc.so.6:__strncpy_avx2) redirected to 0x483f230 (strncpy)
--00:00:00:37.799 87-- REDIR: 0x526dda0 (libstdc++.so.6:operator delete[](void*)) redirected to 0x483d6e0 (operator delete[](void*))
--00:00:00:37.821 87-- REDIR: 0x56a8c90 (libc.so.6:__strcpy_chk) redirected to 0x48435c0 (__strcpy_chk)
--00:00:00:37.903 87-- REDIR: 0x56fea30 (libc.so.6:__strspn_sse42) redirected to 0x4843ef0 (strspn)
--00:00:00:37.903 87-- REDIR: 0x56fe7b0 (libc.so.6:__strcspn_sse42) redirected to 0x4843e10 (strcspn)
--00:00:00:38.702 87-- REDIR: 0x56fefa0 (libc.so.6:__strncmp_avx2) redirected to 0x483f670 (strncmp)
--00:00:00:39.001 87-- REDIR: 0x57016b0 (libc.so.6:__strncasecmp_avx) redirected to 0x483f910 (strncasecmp)
--00:00:00:40.700 87-- REDIR: 0x561c140 (libc.so.6:strcasestr) redirected to 0x4843f80 (strcasestr)
--00:00:00:41.401 87-- REDIR: 0x56fe8f0 (libc.so.6:__strpbrk_sse42) redirected to 0x4843da0 (strpbrk)
--00:00:00:45.803 87-- REDIR: 0x5616000 (libc.so.6:realloc) redirected to 0x483df30 (realloc)
--00:00:01:48.603 87-- Discarding syms at 0x5b725c0-0x5b78a1c in /usr/lib/x86_64-linux-gnu/libnss_files-2.31.so (have_dinfo 1)
==00:00:01:48.799 87== 
==00:00:01:48.799 87== HEAP SUMMARY:
==00:00:01:48.799 87==     in use at exit: 33,620 bytes in 73 blocks
==00:00:01:48.799 87==   total heap usage: 1,701 allocs, 1,628 frees, 311,983 bytes allocated
==00:00:01:48.799 87== 
==00:00:01:48.799 87== Searching for pointers to 73 not-freed blocks
==00:00:01:48.800 87== Checked 328,832 bytes
==00:00:01:48.800 87== 
==00:00:01:48.800 87== LEAK SUMMARY:
==00:00:01:48.800 87==    definitely lost: 0 bytes in 0 blocks
==00:00:01:48.800 87==    indirectly lost: 0 bytes in 0 blocks
==00:00:01:48.800 87==      possibly lost: 0 bytes in 0 blocks
==00:00:01:48.800 87==    still reachable: 33,620 bytes in 73 blocks
==00:00:01:48.800 87==         suppressed: 0 bytes in 0 blocks
==00:00:01:48.800 87== Rerun with --leak-check=full to see details of leaked memory
==00:00:01:48.800 87== 
==00:00:01:48.800 87== ERROR SUMMARY: 0 errors from 0 contexts (suppressed: 0 from 0)
==00:00:01:48.803 87== could not unlink /tmp/vgdb-pipe-from-vgdb-to-87-by-???-on-pseven-htcondorsubmit-deploy-57f648bf99-7h7d7
==00:00:01:48.803 87== could not unlink /tmp/vgdb-pipe-to-vgdb-from-87-by-???-on-pseven-htcondorsubmit-deploy-57f648bf99-7h7d7
==00:00:01:48.803 87== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-87-by-???-on-pseven-htcondorsubmit-deploy-57f648bf99-7h7d7

----------
Sergey Komissarov
Senior Software Developer
DATADVANCE

This message may contain confidential information
constituting a trade secret of DATADVANCE. Any distribution,
use or copying of the information contained in this
message is ineligible except under the internal
regulations of DATADVANCE and may entail liability in
accordance with the current legislation of the Russian
Federation. If you have received this message by mistake
please immediately inform me of it. Thank you!