Are there any race conditions while condor is trying to write to XferStatsLog ?
This could explain the weird log entries I observed.
From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of George Papadimitriou <georgpap@xxxxxxx>
Sent: Tuesday, March 13, 2018 10:12:53 AM
Subject: [HTCondor-users] Interpreting XferStatsLog and understanding message flow
I'm trying to read and understand the log entries of the XferStatsLog, that present tcp connection statistics from condor io.
However, I'm a bit confused with the message flow and it's not entirely clear what does each log entry means.
Here is an example output from the log (excluding the tcp related fields), where I execute a workflow with 4 jobs (2 running at the same time, each time) and condor stages in and stages out files to and from the worker nodes.
In this example the field I have marked as "Description" is the most confusing to me, especially because some records (eg. lines 1, 2, 7, 8) seem to have information about multiple jobs and I cannot understand the meaning.
Could someone explain the meaning of each record and maybe give me a high level description of the message flow ?