[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] DAGMan write jobs log into *.nodes.log even if log file specified for all jobs



On Tue, 12 Nov 2013, 钱晓明 wrote:

DAGMan write jobs log into *.nodes.log file even if log file specified for
all jobs in their submit file.

Their content are similar, except that ImageUpdate event is missing in
*.nodes.log file.

Can I avoid this? I am using 8.0.1.

First of all, is there any particular reason you don't want to have the two log files?

There are two ways you can avoid having duplicate user logs for your jobs:

1) Don't specify log files in your submit files.
2) Set DAGMAN_ALWAYS_USE_NODE_LOG to false in a per-DAG configuration
   file (or some other configuration setting).

There are issues with both of these alternatives -- if you do #1, you won't get log files if you ever run your jobs outside of a DAG. If you do #2, you'll potentially increase DAGMan's file descriptor usage, and decrease performance a bit. (Also, the #2 option may go away in the future.)

In general, unless you have some reason that the duplicate logs are really a problem, we recommend leaving things the way they are.

Kent Wenger
CHTC Team