Logging issue with Log4j in Flink cluster?

Question

I have a program in which Log4j is used to log some information. When I test in the IDE/Intellij, log file could generate successfully. While when I submit this task to flink stand alone cluster. I couldn't find any corresponding log file in any worker node.

Answer 1

In standalone mode, Flink writes its log files to FLINK_DIR/log per default. FLINK_DIR is the home directory of Flink. You can control the logging behaviour by changing the file FLINK_DIR/conf/log4j.properties . There you can also change the path via log4j.appender.file.file=FILE_PATH to which the logging files are written.

Answer 2

如果您使用纱线群集，则日志存储在/hadoop/yarn/logs/$application_id$