4.Where are Hadoop task log files stored?
For each YARN job, the Hadoop framework generates task log file. Where are Hadoop task log files stored?
A. Cached by the NodeManager managing the job containers, then written to a log directory on the NameNode
B. Cached in the YARN container running the task, then copied into HDFS on job completion
C. In HDFS, in the directory of the user who generates the job
D. On the local disk of the slave mode running the task
问题:
对于每个yarn job,hadoop框架产生的task日志文件存储在哪个位置上？
解析:
1.对于学习hadoop有段时间的和亲手搭建过,就会知道log文件一般 肯定是存储在 local disk（本地磁盘）上,而不是存储在hdfs文件系统中。
2.一般输出位置由yarn.nodemanager.log-dirs参数设置(Default Path is ${yarn.log.dir}/userlogs)
<property>
<name>yarn.nodemanager.log-dirs</name>
<value>/home/root/workspace-yarn/nm/log</value>
</property>.
如果不配置将使得NodeManager进程处于Unhealthy状态，无法提供服务，现象是提交作业时，作业一直处于pending状态无法往下执行,所以必须配置。
For each YARN job, the Hadoop framework generates task log file. Where are Hadoop task log files stored?
A. Cached by the NodeManager managing the job containers, then written to a log directory on the NameNode
B. Cached in the YARN container running the task, then copied into HDFS on job completion
C. In HDFS, in the directory of the user who generates the job
D. On the local disk of the slave mode running the task
问题:
对于每个yarn job,hadoop框架产生的task日志文件存储在哪个位置上？
解析:
1.对于学习hadoop有段时间的和亲手搭建过,就会知道log文件一般 肯定是存储在 local disk（本地磁盘）上,而不是存储在hdfs文件系统中。
2.一般输出位置由yarn.nodemanager.log-dirs参数设置(Default Path is ${yarn.log.dir}/userlogs)
<property>
<name>yarn.nodemanager.log-dirs</name>
<value>/home/root/workspace-yarn/nm/log</value>
</property>.
如果不配置将使得NodeManager进程处于Unhealthy状态，无法提供服务，现象是提交作业时，作业一直处于pending状态无法往下执行,所以必须配置。
