大家好,
我安装了Cloudera CDH 6, 然后下载安装flink, 以flink on yarn的方式执行
export HADOOP_CONF_DIR=/opt/cloudera/parcels/CDH-6.0.0-1.cdh6.0.0.p0.537114/lib/hadoop/etc/hadoop
结果总是报错:
The number of virtual cores per node were configured with 4 but Yarn only has -1 virtual cores available. Please note that the number of virtual cores is set to the number of task slots by default unless configured in the Flink config with 'yarn.containers.vcores.'
请指导一下,非常感谢!
在 yarn-site.xml 文件中可配:
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>5</value>
请参考: https://mapr.com/blog/best-practices-yarn-resource-management/
版权声明:本文内容由阿里云实名注册用户自发贡献,版权归原作者所有,阿里云开发者社区不拥有其著作权,亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容,填写侵权投诉表单进行举报,一经查实,本社区将立刻删除涉嫌侵权内容。