开发者社区> 问答> 正文

flink1.10 yarn模式为什么无法提交作业?

在Flink1.10中,用yarn模式无法提交作业。 提示如下: lease check if the requested resources are available in the YARN cluster 2020-02-09 17:22:26,318 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster 2020-02-09 17:22:26,570 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster 2020-02-09 17:22:26,822 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster 2020-02-09 17:22:27,074 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster 2020-02-09 17:22:27,326 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster 2020-02-09 17:22:27,578 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster 2020-02-09 17:22:27,831 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster 2020-02-09 17:22:28,083 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster 2020-02-09 17:22:28,336 INFO org.apache.flink.yarn.YarnClusterDescriptor - Deployment took more than 60 seconds. Please check if the requested resources are available in the YARN cluster

另外,我看了yarn资源足够。但就是提交不了。 我的作业提交命令如下: ./bin/flink run -m yarn-cluster -yjm 1024 -ytm 2048 /opt/flink-1.10/examples/batch/WordCount.jar --input hdfs://192.168.xxx.xxx:9000/test/LICENSE --output hdfs://192.168.xxx.xxx:9000/test/result.txt*来自志愿者整理的flink邮件归档

展开
收起
塔塔塔塔塔塔 2021-12-02 17:54:33 1927 0
1 条回答
写回答
取消 提交回答
  • 你看看是不是yarn队列有很多accept状态的任务,如果有很多正在排队的任务,那就是可能超过了flink设置的超时时间还没有来得及给你这个任务分配资源,就会报这个错误。 但是这个不影响任务的提交,等一会任务提交成功了,客户端就会返回提交成功的结果。*来自志愿者整理的FLINK邮件归档

    2021-12-02 18:11:49
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
深度学习+大数据 TensorFlow on Yarn 立即下载
Docker on Yarn 微服务实践 立即下载
深度学习+大数据-TensorFlow on Yarn 立即下载