开发者社区> 问答> 正文

flink on yarn。

我使用的事flink on yarn。在执行命令时:   flink run -m yarn-cluster ./examples/batch/WordCount.jar   结果却报错了:

 The program finished with the following exception:

org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: org.apache.flink.runtime.rest.util.RestClientException: [org.apache.flink.runtime.rest.handler.RestHandlerException: org.apache.flink.runtime.messages.FlinkJobNotFoundException: Could not find Flink job (397a081a0313f462818575fc725b3582)         at org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler.propagateException(JobExecutionResultHandler.java:94)         at org.apache.flink.runtime.rest.handler.job.JobExecutionResultHandler.lambda$handleRequest$1(JobExecutionResultHandler.java:84)         at java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:870)

        ... 麻烦告知是什么原因呢,我配置文件是这样的: #=============================================================================== high-availability: zookeeper high-availability.storageDir: hdfs://mycluster/flink/ha/ high-availability.zookeeper.quorum: hadoop201:2181,hadoop202:2181,hadoop203:2181 high-availability.zookeeper.path.root: /flink high-availability.cluster-id: /default_one # important: customize per cluster #设置ck的状态后端 state.backend: filesystem state.checkpoints.dir: hdfs://mycluster/flink/checkpoints #设置默认的savepoint的保存位置 state.savepoints.dir: hdfs://mycluster/flink/savepoints

集群名称不能写错

jobmanager.archive.fs.dir: hdfs://mycluster/flink/completed-jobs/ historyserver.archive.fs.dir: hdfs://mycluster/flink/completed-jobs/ #===============================================================================

谢谢!*来自志愿者整理的flink邮件归档

展开
收起
moonlightdisco 2021-12-07 17:01:13 874 0
1 条回答
写回答
取消 提交回答
  • 你可以查看一下JM的日志,看看提交的job或者failover之后恢复的job id是不是397a081a0313f462818575fc725b3582*来自志愿者整理的flink邮件归档

    2021-12-07 17:19:02
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
深度学习+大数据 TensorFlow on Yarn 立即下载
Docker on Yarn 微服务实践 立即下载
深度学习+大数据-TensorFlow on Yarn 立即下载