开发者社区> 问答> 正文

提交pyflink作业到YARN集群报错

Hi,各位大佬, 想请教一下,我使用flink run -m yarn-cluster -p 4 -py myjob.py,报错java.lang.RuntimeException: Found 0 flink-python jar. at org.apache.flink.client.program.PackagedProgram.getJobJarAndDependencies(PackagedProgram.java:263) at org.apache.flink.client.program.PackagedProgram. (PackagedProgram.java:140) at org.apache.flink.client.program.PackagedProgram. (PackagedProgram.java:68) at org.apache.flink.client.program.PackagedProgram$Builder.build(PackagedProgram.java:590) at org.apache.flink.client.cli.CliFrontend.buildProgram(CliFrontend.java:758) at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:250) at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:968) at org.apache.flink.client.cli.CliFrontend.lambda$main$12(CliFrontend.java:1042) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876) at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41) at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1042)

没有发现flink-python jar,这个jar在哪里可以找见,site-packages/pyflink里面,还是自己构建,目前本机已经安装pyflink 1.11.1*来自志愿者整理的flink

展开
收起
毛毛虫雨 2021-12-06 14:56:14 693 0
1 条回答
写回答
取消 提交回答
  • 看一下目录site-packages/pyflink/opt,里面是否有名为flink-python的jar*来自志愿者整理的flink

    2021-12-06 15:57:08
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
深度学习+大数据 TensorFlow on Yarn 立即下载
Docker on Yarn 微服务实践 立即下载
深度学习+大数据-TensorFlow on Yarn 立即下载

相关实验场景

更多