开发者社区> 问答> 正文

using thin jar to replace fat jar on yarn cluster

Does flink on yarn support using thin jar to replace fat jar? I don't want the jar of each flink task to have hundreds of MB. I want to put all the dependent packages in a single directory,and then the size of each flink task jar will be tens of KB.*来自志愿者整理的flink邮件归档

展开
收起
EXCEED 2021-12-08 11:31:05 548 0
1 条回答
写回答
取消 提交回答
  • When using yarn originally, we found a problem. The jars on yarn will take precedence over the jars on the specified classpath, and sometimes yarn is shared, and the jars in the lib directory of yarn cannot be modified. When Flink runs on a yarn cluster, is the jar on the classpath of flink itself higher than the jar on yarn? ________________*来自志愿者整理的flink邮件归档

    2021-12-08 14:23:34
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
深度学习+大数据 TensorFlow on Yarn 立即下载
Docker on Yarn 微服务实践 立即下载
深度学习+大数据-TensorFlow on Yarn 立即下载