开发者社区 > 大数据与机器学习 > 实时计算 Flink > 正文

各位老师,我的flink yarn-session集群,时间长了就jobmanager崩了?

问题1:各位老师,我的flink yarn-session集群,时间长了就jobmanager崩了?Caused by: java.util.concurrent.CompletionException: java.lang.OutOfMemoryError: Metaspace. The metaspace out-of-memory error has occurred. This can mean two things: either Flink Master requires a larger size of JVM metaspace to load classes or there is a class loading leak. In the first case 'jobmanager.memory.jvm-metaspace.size' configuration option should be increased. If the error persists (usually in cluster after several job (re-)submissions) then there is probably a class loading leak in user code or some of its dependencies which has to be investigated and fixed. The Flink Master has to be shutdown... at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)这是因为什么呢,平时用的时候还好 一但几天没用 这个集群就废了 就得重新启一个image.png 问题2:那为啥时间长了才会崩呢,有什么会一直增长吗image.png 配置文件里我设置了2048,这里调大呗,一般都是1024 1024这么增加吧,我再加1024行不行

展开
收起
真的很搞笑 2023-06-29 07:08:06 110 0
1 条回答
写回答
取消 提交回答
  • 回答1:内存不够啊https://nightlies.apache.org/flink/flink-docs-master/docs/ops/debugging/debugging_classloading/#unloading-of-dynamically-loaded-classes-in-user-code,out-of-memory oom 回答2:或者代码层 优化一下 JVM,你可以调整大一些,只要反复提交几次任务metaspace就满了,此回答整理自钉群“Flink CDC 社区”

    2023-06-29 08:48:01
    赞同 展开评论 打赏

实时计算Flink版是阿里云提供的全托管Serverless Flink云服务,基于 Apache Flink 构建的企业级、高性能实时大数据处理系统。提供全托管版 Flink 集群和引擎,提高作业开发运维效率。

相关产品

  • 实时计算 Flink版
  • 相关电子书

    更多
    深度学习+大数据 TensorFlow on Yarn 立即下载
    Docker on Yarn 微服务实践 立即下载
    深度学习+大数据-TensorFlow on Yarn 立即下载