开发者社区 > 大数据与机器学习 > 实时计算 Flink > 正文

Flink CDC这是什么问题?今天所有任务都停失败了 ?

Flink CDC这是什么问题?今天所有任务都停失败了 ?2023-11-28 13:49:59
java.io.IOException: Failed to fetch BLOB d14e8c48ad24201e9d7cbe8bd3e7e89f/p-a7e583f106f46d88b8ae9170727681965bda51d4-275a43c1606a617665ee9351bfbdb899 from localhost/127.0.0.1:44333 and store it under /tmp/tm_localhost:33715-64cada/blobStorage/incoming/temp-00216869
at org.apache.flink.runtime.blob.BlobClient.downloadFromBlobServer(BlobClient.java:168)
at org.apache.flink.runtime.blob.AbstractBlobCache.getFileInternal(AbstractBlobCache.java:177)
at org.apache.flink.runtime.blob.PermanentBlobCache.getFile(PermanentBlobCache.java:269)
at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.createUserCodeClassLoader(BlobLibraryCacheManager.java:252)
at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.getOrResolveClassLoader(BlobLibraryCacheManager.java:229)
at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.access$1100(BlobLibraryCacheManager.java:200)
at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$DefaultClassLoaderLease.getOrResolveClassLoader(BlobLibraryCacheManager.java:334)
at org.apache.flink.runtime.taskmanager.Task.createUserCodeClassloader(Task.java:1024)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:612)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: GET operation failed: Server side error: /tmp/jm_377e30a4384648f7a136344b650d5985/blobStorage/incoming/temp-01301055
at org.apache.flink.runtime.blob.BlobClient.getInternal(BlobClient.java:231)
at org.apache.flink.runtime.blob.BlobClient.downloadFromBlobServer(BlobClient.java:139)
... 10 more
Caused by: java.io.IOException: Server side error: /tmp/jm_377e30a4384648f7a136344b650d5985/blobStorage/incoming/temp-01301055
at org.apache.flink.runtime.blob.BlobClient.receiveAndCheckGetResponse(BlobClient.java:277)
at org.apache.flink.runtime.blob.BlobClient.getInternal(BlobClient.java:226)
... 11 more
Caused by: java.nio.file.NoSuchFileException: /tmp/jm_377e30a4384648f7a136344b650d5985/blobStorage/incoming/temp-01301055
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:409)
at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
at java.nio.file.Files.move(Files.java:1395)
at org.apache.flink.runtime.blob.BlobUtils.lambda$moveTempFileToStore$0(BlobUtils.java:422)
at org.apache.flink.runtime.blob.BlobUtils.internalMoveTempFileToStore(BlobUtils.java:446)
at org.apache.flink.runtime.blob.BlobUtils.moveTempFileToStore(BlobUtils.java:415)
at org.apache.flink.runtime.blob.BlobServer.getFileInternal(BlobServer.java:533)
at org.apache.flink.runtime.blob.BlobServerConnection.get(BlobServerConnection.java:218)
at org.apache.flink.runtime.blob.BlobServerConnection.run(BlobServerConnection.java:113)

展开
收起
真的很搞笑 2023-12-04 08:09:25 61 0
2 条回答
写回答
取消 提交回答
  • 这个歌问题解决了吗

    2024-01-15 09:41:16
    赞同 展开评论 打赏
  • 这个问题看起来像是Flink在执行任务时遇到了一个IO错误,具体表现为无法从本地主机(localhost)下载一个名为"d14e8c48ad24201e9d7cbe8bd3e7e89f/p-a7e583f106f46d88b8ae9170727681965bda51d4-275a43c1606a617665ee9351bfbdb899"的文件,并存储在"/tmp/tm_localhost:33715-64cada/blobStorage/incoming/temp-00216869"的位置。这可能是由于网络连接问题或者目标文件不存在导致的。

    同时,还提到了一个"Server side error: /tmp/jm_377e30a4384648f7a136344b650d5985/blobStorage/incoming/temp-01301055"的错误信息,这可能是在尝试访问临时文件时出现的服务器端错误。

    解决这个问题的方法可能是首先检查网络连接是否正常,然后检查目标文件是否存在并且可以访问。

    2023-12-04 11:49:13
    赞同 展开评论 打赏

实时计算Flink版是阿里云提供的全托管Serverless Flink云服务,基于 Apache Flink 构建的企业级、高性能实时大数据处理系统。提供全托管版 Flink 集群和引擎,提高作业开发运维效率。

相关产品

  • 实时计算 Flink版
  • 相关电子书

    更多
    Flink CDC Meetup PPT - 龚中强 立即下载
    Flink CDC Meetup PPT - 王赫 立即下载
    Flink CDC Meetup PPT - 覃立辉 立即下载