Flink CDC这是什么问题?今天所有任务都停失败了 ?2023-11-28 13:49:59
java.io.IOException: Failed to fetch BLOB d14e8c48ad24201e9d7cbe8bd3e7e89f/p-a7e583f106f46d88b8ae9170727681965bda51d4-275a43c1606a617665ee9351bfbdb899 from localhost/127.0.0.1:44333 and store it under /tmp/tm_localhost:33715-64cada/blobStorage/incoming/temp-00216869
at org.apache.flink.runtime.blob.BlobClient.downloadFromBlobServer(BlobClient.java:168)
at org.apache.flink.runtime.blob.AbstractBlobCache.getFileInternal(AbstractBlobCache.java:177)
at org.apache.flink.runtime.blob.PermanentBlobCache.getFile(PermanentBlobCache.java:269)
at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.createUserCodeClassLoader(BlobLibraryCacheManager.java:252)
at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.getOrResolveClassLoader(BlobLibraryCacheManager.java:229)
at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$LibraryCacheEntry.access$1100(BlobLibraryCacheManager.java:200)
at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager$DefaultClassLoaderLease.getOrResolveClassLoader(BlobLibraryCacheManager.java:334)
at org.apache.flink.runtime.taskmanager.Task.createUserCodeClassloader(Task.java:1024)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:612)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: GET operation failed: Server side error: /tmp/jm_377e30a4384648f7a136344b650d5985/blobStorage/incoming/temp-01301055
at org.apache.flink.runtime.blob.BlobClient.getInternal(BlobClient.java:231)
at org.apache.flink.runtime.blob.BlobClient.downloadFromBlobServer(BlobClient.java:139)
... 10 more
Caused by: java.io.IOException: Server side error: /tmp/jm_377e30a4384648f7a136344b650d5985/blobStorage/incoming/temp-01301055
at org.apache.flink.runtime.blob.BlobClient.receiveAndCheckGetResponse(BlobClient.java:277)
at org.apache.flink.runtime.blob.BlobClient.getInternal(BlobClient.java:226)
... 11 more
Caused by: java.nio.file.NoSuchFileException: /tmp/jm_377e30a4384648f7a136344b650d5985/blobStorage/incoming/temp-01301055
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:409)
at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
at java.nio.file.Files.move(Files.java:1395)
at org.apache.flink.runtime.blob.BlobUtils.lambda$moveTempFileToStore$0(BlobUtils.java:422)
at org.apache.flink.runtime.blob.BlobUtils.internalMoveTempFileToStore(BlobUtils.java:446)
at org.apache.flink.runtime.blob.BlobUtils.moveTempFileToStore(BlobUtils.java:415)
at org.apache.flink.runtime.blob.BlobServer.getFileInternal(BlobServer.java:533)
at org.apache.flink.runtime.blob.BlobServerConnection.get(BlobServerConnection.java:218)
at org.apache.flink.runtime.blob.BlobServerConnection.run(BlobServerConnection.java:113)
这个问题看起来像是Flink在执行任务时遇到了一个IO错误,具体表现为无法从本地主机(localhost)下载一个名为"d14e8c48ad24201e9d7cbe8bd3e7e89f/p-a7e583f106f46d88b8ae9170727681965bda51d4-275a43c1606a617665ee9351bfbdb899"的文件,并存储在"/tmp/tm_localhost:33715-64cada/blobStorage/incoming/temp-00216869"的位置。这可能是由于网络连接问题或者目标文件不存在导致的。
同时,还提到了一个"Server side error: /tmp/jm_377e30a4384648f7a136344b650d5985/blobStorage/incoming/temp-01301055"的错误信息,这可能是在尝试访问临时文件时出现的服务器端错误。
解决这个问题的方法可能是首先检查网络连接是否正常,然后检查目标文件是否存在并且可以访问。
版权声明:本文内容由阿里云实名注册用户自发贡献,版权归原作者所有,阿里云开发者社区不拥有其著作权,亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容,填写侵权投诉表单进行举报,一经查实,本社区将立刻删除涉嫌侵权内容。
实时计算Flink版是阿里云提供的全托管Serverless Flink云服务,基于 Apache Flink 构建的企业级、高性能实时大数据处理系统。提供全托管版 Flink 集群和引擎,提高作业开发运维效率。