在进行table转streaming后报一个异常
场景:将table表转为streaming流进行一个关联维表操作后发生异常
异常内容: 2021-11-17 19:39:53.056|ERROR|org.apache.flink.runtime.io.network.partition.BufferWritingResultPartition|flink-taskexecutor-io-thread-4|releaseInternal|233|Error during release of result subpartition: C:\Users\monster\AppData\Local\Temp\flink-netty-shuffle-76964c7f-ffc6-490f-82bc-a3091412955b\0be871a1d3b522377ffd8f565bb3b81f.channel java.nio.file.NoSuchFileException: C:\Users\monster\AppData\Local\Temp\flink-netty-shuffle-76964c7f-ffc6-490f-82bc-a3091412955b\0be871a1d3b522377ffd8f565bb3b81f.channel at sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:79) at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97) at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102) at sun.nio.fs.WindowsFileSystemProvider.implDelete(WindowsFileSystemProvider.java:269) at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103) at java.nio.file.Files.delete(Files.java:1126) at org.apache.flink.runtime.io.network.partition.FileChannelBoundedData.close(FileChannelBoundedData.java:97) at org.apache.flink.runtime.io.network.partition.BoundedBlockingSubpartition.checkReaderReferencesAndDispose(BoundedBlockingSubpartition.java:253) at org.apache.flink.runtime.io.network.partition.BoundedBlockingSubpartition.release(BoundedBlockingSubpartition.java:205) at org.apache.flink.runtime.io.network.partition.BufferWritingResultPartition.releaseInternal(BufferWritingResultPartition.java:229) at org.apache.flink.runtime.io.network.partition.ResultPartition.release(ResultPartition.java:246) at org.apache.flink.runtime.io.network.partition.ResultPartitionManager.releasePartition(ResultPartitionManager.java:86) at org.apache.flink.runtime.io.network.NettyShuffleEnvironment.lambda$releasePartitionsLocally$0(NettyShuffleEnvironment.java:181) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748)
陈 *来自志愿者整理的flink邮件归档
写回答
-
Hi！
这种文件用于在 task 之间交换数据。我对 windows 的行为不太了解，但看起来是这个临时文件被清理了。是否有设置什么自动清理策略？另外这样的错误如果只是偶发，Flink 的 failover 机制会让作业从 checkpoint 重新运行，不必担心作业的可用性和正确性。*来自志愿者整理的flink邮件归档
2021-12-07 17:27:07赞同 展开评论 打赏
版权声明：本文内容由阿里云实名注册用户自发贡献，版权归原作者所有，阿里云开发者社区不拥有其著作权，亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容，填写侵权投诉表单进行举报，一经查实，本社区将立刻删除涉嫌侵权内容。
