开发者社区> 问答> 正文

Flink Cannot instantiate file system for URI: hdfs

flink standalone模式提交任务报错,idea调试不报错,flink部署在hadoop的一个节点,hadoop集群多台节点,flink/conf下master和worker都是localhost, image.png image.png image.png $ ../bin/flink run -c ** *.jar时报错如下: 2021-10-14 19:23:45 java.io.IOException: Cannot instantiate file system for URI: hdfs://nameservice1/checkpoint/galileo at org.apache.flink.runtime.fs.hdfs.HadoopFsFactory.create(HadoopFsFactory.java:196) at org.apache.flink.core.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:526) at org.apache.flink.core.fs.FileSystem.get(FileSystem.java:407) at org.apache.flink.core.fs.Path.getFileSystem(Path.java:274) at org.apache.flink.runtime.state.filesystem.FsCheckpointStorageAccess. (FsCheckpointStorageAccess.java:64) at org.apache.flink.runtime.state.filesystem.FsStateBackend.createCheckpointStorage(FsStateBackend.java:527) at org.apache.flink.streaming.runtime.tasks.StreamTask. (StreamTask.java:341) at org.apache.flink.streaming.runtime.tasks.StreamTask. (StreamTask.java:308) at org.apache.flink.streaming.runtime.tasks.SourceStreamTask. (SourceStreamTask.java:76) at org.apache.flink.streaming.runtime.tasks.SourceStreamTask. (SourceStreamTask.java:72) at sun.reflect.GeneratedConstructorAccessor29.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.flink.runtime.taskmanager.Task.loadAndInstantiateInvokable(Task.java:1524) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:730) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NumberFormatException: For input string: "30s" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Long.parseLong(Long.java:589) at java.lang.Long.parseLong(Long.java:631) at org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1381) at org.apache.hadoop.hdfs.DFSClient$Conf. (DFSClient.java:507) at org.apache.hadoop.hdfs.DFSClient. (DFSClient.java:647) at org.apache.hadoop.hdfs.DFSClient. (DFSClient.java:628) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149) at org.apache.flink.runtime.fs.hdfs.HadoopFsFactory.create(HadoopFsFactory.java:168) ... 16 more hadoop是CDH安装,把相关hadoop的配置扫描了一遍,没发现30s的配置参数文件。无从下手,请帮忙指点迷津!

展开
收起
游客devdsqnoaisjs 2021-10-14 20:01:33 2662 0
2 条回答
写回答
取消 提交回答
  • 解决了吗,请问是怎么解决的。我也遇到同样的问题了

    2024-07-05 10:06:41
    赞同 展开评论 打赏
  • 之前好像遇到过尝试在连接时设置hadoopConfig "dfs.namenode.decommission.interval":"30", "dfs.client.datanode-restart.timeout":"30"

    2023-02-01 11:17:42
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
Flink CDC Meetup PPT - 龚中强 立即下载
Flink CDC Meetup PPT - 王赫 立即下载
Flink CDC Meetup PPT - 覃立辉 立即下载