开发者社区 > 大数据与机器学习 > 正文

群里有大佬用过阿里的oss么 flink 1.13.6 想把之前的hdfs存放savepoint?

群里有大佬用过阿里的oss么 flink 1.13.6 想把之前的hdfs存放savepoint和checkpoint切换到oss,但是一直报错?2023-05-24 06:35:07,571 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB0140F656F39338B8243 [HostId]: null 2023-05-24 06:35:07,619 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB0140F656F3933FC8243 [HostId]: null 2023-05-24 06:35:07,652 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB0140F656F3933D18343 [HostId]: null 2023-05-24 06:35:07,656 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB0140F656F3933EF8343 [HostId]: null 2023-05-24 06:35:07,668 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB0140F656F39331E8443 [HostId]: null 2023-05-24 06:35:07,672 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB0140F656F3933368443 [HostId]: null 2023-05-24 06:35:08,681 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB0150F656F39337C9043 [HostId]: null 2023-05-24 06:35:08,686 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB0150F656F39338E9043 [HostId]: null 2023-05-24 06:38:28,868 WARN org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Client]Unable to execute HTTP request: Read timed out [ErrorCode]: SocketTimeout [RequestId]: Unknown 2023-05-24 06:41:49,606 WARN org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Client]Unable to execute HTTP request: Read timed out [ErrorCode]: SocketTimeout [RequestId]: Unknown 2023-05-24 06:45:10,941 WARN org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Client]Unable to execute HTTP request: Read timed out [ErrorCode]: SocketTimeout [RequestId]: Unknown 2023-05-24 06:48:33,482 WARN org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Client]Unable to execute HTTP request: Read timed out [ErrorCode]: SocketTimeout [RequestId]: Unknown 2023-05-24 06:51:58,396 WARN org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Client]Unable to execute HTTP request: Read timed out [ErrorCode]: SocketTimeout [RequestId]: Unknown 2023-05-24 06:52:08,031 WARN org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: The difference between the request time and the current time is too large. [ErrorCode]: RequestTimeTooSkewed [RequestId]: 646DB418E04637323975BB63 [HostId]: **************aliyuncs.com [ResponseError]:

RequestTimeTooSkewed The difference between the request time and the current time is too large. 646DB418E04637323975BB63 **************aliyuncs.com 900000 2023-05-24T06:35:08.000Z 2023-05-24T06:52:08.000Z 0002-00000504

2023-05-24 06:52:08,033 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job c9bd4b4c157a28accb1bc5fab4e034c7 reached terminal state FAILED. org.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster. at org.apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.util.concurrent.CompletionException: org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss.OSSException: The difference between the request time and the current time is too large. [ErrorCode]: NoSuchKey [RequestId]: 646DB418E046373239A1BB63 [HostId]: null 2023-05-24 06:52:08,080 INFO org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - [Server]Unable to execute HTTP request: Not Found [ErrorCode]: NoSuchKey [RequestId]: 646DB418E046373239F7BB63 [HostId]: null 2023-05-24 06:52:08,243 WARN org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss [] - Unable to find 'mime.types' file in classpath 2023-05-24 06:52:08,271 INFO org.apache.flink.runtime.history.FsJobArchivist [] - Job c9bd4b4c157a28accb1bc5fab4e034c7 has been archived at oss://*******completed-jobs/c9bd4b4c157a28accb1bc5fab4e034c7.

展开
收起
真的很搞笑 2023-05-29 13:51:05 168 0
0 条回答
写回答
取消 提交回答

大数据领域前沿技术分享与交流,这里不止有技术干货、学习心得、企业实践、社区活动,还有未来。

相关产品

  • 实时计算 Flink版
  • 相关电子书

    更多
    OSS运维进阶实战手册 立即下载
    《OSS运维基础实战手册》 立即下载
    OSS运维基础实战手册 立即下载