DMS管理中使用DMS内置存储保存归档数据--归档失败，请问题怎么处理？
DMS管理中使用DMS内置存储保存归档数据--归档失败，请问题怎么处理？工单号：8137738 归档任务日志： 2023-02-13 13:31:20[GMT+08:00] INFO - Resource Control is active! 2023-02-13 13:31:20[GMT+08:00] INFO - Starting job j_145267 at Mon Feb 13 13:31:20 CST 2023 2023-02-13 13:31:20[GMT+08:00] INFO - job JVM args: '-dms.flowid=f_44683' '-dms.execid=14441889' '-dms.jobid=j_145267' 2023-02-13 13:31:20[GMT+08:00] INFO - user.to.proxy property was not set, defaulting to submit user zhulong 2023-02-13 13:31:20[GMT+08:00] INFO - Building lindorm_backup job executor. 2023-02-13 13:31:20[GMT+08:00] INFO - Starting execution of spark backup job... 2023-02-13 13:31:20[GMT+08:00] INFO - 执行归档到inner_oss的任务，任务版本[f_44683]，业务时间[1676178972531] 2023-02-13 13:31:20[GMT+08:00] INFO - build oss archive param 2023-02-13 13:31:20[GMT+08:00] INFO - wait for spark backup task complete. taskId:1123460 2023-02-13 13:31:20[GMT+08:00] INFO - spark task id 1123460 status: NEW 2023-02-13 13:31:20[GMT+08:00] INFO - Print task detail log. 2023-02-13 13:31:20[GMT+08:00] INFO - DG uri null:null invalid. 2023-02-13 13:32:30[GMT+08:00] INFO - spark task id 1123460 status: RUNNING 2023-02-13 13:32:30[GMT+08:00] INFO - Print task detail log. 2023-02-13 13:31:29[GMT+08:00] INFO - Starting to run job. 2023-02-13 13:32:24[GMT+08:00] INFO - retry !!!,schema:insclaim_core,table:ins_request_log 2023-02-13 13:32:29[GMT+08:00] INFO - start create temp table,temp table name:tmp_dms_8137738_20230212131612_ins_request_log 2023-02-13 13:33:40[GMT+08:00] INFO - spark task id 1123460 status: FAILED 2023-02-13 13:33:40[GMT+08:00] INFO - start get spark log task . taskId:1123460 2023-02-13 13:33:40[GMT+08:00] INFO - check spark response :https://datafactory-test.oss-cn-hangzhou.aliyuncs.com/runlog/production/open/1123460/driver.log?Expires=1676352820&OSSAccessKeyId=LTAI5tAZmejvKKAS9KY2ggPU&Signature=Q2Ydzm7xLb9RTtMC61dGvh3HgRE%3D 2023-02-13 13:33:41[GMT+08:00] INFO - check spark response :["https://datafactory-test.oss-cn-hangzhou.aliyuncs.com/runlog/production/open/1123460/driver.log?Expires=1676352821&OSSAccessKeyId=LTAI5tAZmejvKKAS9KY2ggPU&Signature=2ccrCfJmfv%2BrufL4c4u2XQvFttQ%3D"] 2023-02-13 13:33:41[GMT+08:00] INFO - finish get spark log task . taskId:1123460 2023-02-13 13:33:41[GMT+08:00] ERROR - Spark logs list:{"executorLogsPath":"["https://datafactory-test.oss-cn-hangzhou.aliyuncs.com/runlog/production/open/1123460/driver.log?Expires=1676352821&OSSAccessKeyId=LTAI5tAZmejvKKAS9KY2ggPU&Signature=2ccrCfJmfv%2BrufL4c4u2XQvFttQ%3D"]","driverLogPath":"https://datafactory-test.oss-cn-hangzhou.aliyuncs.com/runlog/production/open/1123460/driver.log?Expires=1676352820&OSSAccessKeyId=LTAI5tAZmejvKKAS9KY2ggPU&Signature=Q2Ydzm7xLb9RTtMC61dGvh3HgRE%3D"} 2023-02-13 13:33:41[GMT+08:00] ERROR - Job run failed! com.alibaba.datafactory.common.exception.TaskFlowRuntimeException: spark task id:1123460,Spark backup task failed. status:FAILED at com.alibaba.datafactory.zhulong.plugin.lindorm.service.impl.ExecuteJobServiceImpl.waitForSparkTaskComplete(ExecuteJobServiceImpl.java:509) at com.alibaba.datafactory.zhulong.plugin.lindorm.service.impl.ExecuteJobServiceImpl.startSparkJob(ExecuteJobServiceImpl.java:326) at com.alibaba.datafactory.zhulong.plugin.lindorm.service.impl.ExecuteJobServiceImpl.executeJob(ExecuteJobServiceImpl.java:231) at com.alibaba.datafactory.zhulong.plugin.lindorm.LindormBackupJob.run(LindormBackupJob.java:56) at zhulong.execapp.JobRunner.runJob(JobRunner.java:909) at zhulong.execapp.JobRunner.doRun(JobRunner.java:624) at zhulong.execapp.JobRunner.run(JobRunner.java:573) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:627) at java.lang.Thread.run(Thread.java:882) 2023-02-13 13:33:41[GMT+08:00] INFO - Finishing job j_145267 at 1676266421242 with status FAILED
写回答
-
-
十分耕耘，一定会有一分收获！楼主你好，看了你的报错信息，推测出来是Task失败监控错误，你可以添加一个监听器来看具体的错误信息，然后对应的解决。
2023-02-19 08:17:07赞同 展开评论 打赏
版权声明：本文内容由阿里云实名注册用户自发贡献，版权归原作者所有，阿里云开发者社区不拥有其著作权，亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容，填写侵权投诉表单进行举报，一经查实，本社区将立刻删除涉嫌侵权内容。
