Remapreduce跑不了
补充一下我是根据御膳房文档中“MR&UDF本地开发工具”文章(链接我发不了。。),运行的是样例Word Count(程序在创建完project就有的)
-------------------------
Remapreduce跑不了
我就是按照那个配置的,那个貌似并没有安装odps sdk
-------------------------
Remapreduce跑不了
而且如果我把Combiner在base.mapred.xml里面去掉,会得到这个错误:
Exception in thread "main" java.lang.RuntimeException: java.lang.UnsupportedOperationException: ODPS-0720503:Unexpected intermediate output in mapper, it is only allowed in mapreduce (reduce num > 0) jobs
at com.aliyun.odps.mapred.LocalJobRunner.submit(LocalJobRunner.java:94)
at com.aliyun.odps.mapred.JobClient.submitJob(JobClient.java:157)
at com.aliyun.odps.mapred.JobClient.runJob(JobClient.java:60)
at mygroup.mapreduce.JobLauncher.main(JobLauncher.java:480)
Caused by: java.lang.UnsupportedOperationException: ODPS-0720503:Unexpected intermediate output in mapper, it is only allowed in mapreduce (reduce num > 0) jobs
at com.aliyun.odps.mapred.local.MapDriver$DirectMapContextImpl.write(MapDriver.java:115)
at mygroup.mapreduce.MyMapper.map(MyMapper.java:26)
at com.aliyun.odps.mapred.local.MapDriver.run(MapDriver.java:312)
at com.aliyun.odps.mapred.LocalJobRunner.handleNonPipeMode(LocalJobRunner.java:234)
at com.aliyun.odps.mapred.LocalJobRunner.runJob(LocalJobRunner.java:113)
at com.aliyun.odps.mapred.LocalJobRunner.submit(LocalJobRunner.java:91)
... 3 more
-------------------------
Remapreduce跑不了
把 numReduceTask 设成1 可以跑了!谢谢!
-------------------------
Remapreduce跑不了
提交程序时 @{env} 和 {rid} 应该填啥?
http://@{env}.codebase.de.yushanfang.com/scheduler/res?id={rid}