阿里云EMR-阿里云开发者社区

{"moduleinfo":{"question":"//developer.aliyun.com/ask/new","rightTitle":"个人中心","menu_count":[{"count_phone":9,"count":9}],"article":"//developer.aliyun.com/article/new","rightMenu_count":[{"count_phone":4,"count":4}]},"menu":[{"ismoreList":"false","menuTitle":"首页","menuLink":"//developer.aliyun.com"},{"ismoreList":"true","submenu":[{"submenuLink":"//developer.aliyun.com/group","tce_rule_count":"1","morsubemenu":[{"morsubemenuTitle":"云计算","morsubemenuLink":"//developer.aliyun.com/group/cloud","tce_rule_count":"1"},{"morsubemenuTitle":"大数据","morsubemenuLink":"//developer.aliyun.com/group/bigdata","tce_rule_count":"1"},{"morsubemenuTitle":"人工智能","morsubemenuLink":"//developer.aliyun.com/group/ai","tce_rule_count":"1"},{"morsubemenuTitle":"IoT","morsubemenuLink":"//developer.aliyun.com/group/iot","tce_rule_count":"1"},{"morsubemenuTitle":"云原生","morsubemenuLink":"//developer.aliyun.com/group/cloudnative","tce_rule_count":"1"},{"morsubemenuTitle":"数据库","morsubemenuLink":"//developer.aliyun.com/group/database","tce_rule_count":"1"},{"morsubemenuTitle":"开发与运维","morsubemenuLink":"//developer.aliyun.com/group/othertech","tce_rule_count":"1"},{"morsubemenuTitle":"微服务","morsubemenuLink":"//developer.aliyun.com/group/microservice","tce_rule_count":"1"},{"morsubemenuTitle":"安全","morsubemenuLink":"//developer.aliyun.com/group/security","tce_rule_count":"1"}],"moresubmenuTitle":"技术领域"},{"submenuLink":"//developer.aliyun.com/group?groupType=other","tce_rule_count":"1","morsubemenu":[{"morsubemenuTitle":"阿里云物联网","morsubemenuLink":"//developer.aliyun.com/group/aliiot","tce_rule_count":"1"},{"morsubemenuTitle":"阿里云实时计算","morsubemenuLink":"//developer.aliyun.com/group/sc","tce_rule_count":"1"},{"morsubemenuTitle":"阿里巴巴大数据计算","morsubemenuLink":"//developer.aliyun.com/group/maxcompute","tce_rule_count":"1"},{"morsubemenuTitle":"阿里巴巴研发效能","morsubemenuLink":"//developer.aliyun.com/group/yunxiao","tce_rule_count":"1"},{"morsubemenuTitle":"阿里中间件","morsubemenuLink":"//developer.aliyun.com/group/aliware","tce_rule_count":"1"},{"morsubemenuTitle":"支付宝开发者社区","morsubemenuLink":"//developer.aliyun.com/group/alipay","tce_rule_count":"1"},{"morsubemenuTitle":"阿里云容器服务","morsubemenuLink":"//developer.aliyun.com/group/kubernetes","tce_rule_count":"1"},{"morsubemenuTitle":"阿里云存储服务","morsubemenuLink":"//developer.aliyun.com/group/storage","tce_rule_count":"1"},{"morsubemenuTitle":"阿里云数据库","morsubemenuLink":"//developer.aliyun.com/group/aliyundb","tce_rule_count":"1"},{"morsubemenuTitle":"蚂蚁金服科技","morsubemenuLink":"//developer.aliyun.com/group/ant","tce_rule_count":"1"},{"morsubemenuTitle":"更多圈子 >>","morsubemenuLink":"//developer.aliyun.com/group?groupType=other","tce_rule_count":"1"}],"moresubmenuTitle":"最热圈子"},{"submenuLink":"//developer.aliyun.com/group?groupType=other","tce_rule_count":"1","morsubemenu":[{"morsubemenuTitle":"阿里巴巴云原生","morsubemenuLink":"https://developer.aliyun.com/group/alisoftwaretech","tce_rule_count":"1"},{"morsubemenuTitle":"新零售淘系技术","morsubemenuLink":"https://developer.aliyun.com/group/taobaotech","tce_rule_count":"1"},{"morsubemenuTitle":"阿里云支持与服务","morsubemenuLink":"https://developer.aliyun.com/group/supportservice","tce_rule_count":"1"},{"morsubemenuTitle":"AlibabaF2E","morsubemenuLink":"https://developer.aliyun.com/group/alibabaf2e","tce_rule_count":"1"},{"morsubemenuTitle":"数字化转型研究联盟","morsubemenuLink":"https://developer.aliyun.com/group/dtu","tce_rule_count":"1"},{"morsubemenuTitle":"宜搭","morsubemenuLink":"https://developer.aliyun.com/group/yida","tce_rule_count":"1"},{"morsubemenuTitle":"阿里技术","morsubemenuLink":"https://developer.aliyun.com/group/alitech","tce_rule_count":"1"},{"morsubemenuTitle":"阿里云 MVP","morsubemenuLink":"https://developer.aliyun.com/group/mvp","tce_rule_count":"1"},{"morsubemenuTitle":"开发者学习资源库","morsubemenuLink":"https://developer.aliyun.com/group/tech_library","tce_rule_count":"1"},{"morsubemenuTitle":"Java开发者","morsubemenuLink":"https://developer.aliyun.com/group/java","tce_rule_count":"1"}],"moresubmenuTitle":"推荐关注"}],"menuTitle":"技术与产品","menuLink":"//developer.aliyun.com/group"},{"ismoreList":"false","submenu":[{"submenuTitle":"API","submenuLink":"//developer.aliyun.com/tool#tab=api","tce_rule_count":"1"},{"submenuTitle":"SDK","submenuLink":"https://developer.aliyun.com/sdk/java.html","tce_rule_count":"1"},{"submenuTitle":"云产品工具","submenuLink":"//developer.aliyun.com/tool#tab=yuntool","tce_rule_count":"1"},{"submenuTitle":"开源工具","submenuLink":"//developer.aliyun.com/tool#tab=opensource","tce_rule_count":"1"},{"submenuTitle":"镜像站","submenuLink":"//developer.aliyun.com/mirror","tce_rule_count":"1"},{"submenuTitle":"Code Sample","submenuLink":"https://developer.aliyun.com/codesample","tce_rule_count":"1"}],"menuTitle":"工具","menuLink":"//developer.aliyun.com/tool"},{"ismoreList":"false","menuTitle":"问答","menuLink":"//developer.aliyun.com/ask"},{"ismoreList":"false","submenu":[{"submenuTitle":"学习中心","submenuLink":"//developer.aliyun.com/learning","tce_rule_count":"1"},{"submenuTitle":"技能测试中心","submenuLink":"//developer.aliyun.com/exam","tce_rule_count":"1"},{"submenuTitle":"公开课","submenuLink":"//developer.aliyun.com/live","tce_rule_count":"1"},{"submenuTitle":"考试认证","submenuLink":"//edu.aliyun.com/certification","tce_rule_count":"1"}],"menuTitle":"学习与认证"},{"ismoreList":"true","submenu":[{"tce_rule_count":"1","morsubemenu":[{"morsubemenuTitle":"阿里云MVP","morsubemenuLink":"//mvp.aliyun.com","tce_rule_count":"1"},{"morsubemenuTitle":"ACE同城会","morsubemenuLink":"//mvp.aliyun.com/ace","tce_rule_count":"1"},{"morsubemenuTitle":"共创空间","morsubemenuLink":"//mvp.aliyun.com/crowdsource","tce_rule_count":"1"},{"morsubemenuTitle":"线下活动","morsubemenuLink":"//developer.aliyun.com/event","tce_rule_count":"1"}],"moresubmenuTitle":"社群"},{"tce_rule_count":"1","morsubemenu":[{"morsubemenuTitle":"大赛","morsubemenuLink":"//tianchi.aliyun.com/competition/gameList/activeList","tce_rule_count":"1"},{"morsubemenuTitle":"实验室","morsubemenuLink":"//tianchi.aliyun.com/notebook-ai","tce_rule_count":"1"},{"morsubemenuTitle":"数据集","morsubemenuLink":"//tianchi.aliyun.com/dataset","tce_rule_count":"1"}],"moresubmenuTitle":"天池"},{"tce_rule_count":"1","morsubemenu":[{"morsubemenuTitle":"创新资讯","morsubemenuLink":"//chuangke.aliyun.com/info/list","tce_rule_count":"1"},{"morsubemenuTitle":"风池计划","morsubemenuLink":"//chuangke.aliyun.com/markets/aliyun/surpportive","tce_rule_count":"1"},{"morsubemenuTitle":"园区入驻","morsubemenuLink":"//chuangke.aliyun.com/incubator","tce_rule_count":"1"},{"morsubemenuTitle":"AI赛道明星","morsubemenuLink":"//chuangke.aliyun.com/star","tce_rule_count":"1"},{"morsubemenuTitle":"加速器","morsubemenuLink":"//chuangke.aliyun.com/markets/aliyun/taofuchengzhen","tce_rule_count":"1"}],"moresubmenuTitle":"创新创业"}],"menuTitle":"社群与活动"},{"ismoreList":"false","menuTitle":"在线编程","menuLink":"//developer.aliyun.com/coding"},{"ismoreList":"false","menuTitle":"高校计划","menuLink":"//developer.aliyun.com/adc/college/"},{"ismoreList":"false","menuTitle":"开发者云","menuLink":"//developer.aliyun.com/adc/","menuTag":"NEW"}],"rightMenu":[{"menuTitle":"个人设置","menuLink":"//developer.aliyun.com/my#/settings"},{"menuTitle":"我的问答","menuLink":"//developer.aliyun.com/my#/ask"},{"menuTitle":"我的文章","menuLink":"//developer.aliyun.com/my#/article"},{"menuTitle":"我的档案","menuLink":"//developer.aliyun.com/myPortrait"}],"countinfo":{"menu":{"length_pc":0,"length":0},"rightMenu":{"length_pc":0,"length":0}},"$tmsId":"tce/2206927"}

{"moduleinfo":{"searchLink":"//m.aliyun.com/product/search","channels_count":[{"count_phone":13,"count":13}],"searchText":"ecs","noAppDownload":false,"logo":"//gw.alicdn.com/tps/TB11eICOFXXXXaLapXXXXXXXXXX-130-39.png"},"channels":[{"spmId":"0","maxShowNum":"6","isOpenSubChannel":"false","link":"//developer.aliyun.com/","title":"首页"},{"spmId":"0","maxShowNum":"9","isOpenSubChannel":"false","title":"技术领域","subChannels":[{"tce_rule_count":"1","link":"//developer.aliyun.com/group/cloud","title":"云计算"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/bigdata","title":"大数据"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/ai","title":"人工智能"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/iot","title":"IoT"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/cloudnative","title":"云原生"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/database","title":"数据库"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/othertech","title":"开发与运维"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/microservice","title":"微服务"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/security","title":"安全"}]},{"spmId":"0","maxShowNum":"6","isOpenSubChannel":"false","link":"//developer.aliyun.com/group?groupType=other","title":"产品与生态","subChannels":[{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/aliiot","title":"阿里云物联网"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/sc","title":"阿里云实时计算"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/maxcompute","title":"阿里巴巴大数据计算"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/yunxiao","title":"阿里巴巴研发效能"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/aliware","title":"阿里中间件"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/alipay","title":"支付宝开发者社区"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/kubernetes","title":"阿里云容器服务"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/storage","title":"阿里云存储服务"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/aliyundb","title":"阿里云数据库"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group/ant","title":"蚂蚁金服科技"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/group?groupType=other","smallText":"二级频道","title":"更多圈子 >>"}]},{"spmId":"0","maxShowNum":"6","isOpenSubChannel":"false","link":"//developer.aliyun.com/tool","title":"工具","subChannels":[{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/api","title":"API"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/sdk","title":"SDK"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/tool#tab=yuntool","title":"云产品工具"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/tool#tab=opensource","title":"开源工具"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/mirror","title":"镜像站"}]},{"spmId":"0","isOpenSubChannel":"false","link":"//developer.aliyun.com/ask","title":"问答"},{"spmId":"0","channelStr":"频道描述","maxShowNum":"6","isOpenSubChannel":"false","link":"//developer.aliyun.com/learning","title":"学习与认证","subChannels":[{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/learning","title":"学习中心"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/exam","title":"技能测试中心"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/live","title":"公开课"},{"spmId":"0","tce_rule_count":"1","link":"//edu.aliyun.com/certification","title":"考试认证"}]},{"spmId":"0","channelStr":"频道描述","maxShowNum":"6","isOpenSubChannel":"false","link":"https://developer.aliyun.com/","title":"社群","subChannels":[{"tce_rule_count":"1","link":"//mvp.aliyun.com","title":"阿里云MVP"},{"spmId":"0","tce_rule_count":"1","link":"//mvp.aliyun.com/ace","title":"ACE同城会"},{"spmId":"0","tce_rule_count":"1","link":"//mvp.aliyun.com/crowdsource","title":"共创空间"},{"spmId":"0","tce_rule_count":"1","link":"//developer.aliyun.com/event","smallText":"二级频道","title":"线下活动"}]},{"spmId":"0","maxShowNum":"6","isOpenSubChannel":"false","link":"//developer.aliyun.com/coding","title":"在线编程"},{"spmId":"0","maxShowNum":"6","isOpenSubChannel":"false","link":"//developer.aliyun.com/adc/college/","title":"高校计划"},{"spmId":"0","maxShowNum":"6","isOpenSubChannel":"false","link":"//developer.aliyun.com/adc/","title":"开发者云"},{"spmId":"0","channelStr":"频道描述","maxShowNum":"6","isOpenSubChannel":"false","link":"//tianchi.aliyun.com/","title":"天池","subChannels":[{"spmId":"0","tce_rule_count":"1","link":"//tianchi.aliyun.com/competition/","title":"大赛"},{"spmId":"0","tce_rule_count":"1","link":"//tianchi.aliyun.com/notebook-ai/","title":"实验室"},{"spmId":"0","tce_rule_count":"1","link":"//tianchi.aliyun.com/dataset/","title":"数据集"}]},{"spmId":"0","maxShowNum":"6","isOpenSubChannel":"false","link":"//chuangke.aliyun.com","title":"创新创业","subChannels":[{"spmId":"0","tce_rule_count":"1","link":"//chuangke.aliyun.com/info/list","title":"创新资讯"},{"spmId":"0","tce_rule_count":"1","link":"//chuangke.aliyun.com/markets/aliyun/surpportive","title":"风池计划"},{"spmId":"0","tce_rule_count":"1","link":"//chuangke.aliyun.com/incubator/","title":"园区入驻"},{"spmId":"0","tce_rule_count":"1","link":"//chuangke.aliyun.com/star","title":"AI赛道明星"},{"spmId":"0","tce_rule_count":"1","link":"//chuangke.aliyun.com/markets/aliyun/taofuchengzhen","title":"加速器"}]},{"spmId":"0","maxShowNum":"6","isOpenSubChannel":"false","title":"个人中心","subChannels":[{"spmId":"0","link":"//developer.aliyun.com/my#/settings","title":"个人设置"},{"spmId":"0","link":"//developer.aliyun.com/my#/ask","title":"我的问答"},{"spmId":"0","link":"//developer.aliyun.com/my#/article","title":"我的文章"},{"spmId":"0","link":"//developer.aliyun.com/myPortrait","smallText":"二级频道","title":"我的档案"}]}],"countinfo":{"channels":{"length_pc":0,"length":0}},"$tmsId":"tce/2207791"}

阿里云EMR

使用钉钉扫一扫加入圈子

阿里巴巴开源大数据技术团队成立阿里云EMR技术圈，每周推送前沿技术文章，直播分享经典案例、在线答疑，营造纯粹的开源大数据氛围，欢迎加入！钉钉群号：21784001，或点击链接申请加入 https://qr.dingtalk.com/action/joingroup?code=v1,k1,jr4ucSRJs6kkK7QZ5sw2oSHRGNoFjONsQgKxZGiTFXA=&_dt_no_comment=1&origin=11

E-MapReduce是构建于阿里云ECS弹性虚拟机之上，利用开源大数据生态系统，包括Hadoop和Spark，为用户提供集群、作业、数据等管理的一站式大数据处理分析服务。产品交流钉钉群号：21784001，欢迎沟通交流。详情访问：https://www.aliyun.com/product/emapreduce。

全部

问答

官方博客

公开课

Apache Spark中国技术交流社区历次直播回顾（持续更新）

文章开源大数据EMR 2019-09-19 4220浏览量
2019年Apache Spark技术交流社区原创文章回顾

文章阿里云E-MapReduce团队 2020-01-09 279浏览量
核桃编程Delta Lake实时数仓应用实践

文章开源大数据EMR 2020-03-02 137浏览量
E-MapReduce弹性低成本离线大数据分析

文章阿里云E-MapReduce团队 2020-04-02 25浏览量
阿里云智能事业群 EMR团队招人啦！

文章开源大数据EMR 2020-03-30 563浏览量
2020阿里云计算平台校招开始啦！（前后端专场）

文章阿里云E-MapReduce团队 2020-03-27 330浏览量
3月26日Spark社区技术直播【Office Depot利用Analytics Zoo构建智能推荐系统的实践分享】

文章开源大数据EMR 2020-03-23 108浏览量
Office Depot利用Analytics Zoo构建智能推荐系统的实践分享

公开课 KB小秘书 2020-03-26 19:00:00
通过Job Committer保证Mapreduce/Spark任务数据一致性

文章开源大数据EMR 2020-03-23 90浏览量
3月19日JindoFS系列直播【关于 JindoFS 最新的 OTS 方案】

文章开源大数据EMR 2020-03-17 89浏览量

滑动查看更多

立即提问

公告

钉钉群号：23109202（已满，请加团队号），团队群号：HPRX8117。微信公众号：Apache Spark技术交流社区。为 Spark 爱好者提供一个交流技术和传递资讯的平台，在这里你可以掌握大数据计算领域最前沿的资讯，可以与 Spark 技术大牛面对面交流，还有不定期社区福利领取哟～

展开

官网链接

官网链接: https://www.aliyun.com/product/emapreduce

历次技术直播回看

技术直播回看

·技术直播回看

从 Spark Streaming 到 Structure Streaming: https://tianchi.aliyun.com/course/video?spm=5176.12282027.0.0.67a4379czXThTI&liveId=41037

Spark SQL进阶与实战: https://tianchi.aliyun.com/course/video?spm=5176.12282027.0.0.67a4379czXThTI&liveId=41035

Migration to Apache Spark: https://tianchi.aliyun.com/course/video?spm=5176.12282027.0.0.67a4379czXThTI&liveId=41034

机型选择

·Hadoop集群 ·Kafka集群 ·Data science集群

上手学习

·产品文档 ·视频学习