1
学习教程
请认真阅读教程后再参赛去学习
2
开通产品服务
开通OSS、DLF和Hologres服务,新用户免费试用去领取
3
上传作品
上传数据表赢奖品去上传
4
了解Hologres
查看产品相关信息立即查看

实时湖仓分析教程

本教程以ORC格式数据为例,上传数据至OSS,通过DLF获取元数据,使用Hologres进行外表加速查询和内表查询。基于大规模、周期性数仓的湖仓一体能力请参考MaxCompute湖仓一体
作者信息

配置环境资源

新用户可免费领取Hologres、OSS试用资源进行参赛,后台会校验产品开通及SQL运行情况
No entry or manifest in @ali/alfa-aliyundotcom-free-widget-goods-card
Error: No entry or manifest in @ali/alfa-aliyundotcom-free-widget-goods-card
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:272373
    at h (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:125719)
    at Generator.<anonymous> (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:125470)
    at Generator.next (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:126078)
    at f (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204053)
    at a (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204255)
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204314
    at new Promise (<anonymous>)
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204196
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:272563
No entry or manifest in @ali/alfa-aliyundotcom-free-widget-goods-card
Error: No entry or manifest in @ali/alfa-aliyundotcom-free-widget-goods-card
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:272373
    at h (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:125719)
    at Generator.<anonymous> (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:125470)
    at Generator.next (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:126078)
    at f (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204053)
    at a (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204255)
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204314
    at new Promise (<anonymous>)
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204196
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:272563
No entry or manifest in @ali/alfa-aliyundotcom-free-widget-goods-card
Error: No entry or manifest in @ali/alfa-aliyundotcom-free-widget-goods-card
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:272373
    at h (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:125719)
    at Generator.<anonymous> (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:125470)
    at Generator.next (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:126078)
    at f (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204053)
    at a (https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204255)
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204314
    at new Promise (<anonymous>)
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:204196
    at https://g.alicdn.com/hmod/ace-developer-factory-free-product/0.0.10/??index.js,services.js:1:272563
我的作品
提交数据表截图(详见教程说明或活动规则),赢得精美礼品
上传作品
参与作品展示
最新最热
蛮有意思的,体验了三个不同的产品。sql查询速度很快。
这次是比较有挑战的活动,由于开发经验不足,中间有几个步骤操作错误。导致执行insert的时候报错。错误原因:ERROR: RunQuery failed due to rpc error: duplicate key value violates unique constraint &quot;nation_pkey&quot;,重新调整后,总算是完成了实验,学到了不少。
相应速度还算是理想,数据量上来的时候,还是需要不断地优化,包括SQL。
阿里云的Hologres实时湖仓一体解决方案与OSS(对象存储服务)配合使用,提供了一种高效、便捷的数据导入方式。用户可以一键将存储在OSS中的数据直接导入到Hologres的SQL库中,无需编写复杂的ETL脚本或进行繁琐的数据迁移操作。
魏红斌
select ps_partkey, sum(ps_supplycost * ps_availqty) as value from partsupp_orc, supplier_orc, nation_orc where ps_suppkey = s_suppkey and s_nationkey = n_nationkey and RTRIM(n_name) = &#39;RUSSIA&#39; group by ps_partkey order by value desc;
co63oc_
修改 n_name 查询,使用 hologres 外部表查询比较方便
co63oc_
内外表查询
挑战赛截图。 SQL用来排序库存中国家供应的零件的总价值。 同样,内部表快外部表很多。
内部表的速度明显比外部表快很多。而且仔细看,从内部表扫描的数据行数和数据量明显比外部表少很多。
自定义SQL外表和内表关联查询
Hologres内表查询比外表查询确实快,如果存储空间允许的情况下,
挑战自定义SQL外表和内表关联查询!!!!!
内表外表查询实例(非自定义SQL)
内表查询实例
挑战自定义SQL外表和内表关联查询!!!!!
内表查询速度
挑战算定义SQL关联查询
Hologres实时湖仓配合oss一键导入数据到SQL库中,非常好用
从nation表、supplier表和partsupp表中联接了数据,并且使用了多重联接和筛选条件。
内外表查询对比,外表真的快好多
AI助理

你好,我是AI助理

可以解答问题、推荐解决方案等