DataWorks中RestAPI Reader配置示例:脚本模式是什么?

DataWorks中RestAPI Reader配置示例:脚本模式是什么?

展开
收起
真的很搞笑 2023-04-29 08:02:54 174 分享 版权
1 条回答
写回答
取消 提交回答
  • **脚本配置示例如下所示。{"type":"job","version":"2.0","steps":[{"stepType":"restapi","parameter":{"url":"http://127.0.0.1:5000/get_array5","dataMode":"oneData","responseType":"json","column":[{"type":"long","name":"a.b" //从a.b路径中查找数据},{"type":"string", //从a.c路径中查找数据"name":"a.c"}],"dirtyData":"null","method":"get","defaultHeader":{"X-Custom-Header":"test header"},"customHeader":{"X-Custom-Header2":"test header2"},"parameters":"abc=1&def=1"},"name":"restapireader","category":"reader"},{"stepType":"stream","parameter":{},"name":"Writer","category":"writer"}],"setting":{"errorLimit":{"record":""},"speed":{"throttle":true, //当throttle值为flase时,mbps参数不生效,表示不限流;当throttle值为true时,表示限流。"concurrent":1, //作业并发数。"mbps":"12"//限流}},"order":{"hops":[{"from":"Reader","to":"Writer"}]}} https://help.aliyun.com/document_detail/194827.html,此回答整理自钉群“DataWorks交流群(答疑@机器人)”

    2023-05-01 15:24:46
    赞同 展开评论

DataWorks基于MaxCompute/Hologres/EMR/CDP等大数据引擎,为数据仓库/数据湖/湖仓一体等解决方案提供统一的全链路大数据开发治理平台。

还有其他疑问?
咨询AI助理