开发者社区 > 大数据与机器学习 > 大数据开发治理DataWorks > 正文

dataworks在跑增量数据同步时报错,怎么处理?

dataworks在跑增量数据同步时报错,怎么处理?
2024-08-01 16:58:24.129 [job-1599192969] ERROR Engine -
Through the intelligent analysis by DataX, the most likely error reason of this task is:
com.alibaba.datax.common.exception.DataXException: [ code:OtsWriterError, message:This error represents an internal error of the ots writer plugin, which indicates that the system is not processed.] - java.lang.IllegalArgumentException: Size of record not equal size of config column. record size : 5, config column size : 2, record data : {"data":[{"byteSize":4,"rawData":"test","type":"STRING"},{"byteSize":0,"type":"STRING"},{"byteSize":0,"type":"STRING"},{"byteSize":0,"type":"STRING"},{"byteSize":2,"rawData":"DR","type":"STRING"}],"size":5}. - java.lang.IllegalArgumentException: Size of record not equal size of config column. record size : 5, config column size : 2, record data : {"data":[{"byteSize":4,"rawData":"test","type":"STRING"},{"byteSize":0,"type":"STRING"},{"byteSize":0,"type":"STRING"},{"byteSize":0,"type":"STRING"},{"byteSize":2,"rawData":"DR","type":"STRING"}],"size":5}.

展开
收起
真的很搞笑 2024-08-05 15:03:40 57 0
1 条回答
写回答
取消 提交回答
  • Size of record not equal size of config column. record size : 5, config column size : 2;看下是不是字段映射配置和实际记录的字段数不符合 ,此回答整理自钉群“DataWorks交流群(答疑@机器人)”

    2024-08-06 20:07:34
    赞同 展开评论 打赏

DataWorks基于MaxCompute/Hologres/EMR/CDP等大数据引擎,为数据仓库/数据湖/湖仓一体等解决方案提供统一的全链路大数据开发治理平台。

相关产品

  • 大数据开发治理平台 DataWorks
  • 热门讨论

    热门文章

    相关电子书

    更多
    DataWorks全链路数据质量解决方案-2020飞天大数据平台实战应用第一季 立即下载
    被窝里的运维——DataWorks移动版公测-2020飞天大数据平台实战应用第一季 立即下载
    MaxCompute技术公开课第四季 之 如何将Kafka数据同步至MaxCompute 立即下载