开发者社区> 问答> 正文

canal对接RocketMQ消息过大时报错:org.apache.rocketmq.client.

环境信息

canal version 1.1.3 mysql version 5.7.20

问题描述

canal上游监控数据库中新闻信息表,下游对接RocketMQ,消息过大时报错 调整 canal.mq.canalBatchSize 参数为1 还是报错

2019-03-21 11:41:34.581 [pool-8-thread-1] ERROR com.alibaba.otter.canal.rocketmq.CanalRocketMQProducer - send flat message to hashed partition error org.apache.rocketmq.client.exception.MQClientException: CODE: 13 DESC: the message body size over max value, MAX: 4194304 For more information, please visit the url, http://rocketmq.apache.org/docs/faq/ at org.apache.rocketmq.client.Validators.checkMessage(Validators.java:99) ~[rocketmq-client-4.3.2.jar:4.3.2] at org.apache.rocketmq.client.impl.producer.DefaultMQProducerImpl.sendSelectImpl(DefaultMQProducerImpl.java:1033) ~[rocketmq-client-4.3.2.jar:4.3.2] at org.apache.rocketmq.client.impl.producer.DefaultMQProducerImpl.send(DefaultMQProducerImpl.java:1021) ~[rocketmq-client-4.3.2.jar:4.3.2] at org.apache.rocketmq.client.impl.producer.DefaultMQProducerImpl.send(DefaultMQProducerImpl.java:1016) ~[rocketmq-client-4.3.2.jar:4.3.2] at org.apache.rocketmq.client.producer.DefaultMQProducer.send(DefaultMQProducer.java:389) ~[rocketmq-client-4.3.2.jar:4.3.2] at com.alibaba.otter.canal.rocketmq.CanalRocketMQProducer.send(CanalRocketMQProducer.java:194) [canal.server-1.1.3-SNAPSHOT.jar:na] at com.alibaba.otter.canal.rocketmq.CanalRocketMQProducer.send(CanalRocketMQProducer.java:73) [canal.server-1.1.3-SNAPSHOT.jar:na] at com.alibaba.otter.canal.server.CanalMQStarter.worker(CanalMQStarter.java:179) [canal.server-1.1.3-SNAPSHOT.jar:na] at com.alibaba.otter.canal.server.CanalMQStarter.access$500(CanalMQStarter.java:22) [canal.server-1.1.3-SNAPSHOT.jar:na] at com.alibaba.otter.canal.server.CanalMQStarter$CanalMQRunnable.run(CanalMQStarter.java:221) [canal.server-1.1.3-SNAPSHOT.jar:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_144] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_144] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_144]

原提问者GitHub用户flackyang

展开
收起
古拉古拉 2023-05-08 13:45:27 139 0
1 条回答
写回答
取消 提交回答
  • server 端 canal.instance.memory.buffer.memunit 和 canal.mq.batchSize调小 adapter 端 canal.conf.batchSize调小 试一下

    原回答者GitHub用户rewerma

    2023-05-09 17:48:18
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
Apache Flink技术进阶 立即下载
Apache Spark: Cloud and On-Prem 立即下载
Hybrid Cloud and Apache Spark 立即下载

相关镜像