开发者社区 > 数据库 > 数据库管理工具 > 正文

请教下数据传输DTS订阅数据变更消息,client启动时报这个错误是什么原因?

请教下数据传输DTS订阅数据变更消息,client启动时报这个错误是什么原因?订阅配置检查过都没有问题。2023-12-21 12:10:09.816 INFO 77013 --- [kaRecordFetcher] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=consumer-dtspe912tjp198628x-1, groupId=dtspe912tjp198628x] Seeking to offset 9192370 for partition cn_qingdao_vpc_pc_m5e1owklp83iu22c2_dev_version2-0
2023-12-21 12:10:09.817 INFO 77013 --- [kaRecordFetcher] c.a.d.s.c.recordfetcher.ConsumerWrap : RecordFetcher consumer: subscribe for [cn_qingdao_vpc_pc_m5e1owklp83iu22c2_dev_version2-0] with checkpoint [Checkpoint[ topicPartition: nulltimestamp: 1703131717, offset: -1, info: ]] first start
2023-12-21 12:10:09.874 INFO 77013 --- [RecordGenerator] c.a.d.s.c.r.UserRecordGenerator : UserRecordGenerator: haven't receive records from generator for 5s
2023-12-21 12:10:09.874 INFO 77013 --- [RecordProcessor] c.a.d.s.c.r.EtlRecordProcessor : EtlRecordProcessor: haven't receive records from generator for 5s
2023-12-21 12:10:09.876 WARN 77013 --- [kaRecordFetcher] c.a.d.s.c.r.KafkaRecordFetcher : KafkaRecordFetcher: error meet cause Error reading field 'session_id': java.nio.BufferUnderflowException, recover time [1]

org.apache.kafka.common.protocol.types.SchemaException: Error reading field 'session_id': java.nio.BufferUnderflowException
at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:110)
at org.apache.kafka.common.protocol.ApiKeys.parseResponse(ApiKeys.java:313)
at org.apache.kafka.clients.NetworkClient.parseStructMaybeUpdateThrottleTimeMetrics(NetworkClient.java:726)
at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:840)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:559)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:262)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:233)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollForFetches(KafkaConsumer.java:1307)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1243)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1173)
at com.aliyun.dts.subscribe.clients.recordfetcher.ConsumerWrap$DefaultConsumerWrap.poll(ConsumerWrap.java:123)
at com.aliyun.dts.subscribe.clients.recordfetcher.KafkaRecordFetcher.run(KafkaRecordFetcher.java:105)
at java.lang.Thread.run(Thread.java:748)

展开
收起
真的很搞笑 2023-12-28 07:46:57 80 0
1 条回答
写回答
取消 提交回答
  • 您好,目前看DTS服务端没有延迟,异常原因在消费client侧,根据您提供的客户端报错信息未定位到原因,建议您通过dts提供的工具包排查下客户端问题,详细参考:https://help.aliyun.com/document_detail/448414.html 或者按该文档操作下 ,此回答整理自钉群“DTS客户交流群-2”

    2023-12-28 08:55:49
    赞同 展开评论 打赏

阿里云提供了一系列数据库管理工具,可以满足您在云上进行数据库管理的各种需求。包含数据传输服务DTS、数据库备份 DBS、数据库自治服务 DAS、数据管理 DMS。

相关电子书

更多
DTS助力企业快速复制阿里巴巴异地多活架构 立即下载
蚂蚁聚宝虫洞项目技术方案介绍 ——云与端之间数据传输的桥梁 立即下载
DTS控制台一本通 立即下载