我们在生产环境遇到一个非常奇怪的问题,CDC在监听到一个TABLE_MAP事件后,在context里找不到表信息而出现了... whose schema isn't known to this connector
异常,怀疑可能和这里的TODO有关系导致schema里没有这个表。2024-03-01 00:00:07,215 ERROR io.debezium.connector.mysql.MySqlStreamingChangeEventSource - Encountered change event 'Event{header=EventHeaderV4{timestamp=1709222407000, eventType=TABLE_MAP, serverId=34153158, headerLength=19, dataLength=62, nextPosition=459864703, flags=0}, data=TableMapEventData{tableId=4322148, database='dj_log', table='t_map_crash_log_202403', columnTypes=3, 8, 8, 3, 15, 15, 15, 18, columnMetadata=0, 0, 0, 0, 256, 1020, 2048, 0, columnNullability={}, eventMetadata=null}}' at offset {transaction_id=null, ts_sec=1709222392, file=binlog.010032, pos=459863947, gtids=0f6fc04c-6a08-11ed-bcb2-f29b611b6193:1-14394004114, server_id=34153158, event=2} for table dj_log.t_map_crash_log_202403 whose schema isn't known to this connector. One possible cause is an incomplete database history topic. Take a new snapshot in this case.
Use the mysqlbinlog tool to view the problematic event: mysqlbinlog --start-position=459864622 --stop-position=459864703 --verbose binlog.010032
2024-03-01 00:00:07,215 ERROR io.debezium.connector.mysql.MySqlStreamingChangeEventSource - Error during binlog processing. Last offset stored = null, binlog reader near position = binlog.010032/459864622
2024-03-01 00:00:07,215 WARN com.ververica.cdc.connectors.mysql.debezium.task.context.MySqlErrorHandler - Schema for table dj_log.t_map_crash_log_202403 is null
2024-03-01 00:00:07,215 INFO io.debezium.connector.mysql.MySqlStreamingChangeEventSource - Error processing binlog event, and propagating to Kafka Connect so it stops this connector. Future binlog events read before connector is shutdown will be ignored.然后这个问题在2.3之后修复了?这个有相关的pr或者什么资料可以参考下嘛?
版权声明:本文内容由阿里云实名注册用户自发贡献,版权归原作者所有,阿里云开发者社区不拥有其著作权,亦不承担相应法律责任。具体规则请查看《阿里云开发者社区用户服务协议》和《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容,填写侵权投诉表单进行举报,一经查实,本社区将立刻删除涉嫌侵权内容。
实时计算Flink版是阿里云提供的全托管Serverless Flink云服务,基于 Apache Flink 构建的企业级、高性能实时大数据处理系统。提供全托管版 Flink 集群和引擎,提高作业开发运维效率。