问题一:Flink CDC这个是什么错误?
Flink CDC这个是什么错误?12月22日星期五11:20:10 CST 2023警告:不建议在没有服务器身份验证的情况下建立SSL连接。根据MySQL 5.5.45+、5.6.26+和5.7.6+的要求,如果没有设置显式选项,则默认情况下必须建立SSL连接。为了符合不使用SSL的现有应用程序,verifyServerCertificate属性设置为“false”。您需要通过设置useSSL=false来显式禁用SSL,或者设置useSSL=true并为服务器证书验证提供信任存储。Fri Dec 22 11:20:10 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
参考回答:
jdbc配置要是设置这个
prop.setProperty("useSSL", "false");
关于本问题的更多回答可点击原文查看:
https://developer.aliyun.com/ask/582319
问题二:"Flink CDC中jdbc写入mysql是出现报错,查不到处理的资料?
"Flink CDC中jdbc写入mysql是出现报错,查不到处理的资料?
[ERROR] Could not execute SQL statement. Reason:
java.lang.ClassNotFoundException: org.apache.flink.connector.jdbc.table.JdbcRowDataInputFormat?"
参考回答:
jdbc 的驱动包加上,还要加数据库的这种jar
关于本问题的更多回答可点击原文查看:
https://developer.aliyun.com/ask/582316
问题三:Flink CDC没报错,但数据不同步,修改source表数据,sink表没变,为什么?
Flink CDC通过flinksql的方式 flink 1.14.6 cdc 2.4.2 测试souce表以下两种增量同步,都没成功过,
'scan.startup.mode' = 'specific-offset',
'scan.startup.specific-offset.file' = 'mysql-bin.000268',
'scan.startup.specific-offset.pos' = '4'
它会把把mysql-bin.000267的变更也进行同步
第二种:
'scan.startup.mode' = 'timestamp',
'scan.startup.timestamp-millis' = '1703103147000'
没报错,但数据不同步,修改source表数据,sink表没变?
参考回答:
如果你的binlog太多了,他会慢慢的过滤binlog,等一会就行,a字段修改不是在b字段修改之前吗,你启动的时候按照b字段修改的差不多时间来看数据
关于本问题的更多回答可点击原文查看:
https://developer.aliyun.com/ask/582279
问题四:Flink CDC3.0没法实现mysql to mysql 吗?
Flink CDC3.0没法实现mysql to mysql 吗?
Exception in thread "main" java.lang.RuntimeException: Cannot find factory with identifier "mysql" in the classpath.
报错了
Exception in thread "main" java.lang.RuntimeException: Cannot find factory with identifier "mysql" in the classpath
Available factory classes are:
com.ververica.cdc.connectors.mysql.factory.MySqlDataSourceFactory
at com.ververica.cdc.composer.utils.FactoryDiscoveryUtils.getFactoryByIdentifier(FactoryDiscoveryUtils.java:60)
at com.ververica.cdc.composer.flink.FlinkPipelineComposer.createDataSink(FlinkPipelineComposer.java:144)
at com.ververica.cdc.composer.flink.FlinkPipelineComposer.compose(FlinkPipelineComposer.java:108)
at com.ververica.cdc.cli.CliExecutor.run(CliExecutor.java:65)
at com.ververica.cdc.cli.CliFrontend.main(CliFrontend.java:62)
参考回答:
sink 不支持mysql
关于本问题的更多回答可点击原文查看:
https://developer.aliyun.com/ask/582256
问题五:Flink CDC这个报错怎么解决?
Flink CDC这个报错怎么解决?
错误是 Oracle 19C
参考回答:
不支持这个在线属性的日志,需要删除这个属性的。debeziumProperties.setProperty("log.mining.continuous.mine", "true");
如果有这个设置就删掉,19里没这个了,
现在数据库用的Oracle 19C 多租户
关于本问题的更多回答可点击原文查看: