AI 助理
备案控制台
开发者社区 数据库 文章 正文

flink1.17提交cdc作业模式遇到的超时问题

2023-12-27 261
版权
版权声明：
本文内容由阿里云实名注册用户自发贡献，版权归原作者所有，阿里云开发者社区不拥有其著作权，亦不承担相应法律责任。具体规则请查看《 阿里云开发者社区用户服务协议》和 《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容，填写 侵权投诉表单进行举报，一经查实，本社区将立刻删除涉嫌侵权内容。
本文涉及的产品
实时计算 Flink 版，5000CU*H 3个月
推荐场景：
实时发现最热Github项目
云数据库 RDS MySQL，集群系列 2核4GB
推荐场景：
搭建个人博客
RDS MySQL Serverless 基础系列，0.5-2RCU 50GB
推荐场景：
学生管理系统数据库设计 搭建个人博客
简介： 各位大佬请教个问题，我在83服务器上部署了一个Flink1.17 ，然后我有两个mysql数据库，分别部署在63服务器和81服务上了，我在往83提交cdc作业时（链接的是81服务器上的数据库），前面几个任务能正常提交，后面再提交报超时（jdbc模式可以正常提交），为了验证cdc连接数，我把后面的任务链接的数据库服务器改为了63，可以正常提交，有人遇到过吗
  • 各位大佬请教个问题，我在83服务器上部署了一个Flink1.17 ，然后我有两个mysql数据库，分别部署在63服务器和81服务上了，我在往83提交cdc作业时（链接的是81服务器上的数据库），前面几个任务能正常提交，后面再提交报超时（jdbc模式可以正常提交），为了验证cdc连接数，我把后面的任务链接的数据库服务器改为了63，可以正常提交，有人遇到过吗
    2023-12-27 10:58:33,813 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job test (3f6489605981317c4125d5cc966aeecd) switched from state FAILING to FAILED.
    org.apache.flink.runtime.JobException: Recovery is suppressed by FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=3, backoffTimeMS=5000)
    at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:139) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getGlobalFailureHandlingResult(ExecutionFailureHandler.java:102) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.scheduler.DefaultScheduler.handleGlobalFailure(DefaultScheduler.java:301) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.lambda$failJob$0(OperatorCoordinatorHolder.java:618) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:453) ~[flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:453) ~[flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:218) ~[flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:84) ~[flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:168) ~[flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:127) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:126) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:175) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:579) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.actor.ActorCell.invoke(ActorCell.scala:547) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_dfc51966-50ff-45ae-8101-fd9d47ccf617.jar:1.17.0]
    at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_392]
    at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_392]
    at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_392]
    at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_392]
    Caused by: org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: source_osi_inspection_task[8]' (operator 605b35e407e90cda15ad084365733fdd).
    at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:600) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:237) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:374) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$runInEventLoop$10(SourceCoordinator.java:463) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40) ~[flink-dist-1.17.0.jar:1.17.0]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_392]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_392]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_392]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_392]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_392]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_392]
    at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_392]
    Caused by: org.apache.flink.util.FlinkRuntimeException: org.apache.flink.util.FlinkRuntimeException: java.sql.SQLTransientConnectionException: connection-pool-10.70.10.81:3306 - Connection is not available, request timed out after 30000ms.
    at com.ververica.cdc.connectors.mysql.debezium.DebeziumUtils.openJdbcConnection(DebeziumUtils.java:71) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlChunkSplitter.open(MySqlChunkSplitter.java:112) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlSnapshotSplitAssigner.open(MySqlSnapshotSplitAssigner.java:168) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlHybridSplitAssigner.open(MySqlHybridSplitAssigner.java:93) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.enumerator.MySqlSourceEnumerator.start(MySqlSourceEnumerator.java:87) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$start$1(SourceCoordinator.java:225) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$runInEventLoop$10(SourceCoordinator.java:449) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40) ~[flink-dist-1.17.0.jar:1.17.0]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_392]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_392]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_392]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_392]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_392]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_392]
    at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_392]
    Caused by: org.apache.flink.util.FlinkRuntimeException: java.sql.SQLTransientConnectionException: connection-pool-10.70.10.81:3306 - Connection is not available, request timed out after 30000ms.
    at com.ververica.cdc.connectors.mysql.source.connection.JdbcConnectionFactory.connect(JdbcConnectionFactory.java:72) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:888) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:883) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at io.debezium.jdbc.JdbcConnection.connect(JdbcConnection.java:411) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.debezium.DebeziumUtils.openJdbcConnection(DebeziumUtils.java:68) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlChunkSplitter.open(MySqlChunkSplitter.java:112) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlSnapshotSplitAssigner.open(MySqlSnapshotSplitAssigner.java:168) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlHybridSplitAssigner.open(MySqlHybridSplitAssigner.java:93) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.enumerator.MySqlSourceEnumerator.start(MySqlSourceEnumerator.java:87) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$start$1(SourceCoordinator.java:225) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$runInEventLoop$10(SourceCoordinator.java:449) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40) ~[flink-dist-1.17.0.jar:1.17.0]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_392]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_392]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_392]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_392]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_392]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_392]
    at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_392]
    Caused by: java.sql.SQLTransientConnectionException: connection-pool-10.70.10.81:3306 - Connection is not available, request timed out after 30000ms.
    at com.ververica.cdc.connectors.shaded.com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.shaded.com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:197) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.shaded.com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:162) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.shaded.com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:100) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.connection.JdbcConnectionFactory.connect(JdbcConnectionFactory.java:59) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:888) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:883) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at io.debezium.jdbc.JdbcConnection.connect(JdbcConnection.java:411) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.debezium.DebeziumUtils.openJdbcConnection(DebeziumUtils.java:68) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlChunkSplitter.open(MySqlChunkSplitter.java:112) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlSnapshotSplitAssigner.open(MySqlSnapshotSplitAssigner.java:168) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlHybridSplitAssigner.open(MySqlHybridSplitAssigner.java:93) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at com.ververica.cdc.connectors.mysql.source.enumerator.MySqlSourceEnumerator.start(MySqlSourceEnumerator.java:87) ~[flink-sql-connector-mysql-cdc-2.4.0.jar:2.4.0]
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$start$1(SourceCoordinator.java:225) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$runInEventLoop$10(SourceCoordinator.java:449) ~[flink-dist-1.17.0.jar:1.17.0]
    at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40) ~[flink-dist-1.17.0.jar:1.17.0]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_392]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_392]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_392]
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_392]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_392]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_392]
    at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_392]
    2023-12-27 10:58:33,815 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Stopping checkpoint coordinator for job 3f6489605981317c4125d5cc966aeecd.
    2023-12-27 10:58:33,822 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job 3f6489605981317c4125d5cc966aeecd reached terminal state FAILED.
    org.apache.flink.util.FlinkException: Global failure triggered by OperatorCoordinator for 'Source: source_osi_inspection_project[3]' (operator feca28aff5a3958840bee985ee7de4d3).
    at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder$LazyInitializedCoordinatorContext.failJob(OperatorCoordinatorHolder.java:600)
    at org.apache.flink.runtime.operators.coordination.RecreateOnResetOperatorCoordinator$QuiesceableContext.failJob(RecreateOnResetOperatorCoordinator.java:237)
    at org.apache.flink.runtime.source.coordinator.SourceCoordinatorContext.failJob(SourceCoordinatorContext.java:374)
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$runInEventLoop$10(SourceCoordinator.java:463)
    at org.apache.flink.util.ThrowableCatchingRunnable.run(ThrowableCatchingRunnable.java:40)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:750)
    Caused by: org.apache.flink.util.FlinkRuntimeException: Failed to discovery tables to capture
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlSnapshotSplitAssigner.discoveryCaptureTables(MySqlSnapshotSplitAssigner.java:184)
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlSnapshotSplitAssigner.open(MySqlSnapshotSplitAssigner.java:169)
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlHybridSplitAssigner.open(MySqlHybridSplitAssigner.java:93)
    at com.ververica.cdc.connectors.mysql.source.enumerator.MySqlSourceEnumerator.start(MySqlSourceEnumerator.java:87)
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$start$1(SourceCoordinator.java:225)
    at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$runInEventLoop$10(SourceCoordinator.java:449)
    ... 8 more
    Caused by: org.apache.flink.util.FlinkRuntimeException: org.apache.flink.util.FlinkRuntimeException: java.sql.SQLTransientConnectionException: connection-pool-10.70.10.81:3306 - Connection is not available, request timed out after 30000ms.
    at com.ververica.cdc.connectors.mysql.debezium.DebeziumUtils.openJdbcConnection(DebeziumUtils.java:71)
    at com.ververica.cdc.connectors.mysql.source.assigners.MySqlSnapshotSplitAssigner.discoveryCaptureTables(MySqlSnapshotSplitAssigner.java:179)
    ... 13 more
    Caused by: org.apache.flink.util.FlinkRuntimeException: java.sql.SQLTransientConnectionException: connection-pool-10.70.10.81:3306 - Connection is not available, request timed out after 30000ms.
    at com.ververica.cdc.connectors.mysql.source.connection.JdbcConnectionFactory.connect(JdbcConnectionFactory.java:72)
    at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:888)
    at io.debezium.jdbc.JdbcConnection.connection(JdbcConnection.java:883)
    at io.debezium.jdbc.JdbcConnection.connect(JdbcConnection.java:411)
    at com.ververica.cdc.connectors.mysql.debezium.DebeziumUtils.openJdbcConnection(DebeziumUtils.java:68)
    ... 14 more
    Caused by: java.sql.SQLTransientConnectionException: connection-pool-10.70.10.81:3306 - Connection is not available, request timed out after 30000ms.
    at com.ververica.cdc.connectors.shaded.com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696)
    at com.ververica.cdc.connectors.shaded.com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:197)
    at com.ververica.cdc.connectors.shaded.com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:162)
    at com.ververica.cdc.connectors.shaded.com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:100)
    at com.ververica.cdc.connectors.mysql.source.connection.JdbcConnectionFactory.connect(JdbcConnectionFactory.java:59)
    ... 18 more
文章标签：
实时计算 Flink版
云数据库 RDS MySQL 版
数据库
Java
关系型数据库
MySQL
数据库连接
关键词：
实时计算 Flink版CDC
实时计算 Flink版模式
实时计算 Flink版超时
实时计算 Flink版作业
实时计算 Flink版cdc模式
相关实践学习
基于Hologres轻松玩转一站式实时仓库
本场景介绍如何利用阿里云MaxCompute、实时计算Flink和交互式分析服务Hologres开发离线、实时数据融合分析的数据大屏应用。
Linux入门到精通
本套课程是从入门开始的Linux学习课程，适合初学者阅读。由浅入深案例丰富，通俗易懂。主要涉及基础的系统操作以及工作中常用的各种服务软件的应用、部署和优化。即使是零基础的学员，只要能够坚持把所有章节都学完，也一定会受益匪浅。
游客f3wsbz3d3mvme
目录
相关文章
武子康
|
2月前
|
分布式计算 监控 大数据
大数据-131 - Flink CEP 案例：检测交易活跃用户、超时未交付
大数据-131 - Flink CEP 案例：检测交易活跃用户、超时未交付
武子康
84 0
武子康
|
2月前
|
消息中间件 分布式计算 大数据
大数据-123 - Flink 并行度 相关概念 全局、作业、算子、Slot并行度 Flink并行度设置与测试
大数据-123 - Flink 并行度 相关概念 全局、作业、算子、Slot并行度 Flink并行度设置与测试
武子康
153 0
武子康
|
2月前
|
分布式计算 资源调度 大数据
大数据-110 Flink 安装部署 下载解压配置 Standalone模式启动 打包依赖（一）
大数据-110 Flink 安装部署 下载解压配置 Standalone模式启动 打包依赖（一）
武子康
74 0
武子康
|
2月前
|
分布式计算 资源调度 大数据
大数据-110 Flink 安装部署 下载解压配置 Standalone模式启动 打包依赖（二）
大数据-110 Flink 安装部署 下载解压配置 Standalone模式启动 打包依赖（二）
武子康
78 0
蓝易云
|
2天前
|
监控 关系型数据库 MySQL
Flink CDC MySQL同步MySQL错误记录
在使用Flink CDC同步MySQL数据时，常见的错误包括连接错误、权限错误、表结构变化、数据类型不匹配、主键冲突和
蓝易云
33 16
众所周知
|
1月前
|
消息中间件 资源调度 关系型数据库
如何在Flink on YARN环境中配置Debezium CDC 3.0，以实现实时捕获数据库变更事件并将其传输到Flink进行处理
本文介绍了如何在Flink on YARN环境中配置Debezium CDC 3.0，以实现实时捕获数据库变更事件并将其传输到Flink进行处理。主要内容包括安装Debezium、配置Kafka Connect、创建Flink任务以及启动任务的具体步骤，为构建实时数据管道提供了详细指导。
众所周知
85 9
武子康
|
2月前
|
消息中间件 分布式计算 大数据
大数据-128 - Flink 并行度设置 细节详解 全局、作业、算子、Slot
大数据-128 - Flink 并行度设置 细节详解 全局、作业、算子、Slot
武子康
149 0
武子康
|
2月前
|
资源调度 分布式计算 大数据
大数据-111 Flink 安装部署 YARN部署模式 FlinkYARN模式申请资源、提交任务
大数据-111 Flink 安装部署 YARN部署模式 FlinkYARN模式申请资源、提交任务
武子康
120 0
嘟嘟嘟嘟嘟嘟
|
7月前
|
Oracle 关系型数据库 MySQL
flink cdc 插件问题之报错如何解决
Flink CDC（Change Data Capture）是一个基于Apache Flink的实时数据变更捕获库，用于实现数据库的实时同步和变更流的处理；在本汇总中，我们组织了关于Flink CDC产品在实践中用户经常提出的问题及其解答，目的是辅助用户更好地理解和应用这一技术，优化实时数据处理流程。
嘟嘟嘟嘟嘟嘟
83 0
sunrr
|
7月前
|
Java 关系型数据库 MySQL
Flink CDC有见这个报错不？
【2月更文挑战第29天】Flink CDC有见这个报错不？
sunrr
110 2

热门文章

最新文章

  • 1
    Flink on YARN（上）：一张图轻松掌握基础架构与启动流程
  • 2
    Flink入坑指南 第四章：SQL中的经典操作Group By+Agg
  • 3
    Flink+Hologres实时数仓在Lazada的建设及应用
  • 4
    Flink 消息聚合处理方案
  • 5
    flink timer定时器
  • 6
    江铃汽车基于 Flink 构建数据集成平台的设计与实现
  • 7
    10分钟入门Flink--安装
  • 8
    Flink CDC中MySQL 进行cdc的用户需要什么权限？
  • 9
    10月17日Spark社区直播【Tablestore Spark Streaming Connector -- 海量结构化数据的实时计算和处理】
  • 10
    flink面试问题总结（2）
  • 1
    Flink+Hologres搭建实时数仓
    125
  • 2
    实时计算 Flink版操作报错合集之本地打成jar包，运行报错，idea运行不报错，是什么导致的
    88
  • 3
    实时计算 Flink版操作报错合集之报错显示“Unsupported SQL query! sqlUpdate() only accepts SQL statements of type INSERT and DELETE"是什么意思
    299
  • 4
    实时计算 Flink版操作报错合集之在连接Oracle 19c时报错如何解决
    129
  • 5
    实时计算 Flink版操作报错合集之写入 Kafka 报错 "Failed to send data to Kafka: Failed to allocate memory within the configured max blocking time 60000 ms"，该怎么解决
    538
  • 6
    实时计算 Flink版操作报错合集之遇到报错："An OperatorEvent from an OperatorCoordinator to a task was lost. Triggering task failover to ensure consistency." ，该怎么办
    161
  • 7
    实时计算 Flink版操作报错合集之报错io.debezium.DebeziumException: The db history topic or its content is fully or partially missing. Please check database history topic configuration and re-execute the snapshot. 是什么原因
    396
  • 8
    实时计算 Flink版操作报错合集之向Hudi写入数据时遇到错误如何解决
    138
  • 9
    实时计算 Flink版操作报错合集之使用 Event Time Temporal Join 关联多个 HBase 后，Kafka 数据的某个字段变为 null 是什么原因导致的
    145
  • 10
    实时计算 Flink版操作报错合集之使用 Event Time Temporal Join 关联多个 HBase 后，Kafka 数据的某个字段变为 null 是什么原因导致的
    105

    • 相关课程

    更多
  • 大数据Flink实时旅游平台环境篇 2020版
  • Apache Flink 入门到实战 - Flink开源社区出品
  • 实时计算 Flink 版产品入门与实操
  • 开源 Flink 极速上手教程
  • 大数据实时计算框架Spark快速入门
  • Apache Flink 入门

    • 相关电子书

    更多
  • Flink CDC Meetup PPT - 龚中强
  • Flink CDC Meetup PPT - 王赫
  • Flink CDC Meetup PPT - 覃立辉

    • 相关实验场景

    更多
  • 基于Hologres+Flink搭建GitHub实时数据大屏
  • 基于Flink+Tair搭建实时监控大屏
  • 5分钟上手Flink MySQL连接器
  • 使用Flink实时发现最热Github项目
    • 下一篇
    【案例实战】SpringBoot整合阿里云文件上传OSS