开发者社区 > 大数据与机器学习 > 实时计算 Flink > 正文

oracle-cdc 初始化加载一张大表,这个问题是程序的资源不够了吗?

"2023-01-04 16:51:22,037 INFO com.ververica.cdc.connectors.oracle.source.reader.fetch.OracleScanFetchTask$OracleSnapshotSplitReadTask [] - Exported 770197 records for split 'DEVE3S.MDM.T_MDM_DLR_CAR:0' after 00:10:42.083 2023-01-04 16:51:23,447 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0 2023-01-04 16:51:29,696 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0 2023-01-04 16:51:33,668 INFO com.ververica.cdc.connectors.oracle.source.reader.fetch.OracleScanFetchTask$OracleSnapshotSplitReadTask [] - Exported 770533 records for split 'DEVE3S.MDM.T_MDM_DLR_CAR:0' after 00:10:53.713 2023-01-04 16:51:38,898 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0 2023-01-04 16:51:43,906 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0 2023-01-04 16:51:48,914 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0 2023-01-04 16:51:53,923 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0 2023-01-04 16:51:58,931 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0 2023-01-04 16:52:03,941 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0 2023-01-04 16:52:08,949 INFO com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0

各位大佬, oracle-cdc 初始化加载一张大表,然后日志打印到这个时候就一直输出: com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0. 那这个问题是程序的资源不够了吗? 所以数据一直没有初始化加载完.,taskmanage的内存也到达了94% 就一直维持住。没有异常提示,一直打印info日志 : com.starrocks.data.load.stream.DefaultStreamLoadManager [] - manager report, current Bytes : 0, waitQ : 0, prepareQ : 0, commitQ : 0. "

展开
收起
wenti 2023-01-08 18:36:55 166 0
1 条回答
写回答
取消 提交回答
  • 你这个是StarRocks数据导入的问题,可以检查一下StarRocks状态——该回答整理自钉群“Flink CDC 社区“

    2023-01-08 20:54:22
    赞同 展开评论 打赏

实时计算Flink版是阿里云提供的全托管Serverless Flink云服务,基于 Apache Flink 构建的企业级、高性能实时大数据处理系统。提供全托管版 Flink 集群和引擎,提高作业开发运维效率。

相关电子书

更多
PostgresChina2018_樊文凯_ORACLE数据库和应用异构迁移最佳实践 立即下载
PostgresChina2018_王帅_从Oracle到PostgreSQL的数据迁移 立即下载
Oracle云上最佳实践 立即下载

相关镜像