问题描述

我在使用Flink + Flink cdc + Paimon + oss 做数据同步，在cdc的yaml里指定了paimon的文件格式是parquet，但生成的文件依然是默认的文件格式orc，请问是什么原因？

软件版本

• Flink ：1.18.1
• Flink CDC : 3.1.0
• Paimon： 0.8.0

cdc yaml

source:
  type: mysql
  name: MySQL Source
  hostname: 192.168.xxx.xxx
  port: 3306
  username: xxxx
  password: xxxx
  tables: paimon_test.users,paimon_test.products,paimon_test.order_details,paimon_test.orders
  server-id: 5401-5404
  scan.startup.mode: initial
  jdbc.properties.useSSL: false
  server-time-zone: Asia/Shanghai

sink:
  type: paimon
  name: Paimon Sink
  catalog.properties.file.format: parquet
  catalog.properties.metastore: filesystem
  catalog.properties.warehouse: oss://paimon-test/warehouse
  catalog.properties.fs.oss.endpoint: oss-cn-shenzhen.aliyuncs.com
  catalog.properties.fs.oss.accessKeyId: xxxxx
  catalog.properties.fs.oss.accessKeySecret: xxx


pipeline:
  name: MySQL to Paimon Pipeline OSS
  parallelism: 1