开发者社区> 问答> 正文

flink sql报错: Could not find any format factory for

Hi:

在使用flink sql connector的filesytem时,指定format为parquet。抛出异常信息

Caused by: org.apache.flink.table.api.ValidationException: Could not find any format factory for identifier 'parquet' in the classpath.

at org.apache.flink.table.filesystem.FileSystemTableSource. (FileSystemTableSource.java:97)

at org.apache.flink.table.filesystem.FileSystemTableFactory.createDynamicTableSource(FileSystemTableFactory.java:72)

at org.apache.flink.table.factories.FactoryUtil.createTableSource(FactoryUtil.java:119)

... 41 more

Sql语句如下:

CREATE TABLE user_info (

user_id bigint,

user_name string

) PARTITIONED BY (user_id) WITH (

'connector' = 'filesystem',

'path' = '',

'format' = 'parquet'

);

CREATE TABLE sink_table (

user_id bigint,

user_name string

) PARTITIONED BY (datetime) WITH (

'connector'='filesystem',

'path'='',

'format'='parquet',

'sink.partition-commit.delay'='1h',

'sink.partition-commit.policy.kind'='success-file'

);

insert OVERWRITE sink_table select *, '2021062600' as datetime from user_info;*来自志愿者整理的flink邮件归档

展开
收起
彗星halation 2021-12-02 11:32:24 2084 0
1 条回答
写回答
取消 提交回答
  • 您好,

    添加的parquet 依赖如下,不知道全不全

    org.apache.flink

    flink-parquet_${scala.binary.version}

    ${flink.version}

    org.apache.parquet

    parquet-avro

    1.10.1

    *来自志愿者整理的FLINK邮件归档

    2021-12-02 11:47:43
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
SQL Server在电子商务中的应用与实践 立即下载
GeoMesa on Spark SQL 立即下载
原生SQL on Hadoop引擎- Apache HAWQ 2.x最新技术解密malili 立即下载