开发者社区> 问答> 正文

Rewind offset to a previous position and ensure ce

Rewind offset to a previous position and ensure certainty. I'm trying to use Kafka as an event store and I want to create several partitions to improve read/write throughput. Occasionally I need to rewind offset to a previous position for recomputing. Since order isn't guaranteed among partitions in Kafka, does this mean that Flink won't produce the same results as before when rewind even if it uses event time? For example, consumer for a partition progresses extremely fast and raises watermark, so events from other partitions are discarded. Is there any ways to prevent this from happening?*来自志愿者整理的flink邮件归档

展开
收起
EXCEED 2021-12-08 11:29:03 651 0
1 条回答
写回答
取消 提交回答
  • Are you finding how to generate watermark pre Kafka partition? Flink provides Kafka-partition-aware watermark generation. 1

    2021-12-08 13:54:43
    赞同 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
Why you should care about data layout in the file system 立即下载
The Leaky Pipeline Problem: Making your Mark as a Woman in Big Data 立即下载
Tracking-Ransomware-End-To-End 立即下载