关于deleteExpiredFile函数的一个问题

消息堆积,并且立即执行磁盘速率阈值(例如0.85或0.90)来删除文件。这种情况可能会导致未使用的消息被删除和消息丢失。

代码如下:

 `private void deleteExpiredFiles() {
    int deleteCount = 0;

    long fileReservedTime = DefaultMessageStore.this.getMessageStoreConfig().getFileReservedTime();
    int deletePhysicFilesInterval = DefaultMessageStore.this.getMessageStoreConfig().getDeleteCommitLogFilesInterval();
    int destroyMapedFileIntervalForcibly = DefaultMessageStore.this.getMessageStoreConfig().getDestroyMapedFileIntervalForcibly();

    boolean timeup = this.isTimeToDelete();

    // core code
    boolean spacefull = this.isSpaceToDelete();

    boolean manualDelete = this.manualDeleteFileSeveralTimes > 0;


    if (timeup || spacefull || manualDelete) {
        if (manualDelete)
            this.manualDeleteFileSeveralTimes--;

        // core code
        boolean cleanAtOnce = DefaultMessageStore.this.getMessageStoreConfig().isCleanFileForciblyEnable() && this.cleanImmediately;

        log.info("begin to delete before {} hours file. timeup: {} spacefull: {} manualDeleteFileSeveralTimes: {} cleanAtOnce: {}",
                fileReservedTime,
                timeup,
                spacefull,
                manualDeleteFileSeveralTimes,
                cleanAtOnce);

        fileReservedTime *= 60 * 60 * 1000;

        deleteCount = DefaultMessageStore.this.commitLog.deleteExpiredFile(
                fileReservedTime,
                deletePhysicFilesInterval,
                destroyMapedFileIntervalForcibly,
                cleanAtOnce);

        if (deleteCount > 0) {
        } else if (spacefull) {
            log.warn("disk space will be full soon, but delete file failed.");
        }
    }
}`

原提问者GitHub用户gentryhuang

展开
收起
芬奇福贵 2023-05-26 10:32:17 64 分享 版权
1 条回答
写回答
取消 提交回答
  • IMO,用户应在磁盘使用量达到0.85之前对其进行监控。RocketMQ设置了两级服务降级:当磁盘使用量达到0.85时,立即删除最旧的文件,以缓解可用服务(RW)的磁盘压力;当磁盘使用率达到0.9时,请防止写入可用服务(R)。

    原回答者GitHub用户lizhiboo

    2023-05-26 16:50:17
    赞同 展开评论
问答地址: