AI 助理
备案控制台
开发者社区 开发与运维 文章 正文

使用Disruptor BlockingWaitStrategy遭遇死锁dead lock

2023-11-16 95
版权
版权声明：
本文内容由阿里云实名注册用户自发贡献，版权归原作者所有，阿里云开发者社区不拥有其著作权，亦不承担相应法律责任。具体规则请查看《 阿里云开发者社区用户服务协议》和 《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容，填写 侵权投诉表单进行举报，一经查实，本社区将立刻删除涉嫌侵权内容。
简介： 使用Disruptor BlockingWaitStrategy遭遇死锁dead lock

发现跑了半天的game server登录不了，简单jstack了下，发现登录线程 game-bus_init-X 被堵塞了，一直堵在抛出登录事件上，原因是

Affects AAffects Version:3.3.2  Fix version:3.3.6
JDK 1.8
Cause: Nope this is not resolved by dropping the events. Ring Buffer Works on Producer and Consumer Thread Model.This issue actually happened due to signal missed by consumer. As per LMAX disruptor signal miss should not happen.

这不是通过删除事件来解决。 环形缓冲区在生产者和消费者线程模型上工作。这个问题实际上是由于消费者错过信号而发生的。 根据LMAX中断器信号缺失不应该发生。



Solution:by mikeb01

I added support for re-signalling the listeners if the producer encounters a full ring buffer, so if the signal happened to be lost somehow (not convinced that it can be) then it will be on the next attempted publication.

如果生产者遇到一个已塞满的环形缓冲区，我添加了对重新发信号通知监听器的支持，所以如果信号偶然丢失（不确信是不是这个原因），那么它将在下一次重新发布。


If it detects that the ring buffer is full it will re-signal the wait strategy, this should unstick the consumer if it happened to miss a signal.

如果它检测到环形缓冲区已满，它将重发信号的等待策略，如果它碰巧错过一个信号，这应该解锁消费者。

也可以改用Add LiteTimeoutBlockingWaitStrategy 

"game-bus_init-3" #69 daemon prio=5 os_prio=0 tid=0x00007f9ba1cf1800 nid=0x1113 waiting on condition [0x00007f9af25e8000]
   java.lang.Thread.State: WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  - parking to wait for  <0x00000000d5054d20> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  at com.lmax.disruptor.BlockingWaitStrategy.waitFor(BlockingWaitStrategy.java:45)
  at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:55)
  at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:123)
  at java.lang.Thread.run(Thread.java:745)
"game-bus_init-2" #68 daemon prio=5 os_prio=0 tid=0x00007f9ba1cef800 nid=0x1112 runnable [0x00007f9af26e8000]
   java.lang.Thread.State: TIMED_WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:338)
  at com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:136)
  at com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:105)
  at com.lmax.disruptor.RingBuffer.next(RingBuffer.java:246)
  at com.lingyu.common.message.BalanceBusinessExecutor$ExecutorPoolGroup$Executor.execute(BalanceBusinessExecutor.java:156)
  at com.lingyu.game.service.event.EventManager.asyncCall(EventManager.java:84)
  at com.lingyu.game.service.event.AbEvent.advancedAsyncCall(AbEvent.java:114)
  at com.lingyu.game.service.event.AbEvent.dispatch(AbEvent.java:73)
  at com.lingyu.game.service.event.LoginGameEvent.publish(LoginGameEvent.java:130)
  at com.xianling.public_.nodecontrol.service.impl.NodeControlServiceImpl.login(NodeControlServiceImpl.java:55)
  at com.lingyu.game.action.bus.LoginAction.loginGame(LoginAction.java:254)
  at com.lingyu.game.action.bus.LoginActionMethodAccess.invoke(Unknown Source)
  at com.lingyu.common.message.MessageResolver.execute(MessageResolver.java:46)
  at com.lingyu.common.message.MessageMediator.execute(MessageMediator.java:75)
  at com.lingyu.common.message.ExecutorRunnablePool$RunnableImpl.run(ExecutorRunnablePool.java:87)
  at com.lingyu.common.message.GameEventHandler.onEvent(GameEventHandler.java:20)
  at com.lingyu.common.message.GameEventHandler.onEvent(GameEventHandler.java:11)
  at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:128)
  at java.lang.Thread.run(Thread.java:745)
"game-bus_init-1" #67 daemon prio=5 os_prio=0 tid=0x00007f9ba1ced800 nid=0x1111 runnable [0x00007f9af27e9000]
   java.lang.Thread.State: TIMED_WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:338)
  at com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:136)
  at com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:105)
  at com.lmax.disruptor.RingBuffer.next(RingBuffer.java:246)
  at com.lingyu.common.message.BalanceBusinessExecutor$ExecutorPoolGroup$Executor.execute(BalanceBusinessExecutor.java:156)
  at com.lingyu.game.service.event.EventManager.asyncCall(EventManager.java:84)
  at com.lingyu.game.service.event.AbEvent.advancedAsyncCall(AbEvent.java:114)
  at com.lingyu.game.service.event.AbEvent.dispatch(AbEvent.java:73)
  at com.lingyu.game.service.event.LoginGameEvent.publish(LoginGameEvent.java:130)
  at com.xianling.public_.nodecontrol.service.impl.NodeControlServiceImpl.login(NodeControlServiceImpl.java:55)
  at com.lingyu.game.action.bus.LoginAction.loginGame(LoginAction.java:254)
  at com.lingyu.game.action.bus.LoginActionMethodAccess.invoke(Unknown Source)
  at com.lingyu.common.message.MessageResolver.execute(MessageResolver.java:46)
  at com.lingyu.common.message.MessageMediator.execute(MessageMediator.java:75)
  at com.lingyu.common.message.ExecutorRunnablePool$RunnableImpl.run(ExecutorRunnablePool.java:87)
  at com.lingyu.common.message.GameEventHandler.onEvent(GameEventHandler.java:20)
  at com.lingyu.common.message.GameEventHandler.onEvent(GameEventHandler.java:11)
  at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:128)
  at java.lang.Thread.run(Thread.java:745)
"game-bus_init-0" #66 daemon prio=5 os_prio=0 tid=0x00007f9ba1ceb800 nid=0x1110 runnable [0x00007f9af28eb000]
   java.lang.Thread.State: TIMED_WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:338)
  at com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:136)
  at com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:105)
  at com.lmax.disruptor.RingBuffer.next(RingBuffer.java:246)
  at com.lingyu.common.message.BalanceBusinessExecutor$ExecutorPoolGroup$Executor.execute(BalanceBusinessExecutor.java:156)
  at com.lingyu.game.service.event.EventManager.asyncCall(EventManager.java:84)
  at com.lingyu.game.service.event.AbEvent.advancedAsyncCall(AbEvent.java:114)
  at com.lingyu.game.service.event.AbEvent.dispatch(AbEvent.java:73)
  at com.lingyu.game.service.event.LoginGameEvent.publish(LoginGameEvent.java:130)
  at com.xianling.public_.nodecontrol.service.impl.NodeControlServiceImpl.login(NodeControlServiceImpl.java:55)
  at com.lingyu.game.action.bus.LoginAction.loginGame(LoginAction.java:254)
  at com.lingyu.game.action.bus.LoginActionMethodAccess.invoke(Unknown Source)
  at com.lingyu.common.message.MessageResolver.execute(MessageResolver.java:46)
  at com.lingyu.common.message.MessageMediator.execute(MessageMediator.java:75)
  at com.lingyu.common.message.ExecutorRunnablePool$RunnableImpl.run(ExecutorRunnablePool.java:87)
  at com.lingyu.common.message.GameEventHandler.onEvent(GameEventHandler.java:20)
  at com.lingyu.common.message.GameEventHandler.onEvent(GameEventHandler.java:11)
  at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:128)
  at java.lang.Thread.run(Thread.java:745)
"game-bus_cache-3" #65 daemon prio=5 os_prio=0 tid=0x00007f9ba1cea000 nid=0x110f waiting on condition [0x00007f9af29ec000]
   java.lang.Thread.State: WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  - parking to wait for  <0x00000000d5054d80> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  at com.lmax.disruptor.BlockingWaitStrategy.waitFor(BlockingWaitStrategy.java:45)
  at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:55)
  at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:123)
  at java.lang.Thread.run(Thread.java:745)
"game-bus_cache-2" #64 daemon prio=5 os_prio=0 tid=0x00007f9ba1ce8000 nid=0x110e waiting on condition [0x00007f9af2aed000]
   java.lang.Thread.State: WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  - parking to wait for  <0x00000000d5054db0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  at com.lmax.disruptor.BlockingWaitStrategy.waitFor(BlockingWaitStrategy.java:45)
  at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:55)
  at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:123)
  at java.lang.Thread.run(Thread.java:745)
"game-bus_cache-1" #63 daemon prio=5 os_prio=0 tid=0x00007f9ba1ce6000 nid=0x110d waiting on condition [0x00007f9af2bee000]
   java.lang.Thread.State: WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  - parking to wait for  <0x00000000d50e2650> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
  at com.lmax.disruptor.BlockingWaitStrategy.waitFor(BlockingWaitStrategy.java:45)
  at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:55)
  at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:123)
  at java.lang.Thread.run(Thread.java:745)
"game-bus_cache-0" #62 daemon prio=5 os_prio=0 tid=0x00007f9ba1ce4000 nid=0x110c runnable [0x00007f9af2cee000]
   java.lang.Thread.State: TIMED_WAITING (parking)
  at sun.misc.Unsafe.park(Native Method)
  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:338)
  at com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:136)
  at com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:105)
  at com.lmax.disruptor.RingBuffer.next(RingBuffer.java:246)
  at com.lingyu.common.message.BalanceBusinessExecutor$ExecutorPoolGroup$Executor.execute(BalanceBusinessExecutor.java:156)
  at com.lingyu.game.service.event.EventManager.asyncCall(EventManager.java:84)
  at com.lingyu.game.service.event.AbEvent.advancedAsyncCall(AbEvent.java:114)
  at com.lingyu.game.service.event.AbEvent.dispatch(AbEvent.java:73)
  at com.lingyu.game.service.event.MoneyIncrEvent.publish(MoneyIncrEvent.java:65)
  at com.lingyu.game.service.role.RoleManager.incrCoin(RoleManager.java:2369)
  at com.lingyu.game.service.role.CoinMoneyOperation.incr(CoinMoneyOperation.java:19)
  at com.lingyu.game.service.money.MoneyManager.incr(MoneyManager.java:203)
  - locked <0x00000000ebf8eaa8> (a [Ljava.lang.Byte;)
  at com.lingyu.game.service.money.MoneyManager.incr(MoneyManager.java:136)
  at com.lingyu.game.service.money.MoneyManager.incr(MoneyManager.java:171)
  at com.lingyu.game.action.bus.RoleAction.addMoney(RoleAction.java:906)
  at com.lingyu.game.action.bus.RoleActionMethodAccess.invoke(Unknown Source)
  at com.lingyu.common.message.MessageResolver.execute(MessageResolver.java:35)
  at com.lingyu.common.message.MessageMediator.execute(MessageMediator.java:69)
  at com.lingyu.common.message.ExecutorRunnablePool$RunnableImpl.run(ExecutorRunnablePool.java:85)
  at com.lingyu.common.message.GameEventHandler.onEvent(GameEventHandler.java:20)
  at com.lingyu.common.message.GameEventHandler.onEvent(GameEventHandler.java:11)
  at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:128)
  at java.lang.Thread.run(Thread.java:745)

参考文章:

Dead lock observed in BlockingWaitStrategy

Dead lock observed in BlockingWaitStrategy in Log4J

Add LiteTimeoutBlockingWaitStrategy

后发现又重现这个问题了，原来是因为待处理的事件超过了ringbuff size的上限，导致事件又被覆盖导致了，无法处理。

文章标签：
Java
流子
目录
相关文章
众所周知
|
2月前
|
安全 Java 开发者
Java多线程中的`wait()`、`notify()`和`notifyAll()`方法，探讨了它们在实现线程间通信和同步中的关键作用
本文深入解析了Java多线程中的`wait()`、`notify()`和`notifyAll()`方法，探讨了它们在实现线程间通信和同步中的关键作用。通过示例代码展示了如何正确使用这些方法，并分享了最佳实践，帮助开发者避免常见陷阱，提高多线程程序的稳定性和效率。
众所周知
54 1
1387503158665997
|
3月前
|
存储 安全 算法
Wound/Wait死锁安全的互斥锁设计 【ChatgGPT】
Wound/Wait死锁安全的互斥锁设计 【ChatgGPT】
1387503158665997
35 1
土木林森
|
6月前
|
Java
JAVA多线程的“心灵感应”：wait()与notify()的秘密
【6月更文挑战第20天】Java多线程中，`wait()`和`notify()`是线程间协作的关键。它们充当线程间的通信桥梁，使得线程能感知对方状态。例如，生产者线程在资源满时`wait()`，消费者线程消费后`notify()`或`notifyAll()`，确保资源有效利用且避免冲突。简化的代码示例展示了这种同步机制，线程通过等待和唤醒操作实现“心灵感应”般的协同工作。
土木林森
34 3
小谢在努力
|
7月前
|
安全 算法 关系型数据库
线程安全--深入探究线程等待机制和死锁问题
线程安全--深入探究线程等待机制和死锁问题
小谢在努力
228 1
众所周知
|
7月前
|
Java
Java多线程：什么是死锁（Deadlock）？
Java多线程：什么是死锁（Deadlock）？
众所周知
97 0
玉面大蛟龙
|
API
JUC学习（三）：synchronized和Lock实现线程间通信（包含虚假唤醒的讲解）
JUC学习（三）：synchronized和Lock实现线程间通信（包含虚假唤醒的讲解）
玉面大蛟龙
78 0
JUC学习（三）：synchronized和Lock实现线程间通信（包含虚假唤醒的讲解）
lijtao
|
安全 Java
Java并发编程之Wait和Notify
Java并发编程之Wait和Notify
lijtao
135 0
Java并发编程之Wait和Notify
愿荣
|
算法 Java 程序员
Java多线程之死锁问题,wait和notify
Java多线程之死锁问题,wait和notify
愿荣
259 0
Java多线程之死锁问题,wait和notify
JanYork|小简
|
安全 Java
Java并发编程之Lock(同步锁、死锁)
这篇文章是接着我上一篇文章来的。
JanYork|小简
133 0
金士曼
|
安全 Java
Java多线程06—用Lock锁解决线程的安全问题
Java多线程06—用Lock锁解决线程的安全问题
金士曼
146 0
Java多线程06—用Lock锁解决线程的安全问题

热门文章

最新文章

  • 1
    docker容器里安装ssh
  • 2
    优秀的代码都是如何分层的？
  • 3
    RDS入门——Excel文件转存到RDS数据库实践
  • 4
    3、Python与设计模式--建造者模式
  • 5
    PostgreSQL SQL HINT的使用
  • 6
    跟阿里云技术专家阙寒一起深度了解视频直播CDN技术
  • 7
    AjaxFileUploader上传插件 兼容性好
  • 8
    （转载） 数组a[]={3,5,2,4,1,8}，要求从a中找出所有“和”等于10的子集
  • 9
    SAP WM Movement Type Mail Control for Background processing
  • 10
    Ext 4 概述（七）之面板Panel &amp; 杂项
  • 1
    自学记录HarmonyOS Next DRM API 13：构建安全的数字内容保护系统
    42
  • 2
    《MaxFrame：数据处理的卓越实践与提升》
    55
  • 3
    《DataWorks：数据处理的卓越实践与改进思考》
    50
  • 4
    三维球体空间中光线反射模拟与三维点云提取matlab仿真
    46
  • 5
    《多模态数据信息提取解决方案的体验与部署》
    45
  • 6
    基于PSO优化的PV光伏发电系统simulink建模与仿真
    52
  • 7
    数据链中常见电磁干扰matlab仿真,对比噪声调频,线性调频,噪声,扫频,灵巧五种干扰模型
    47
  • 8
    《破局之路：人工智能产业的健康发展》
    38
  • 9
    《强化学习算法在动态环境中的优化之路》
    36
  • 10
    《大模型训练成本高，如何在不牺牲性能的前提下破局》
    40

    • 相关电子书

    更多
  • 低代码开发师（初级）实战教程
  • 冬季实战营第三期：MySQL数据库进阶实战
  • 阿里巴巴DevOps 最佳实践手册
    • 下一篇
    手把手教你白嫖阿里云服务器(免费领服务器)