https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/rabbitmq.html

RabbitMQ Source

This connector provides a RMQSource class to consume messages from a RabbitMQ queue. This source provides three different levels of guarantees, depending on how it is configured with Flink:

  1. Exactly-once: In order to achieve exactly-once guarantees with the RabbitMQ source, the following is required -

    • Enable checkpointing: With checkpointing enabled, messages are only acknowledged (hence, removed from the RabbitMQ queue) when checkpoints are completed.
    • Use correlation ids: Correlation ids are a RabbitMQ application feature. You have to set it in the message properties when injecting messages into RabbitMQ. The correlation id is used by the source to deduplicate any messages that have been reprocessed when restoring from a checkpoint.
    • Non-parallel source: The source must be non-parallel (parallelism set to 1) in order to achieve exactly-once. This limitation is mainly due to RabbitMQ’s approach to dispatching messages from a single queue to multiple consumers.

  2. At-least-once: When checkpointing is enabled, but correlation ids are not used or the source is parallel, the source only provides at-least-once guarantees.

  3. No guarantee: If checkpointing isn’t enabled, the source does not have any strong delivery guarantees. Under this setting, instead of collaborating with Flink’s checkpointing, messages will be automatically acknowledged once the source receives and processes them.

最新文章

  1. Newtonsoft.Json解析Json字符串案例：
  2. xml文件格式说明
  3. About_PHP
  4. JavaScript学习汇总
  5. ssh 远程 centos 乱码
  6. 【PythonChallenge】Level 3
  7. Hash表的使用
  8. js中高度与宽度的获取
  9. 微信小程序结合后台数据管理实现商品数据的动态展示、维护
  10. Sql的基础知识(一)
  11. C++版 - HDUoj 2010 3阶的水仙花数 - 牛客网
  12. AIX 网络设置
  13. centos----------centos下如何安装phpstorm
  14. QT插件+ROS 2 新建项目
  15. PHP函数 ------ ctype_alnum
  16. AEAI DP V3.8.0 升级说明，开源综合应用开发平台
  17. 实训五（Cocos2dx-3.x 打包apk再理解）
  18. 「Vue」父子组件之间的传值及调用方法
  19. 批量转换gbk编码的java代码为utf8
  20. VC6_导入lib库

热门文章

  1. 九度oj 题目1491：求1和2的个数
  2. 转载： GMM-HMM学习笔记
  3. __new__ 与 __init__的区别
  4. 16.1114 模拟考试T1
  5. mysqldumpslow不是内部或外部命令，也不是可运行的程序
  6. dedecms--需要注意的细节
  7. js react 全选和反选
  8. 2018 ICPC 沈阳网络赛预赛 Supreme Number（找规律）
  9. UVA 11346 Probability
  10. UICollectionView 使用 介绍