Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Message Queue is Dead, Long Live the Messag...
Search
Mathias Meyer
April 22, 2013
Technology
4
680
The Message Queue is Dead, Long Live the Message Queue
Ramblings and thought experiments on message queues
Mathias Meyer
April 22, 2013
Tweet
Share
More Decks by Mathias Meyer
See All by Mathias Meyer
Building and Scaling an Distributed and Inclusive Team
roidrage
0
1.2k
cooking infrastructure with chef
roidrage
4
220
riak-js
roidrage
1
270
designing for concurrency with riak
roidrage
11
1.8k
metrics, monitoring, logging
roidrage
82
14k
design for cloud - jax 2012
roidrage
2
290
A Riak Query Tale
roidrage
5
1k
Don't Use NoSQL
roidrage
10
1k
Designing Applications for Amazon Web Services (GOTO Aarhus)
roidrage
6
350
Other Decks in Technology
See All in Technology
JTCや セキュリティチェックリストが夢の跡
nikinusu
2
1k
内製化を目指す事業会社が、システム開発会社と共に進める「開発生産性改善」の取り組み事例 #devsumi
yuwji
1
350
エムスリーエビデンス創出プロダクトチーム紹介資料 / Introduction of M3 Create Evidence Team
m3_engineering
0
1.9k
急拡大する開発組織を支えるナレッジワークの E2E テスト基盤
kworkdev
PRO
1
480
フロントエンド開発事例① LINEギフト
lycorptech_jp
PRO
1
140
Android15(SDK35)から強制される、Edge-to-Edgeに対応しなければならない
sansantech
PRO
0
320
CDK Pipelinesをざっくり理解する
smt7174
0
190
タイミーのレコメンドにおける ABテストの運用
ozeshun
2
300
REST API Design Pitfalls
victorrentea
0
390
Introducing NgRx in an Nx Angular Workspace
fabiangosebrink
0
170
静的サイトのCI/CDでも侮るなかれ!Docs as Codeに沿ったセキュアな開発プロセスの実践/secure-docsascode-cicd-for-static-sites
mhrtech
11
1.9k
LLMの効率化を支えるアルゴリズム
taturabe
16
4k
Featured
See All Featured
Web Components: a chance to create the future
zenorocha
309
42k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
190
16k
Become a Pro
speakerdeck
PRO
22
4.9k
Building a Modern Day E-commerce SEO Strategy
aleyda
36
6.8k
Ruby is Unlike a Banana
tanoku
96
11k
Statistics for Hackers
jakevdp
794
220k
Done Done
chrislema
180
16k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
39
9.2k
In The Pink: A Labor of Love
frogandcode
139
22k
Being A Developer After 40
akosma
84
590k
The Art of Programming - Codeland 2020
erikaheidi
48
13k
Stop Working from a Prison Cell
hatefulcrawdad
267
20k
Transcript
the message queue is dead railsberry 2013, mathias meyer, @roidrage
travis-ci.org
None
None
None
the golden rules of message queues
#1 everything is a queue
www email upload live updates
rabbitmq activemq mqseries nsq beanstalkd sqs gearman qless kafka kestrel
qpid sidekiq resque zeromq celery mqseries stormmq amqp jms hornetq swiftmq delayed_job
tasks
publish/subscribe
publish/subscribe
broker
None
log streaming databass
None
unbounded queues
#2 a queue is either empty or infinitely full
the art of capacity planning
50 msg * 60 seconds * 30 minutes = 90000
msg
peak capacity: 120 msg/s
90000 msg / 120 msg/s = 12,5 min
None
#3 whenever something breaks, it's a queue backing up or
dropping messages
None
databass x x P x
None
retry databass x x P x
exponential backoff databass x x P x
handling queues involves business decisions
a thought experiment
message queues introduce tight coupling
hide the queue api
api
api
the queue is dead, long live the queue
no berries were harmed © railsberry