Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Message Queues by Mathias Meyer
Search
Railsberry
April 22, 2013
Technology
1
150
Message Queues by Mathias Meyer
Watch the video here:
https://vimeo.com/68698333
Railsberry
April 22, 2013
Tweet
Share
More Decks by Railsberry
See All by Railsberry
Shipping Post-PC by Antek Piechnik & Marcin Bunsch
railsberry
0
150
Nodecopter by Felix Geisendoerfer
railsberry
0
94
Creative machines by Joseph Wilk
railsberry
1
140
Internal tools by Keavy McMinn
railsberry
1
170
Solid as diamond by Paolo Perego
railsberry
1
160
Future of Online Education by Gregg Pollack
railsberry
3
150
Lessons from the Masters by Geoffrey Grosenbach
railsberry
0
92
Go - a simple programming environment by Andrew Gerrand
railsberry
12
2.7k
Zero-confidence by Katrina Owen
railsberry
4
1.2k
Other Decks in Technology
See All in Technology
[Ruby] Develop a Morse Code Learning Gem & Beep from Strings
oguressive
1
180
サービスでLLMを採用したばっかりに振り回され続けたこの一年のあれやこれや
segavvy
2
520
.NET 9 のパフォーマンス改善
nenonaninu
0
1.2k
3年でバックエンドエンジニアが5倍に増えても破綻しなかったアーキテクチャ そして、これから / Software architecture that scales even with a 5x increase in backend engineers in 3 years
euglena1215
5
960
TSKaigi 2024 の登壇から広がったコミュニティ活動について
tsukuha
0
160
サイボウズフロントエンドエキスパートチームについて / FrontendExpert Team
cybozuinsideout
PRO
5
38k
第3回Snowflake女子会_LT登壇資料(合成データ)_Taro_CCCMK
tarotaro0129
0
200
コンテナセキュリティのためのLandlock入門
nullpo_head
2
320
権威ドキュメントで振り返る2024 #年忘れセキュリティ2024
hirotomotaguchi
2
760
成果を出しながら成長する、アウトプット駆動のキャッチアップ術 / Output-driven catch-up techniques to grow while producing results
aiandrox
0
370
私なりのAIのご紹介 [2024年版]
qt_luigi
1
120
マイクロサービスにおける容易なトランザクション管理に向けて
scalar
0
150
Featured
See All Featured
ReactJS: Keep Simple. Everything can be a component!
pedronauck
665
120k
Why You Should Never Use an ORM
jnunemaker
PRO
54
9.1k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
6
450
Statistics for Hackers
jakevdp
796
220k
How to Think Like a Performance Engineer
csswizardry
22
1.2k
It's Worth the Effort
3n
183
28k
Building Adaptive Systems
keathley
38
2.3k
How To Stay Up To Date on Web Technology
chriscoyier
789
250k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
159
15k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
48k
Transcript
the message queue is dead railsberry 2013, mathias meyer, @roidrage
travis-ci.org
None
None
None
the golden rules of message queues
#1 everything is a queue
www email upload live updates
rabbitmq activemq mqseries nsq beanstalkd sqs gearman qless kafka kestrel
qpid sidekiq resque zeromq celery mqseries stormmq amqp jms hornetq swiftmq delayed_job
tasks
publish/subscribe
publish/subscribe
broker
None
log streaming databass
None
unbounded queues
#2 a queue is either empty or infinitely full
the art of capacity planning
50 msg * 60 seconds * 30 minutes = 90000
msg
peak capacity: 120 msg/s
90000 msg / 120 msg/s = 12,5 min
None
#3 whenever something breaks, it's a queue backing up or
dropping messages
None
databass x x P x
None
retry databass x x P x
exponential backoff databass x x P x
handling queues involves business decisions
a thought experiment
message queues introduce tight coupling
hide the queue api
api
api
the queue is dead, long live the queue
no berries were harmed © railsberry