Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Message Queues by Mathias Meyer
Search
Railsberry
April 22, 2013
Technology
1
150
Message Queues by Mathias Meyer
Watch the video here:
https://vimeo.com/68698333
Railsberry
April 22, 2013
Tweet
Share
More Decks by Railsberry
See All by Railsberry
Shipping Post-PC by Antek Piechnik & Marcin Bunsch
railsberry
0
140
Nodecopter by Felix Geisendoerfer
railsberry
0
94
Creative machines by Joseph Wilk
railsberry
1
130
Internal tools by Keavy McMinn
railsberry
1
160
Solid as diamond by Paolo Perego
railsberry
1
160
Future of Online Education by Gregg Pollack
railsberry
3
150
Lessons from the Masters by Geoffrey Grosenbach
railsberry
0
89
Go - a simple programming environment by Andrew Gerrand
railsberry
12
2.7k
Zero-confidence by Katrina Owen
railsberry
4
1.1k
Other Decks in Technology
See All in Technology
より快適なエラーログ監視を目指して
leveragestech
4
1.5k
QAに対する超個人的な解釈 / Personal Take on QA
toma_sm
1
140
PdMはどのように全てのスピードを上げられるか ~ 非連続進化のための具体的な取り組み ~
sansantech
PRO
4
1.3k
言葉は感情の近似値である。その感情と言葉の誤差を最小化しよう ~コミュニケーションにおけるアナログ/デジタル変換の課題に立ち向かう~
nktamago
0
240
「自動テストのプラクティスを効果的に学ぶためのカードゲーム」 ( #sqip2024 )
teyamagu
PRO
2
180
Cloud Run と GitHub Template Repository による軽量なアプリケーションプラットフォーム/ #nikkei_tech_talk
nikkei_engineer_recruiting
0
110
GC24 Recap: Interface Internals
task4233
0
220
事前準備が肝!AI活用のための業務改革
layerx
PRO
1
390
どこよりも遅めなWinActor Ver.7.5.0 新機能紹介
tamai_63
0
210
Developer Experienceを向上させる基盤づくりの取り組み事例集
coconala_engineer
0
160
タイミーのレコメンドにおける ABテストの運用
ozeshun
1
200
「認証認可」という体験をデザインする ~Nekko Cloud認証認可基盤計画
logica0419
2
450
Featured
See All Featured
[RailsConf 2023] Rails as a piece of cake
palkan
48
4.6k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
28
1.6k
A Philosophy of Restraint
colly
202
16k
Designing Experiences People Love
moore
138
23k
Six Lessons from altMBA
skipperchong
26
3.4k
The Invisible Customer
myddelton
119
13k
Bash Introduction
62gerente
608
210k
Creatively Recalculating Your Daily Design Routine
revolveconf
215
12k
GraphQLの誤解/rethinking-graphql
sonatard
65
9.8k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
24
610
Done Done
chrislema
180
16k
Typedesign – Prime Four
hannesfritz
39
2.3k
Transcript
the message queue is dead railsberry 2013, mathias meyer, @roidrage
travis-ci.org
None
None
None
the golden rules of message queues
#1 everything is a queue
www email upload live updates
rabbitmq activemq mqseries nsq beanstalkd sqs gearman qless kafka kestrel
qpid sidekiq resque zeromq celery mqseries stormmq amqp jms hornetq swiftmq delayed_job
tasks
publish/subscribe
publish/subscribe
broker
None
log streaming databass
None
unbounded queues
#2 a queue is either empty or infinitely full
the art of capacity planning
50 msg * 60 seconds * 30 minutes = 90000
msg
peak capacity: 120 msg/s
90000 msg / 120 msg/s = 12,5 min
None
#3 whenever something breaks, it's a queue backing up or
dropping messages
None
databass x x P x
None
retry databass x x P x
exponential backoff databass x x P x
handling queues involves business decisions
a thought experiment
message queues introduce tight coupling
hide the queue api
api
api
the queue is dead, long live the queue
no berries were harmed © railsberry