Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Path Towards Simplifying Consistency in Dis...
Search
Caitie McCaffrey
April 24, 2017
Technology
1
340
The Path Towards Simplifying Consistency in Distributed Systems
Caitie McCaffrey
April 24, 2017
Tweet
Share
More Decks by Caitie McCaffrey
See All by Caitie McCaffrey
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
332
22k
Argus Papers We Love
caitiem20
14
1.2k
The Verification of a Distributed System
caitiem20
22
2.3k
We Hear You Like Papers: Eventual Consistency
caitiem20
14
830
The Verification of a Distributed System
caitiem20
12
780
The Verification of a Distributed System
caitiem20
6
790
A Brief History of Distributed Programming: RPC
caitiem20
31
6.7k
Building Scalable Stateful Services
caitiem20
12
1.6k
Papers we Love PDX
caitiem20
2
1.3k
Other Decks in Technology
See All in Technology
増え続ける脆弱性に立ち向かう: 事前対策と優先度づけによる 持続可能な脆弱性管理 / Confronting the Rise of Vulnerabilities: Sustainable Management Through Proactive Measures and Prioritization
nttcom
1
230
LLM開発を支えるエヌビディアの生成AIエコシステム
acceleratedmu3n
0
360
LLMをツールからプラットフォームへ〜Ai Workforceの戦略〜 #BetAIDay
layerx
PRO
1
600
大規模イベントを支える ABEMA の アーキテクチャ 変遷 2025
nagapad
6
600
AI コードレビューが面倒すぎるのでテスト駆動開発で解決しようとして読んだら、根本的に俺の勘違いだった
mutsumix
0
140
メモ整理が苦手な者による頑張らないObsidian活用術
optim
1
170
With Devin -AIの自律とメンバーの自立
kotanin0
2
1k
Rubyの国のPerlMonger
anatofuz
2
680
GMOペパボのデータ基盤とデータ活用の現在地 / Current State of GMO Pepabo's Data Infrastructure and Data Utilization
zaimy
3
170
反脆弱性(アンチフラジャイル)とデータ基盤構築
cuebic9bic
2
130
Power Automate のパフォーマンス改善レシピ / Power Automate Performance Improvement Recipes
karamem0
0
280
Microsoft Learn MCP/Fabric データエージェント/Fabric MCP/Copilot Studio-簡単・便利なAIエージェント作ってみた -"Building Simple and Powerful AI Agents with Microsoft Learn MCP, Fabric Data Agent, Fabric MCP, and Copilot Studio"-
reireireijinjin6
1
210
Featured
See All Featured
Designing Experiences People Love
moore
142
24k
Music & Morning Musume
bryan
46
6.7k
Build The Right Thing And Hit Your Dates
maggiecrowley
37
2.8k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
283
13k
The Straight Up "How To Draw Better" Workshop
denniskardys
235
140k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.4k
BBQ
matthewcrist
89
9.8k
[RailsConf 2023] Rails as a piece of cake
palkan
56
5.7k
Intergalactic Javascript Robots from Outer Space
tanoku
272
27k
Designing for humans not robots
tammielis
253
25k
How to Think Like a Performance Engineer
csswizardry
25
1.8k
Unsuck your backbone
ammeep
671
58k
Transcript
The Path Towards Simplifying Consistency in Distributed Systems
Caitie McCaffrey Distributed Systems Engineer caitiem.com @caitie
Distributed Systems Engineer Feral Concurrency Control Programmer Caitie McCaffrey
2015
2015 “Application-level Mechanisms for maintaining database integrity”
Halo 4 Statistics Service Halo 4 Statistics Service Record &
Aggregate Statistics From Every Multiplayer Halo Game a User Plays
Halo 4 Statistics Service
Observability at Twitter Make Dashboards & Alerts Always Available
Cmd Line Tool Viz / Dashboad Alerting Svc Cuckoo-Read Cuckoo-Write
Indexing Svc Relay Svc Twitter Front End Twitter Svc Twitter Statsite Twitter Svc Twitter Svc Scribe Collection Agent HDFS Manhattan Database Public Cloud Observability at Twitter
Notify Users When We Receive Abuse Reports
Notify Users If An Action is Taken
Report Events Stream Modification Events Stream Enrollment Events Stream Listener
Service Daemons Service Executor Service Notification Events Stream Notification Service Manhattan Macaw
Feral Concurrency Control
Service Service Service Monoliths
The Rise of NoSQL
None
Microservices
State of Affairs
Linearizable Sequential Causal Pipelined Random Access Memory Read Your Write
Monotonic Read Monotonic Write Write From Read Consistency Models
None
None
None
None
None
None
Can We Do Better?
Finance & Accounting
VisiCalc 1979
1983 Lotus 123
None
1987 Excel
None
& Standardization Computer Aided Computation
Standardization for Consistency in Distributed Systems
1988
1988 “We believe the form of communication that is needed
is remote procedure call with at- most-once semantics”
1988 “An adequate language must provide a modular, reasonably automatic
method for achieving consistency ”
Branch B Account 789: $250 Branch A Account 123 :
$100 Account 456: $50 SubAction: Deposit (123, 50) Transfer Action SubAction: Withdraw(789, 50) Transfer Deposit Withdraw enter topaction coenter action branchA.Deposit(123, 50) action branchB.Withdraw(789, 50) end end
What about Spanner?
2015
2015 “The biggest barrier…is that consistency mechanisms must integrate across
many stateful services”
Microservices
CRDTs * Stolen from Chris Meiklejohn in practice
CRDTs * Stolen from Chris Meiklejohn in practice
There Is No One Size Fits All Consistency Model
Mixed Consistency Data Stores Manhattan
None
Computer Aided Computation for Consistency in Distributed Systems
2016
Bank Application Bank Account must be > 0 Deposit Money
Withdrawal Money
‘Cause I’m Strong Enough: Reasoning About Consistency Choices in Distributed
Systems
Define Invariants & Actions Deposit Money Withdrawal Money Determine Consistency
Required Bank Account > 0 Eventual Consistency Strong Consistency Code Generation?
& Standardization Computer Aided Computation
Thank you @caitie