Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Scale Agnostic Python
Search
Sponsored
·
Your Podcast. Everywhere. Effortlessly.
Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
→
Sean T Allen
August 17, 2017
Programming
280
0
Share
Scale Agnostic Python
Presented to the NYC Python meetup August 17, 2017
Sean T Allen
August 17, 2017
More Decks by Sean T Allen
See All by Sean T Allen
On Deny Capabilities for Safe, Fast Actors
seantallen
1
160
Data corrupting architectures we know and love - VelocityConf San Jose 2019
seantallen
1
140
Data corrupting architectures we know and love
seantallen
0
150
Scale-Independent Python
seantallen
2
260
Pat Helland and Me: How to Build Stateful Distributed Applications That Can Scale Almost Infinitely - Velocity NY October 2018
seantallen
0
120
Adventures in Cgo Preformance
seantallen
0
700
Pat Helland and me: A talk about “Life Beyond Distributed Transactions: An Apostate’s Opinion”
seantallen
0
740
Pat Helland and me: How to build stateful distributed applications that can scale almost infinitely - Salesforce July 2018
seantallen
0
190
Pony: How I learned to stop worrying and embrace an unproven technology - OSCON 2018
seantallen
0
570
Other Decks in Programming
See All in Programming
ハーネスエンジニアリングにどう向き合うか 〜ルールファイルを超えて開発プロセスを設計する〜 / How to approach harness engineering
rkaga
23
13k
Cache-moi si tu peux : patterns et pièges du cache en production - Devoxx France 2026 - Conférence
slecache
0
260
瑠璃の宝石に学ぶ技術の声の聴き方 / 【劇場版】アニメから得た学びを発表会2026 #エンジニアニメ
mazrean
0
260
ハーネスエンジニアリングとは?
kinopeee
11
5.5k
forteeの改修から振り返るPHPerKaigi 2026
muno92
PRO
3
290
iOS機能開発のAI環境と起きた変化
ryunakayama
0
180
Running Swift without an OS
kishikawakatsumi
0
840
ルールルルルルRubyの中身の予備知識 ── RubyKaigiの前に予習しなイカ?
ydah
1
190
mruby on C#: From VM Implementation to Game Scripting (RubyKaigi 2026)
hadashia
2
550
アクセシビリティ試験の"その後"を仕組み化する
yuuumiravy
0
150
「Linuxサーバー構築標準教科書」を読んでみた #ツナギメオフライン.7
akase244
0
1.4k
Angular Signal Forms
debug_mode
0
110
Featured
See All Featured
The Curse of the Amulet
leimatthew05
1
11k
エンジニアに許された特別な時間の終わり
watany
106
240k
Building a Modern Day E-commerce SEO Strategy
aleyda
45
9k
A designer walks into a library…
pauljervisheath
211
24k
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
aleyda
2
10k
End of SEO as We Know It (SMX Advanced Version)
ipullrank
3
4.1k
We Analyzed 250 Million AI Search Results: Here's What I Found
joshbly
1
1.2k
BBQ
matthewcrist
89
10k
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
davidcarrasco
3
110
Odyssey Design
rkendrick25
PRO
2
580
Darren the Foodie - Storyboard
khoart
PRO
3
3.3k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
250
1.3M
Transcript
SCALE AGNOSTIC PYTHON HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT
ANY CODE CHANGES*
SEAN T. ALLEN VP OF ENGINEERING AT SENDENCE AUTHOR OF
“STORM APPLIED” @SEANTALLEN
SCALE AGNOSTIC COMPUTING
THE PROBLEM THE LITTLE APPLICATION THAT COULD… UNTIL IT COULDN’T.
Scaling an application from “little data” to “a little more
data” to “big data” is hard.
OPTIONS
Rewrite the application Rewrite to scale across multiple processes Example:
“multiprocessing” Python library
Run more versions Smart loader to load data in. Perhaps
via a job queue like Celery.
Go scale agnostic Write you application against a scale agnostic
API that runs on a scale aware platform
SENDENCE WALLAROO SCALE AGNOSTIC COMPUTING FOR PYTHON
Sendence Wallaroo Simple Scale Agnostic API Managed in-memory state Guaranteed
Message Processing
“We handle the hard infrastructure plumbing so you don’t have
to.” – The Wallaroo Team
LEARN MORE… sendence.com Sendence Engineering on Twitter: @SendenceEng Pat Helland’s
“Life Beyond Distributed Transactions”