Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Scale Agnostic Python
Search
Sean T Allen
August 17, 2017
Programming
0
190
Scale Agnostic Python
Presented to the NYC Python meetup August 17, 2017
Sean T Allen
August 17, 2017
Tweet
Share
More Decks by Sean T Allen
See All by Sean T Allen
On Deny Capabilities for Safe, Fast Actors
seantallen
1
93
Data corrupting architectures we know and love - VelocityConf San Jose 2019
seantallen
1
100
Data corrupting architectures we know and love
seantallen
0
100
Scale-Independent Python
seantallen
2
210
Pat Helland and Me: How to Build Stateful Distributed Applications That Can Scale Almost Infinitely - Velocity NY October 2018
seantallen
0
78
Adventures in Cgo Preformance
seantallen
0
630
Pat Helland and me: A talk about “Life Beyond Distributed Transactions: An Apostate’s Opinion”
seantallen
0
570
Pat Helland and me: How to build stateful distributed applications that can scale almost infinitely - Salesforce July 2018
seantallen
0
160
Pony: How I learned to stop worrying and embrace an unproven technology - OSCON 2018
seantallen
0
420
Other Decks in Programming
See All in Programming
GenU導入でCDKに初挑戦し、悪戦苦闘した話
hideg
0
160
オートマトン学習しろ / Do automata learning
makenowjust
3
130
watsonx.ai Dojo #2 生成AIを使ったアプリ開発入門編
oniak3ibm
PRO
0
110
Ebitengineの1vs1ゲーム WebRTCの活用
ponyo877
0
380
LangChainでWebサイトの内容取得やGitHubソースコード取得
shukob
0
160
Boost Performance and Developer Productivity with Jakarta EE 11
ivargrimstad
0
440
月間4.5億回再生を超える大規模サービス TVer iOSアプリのリアーキテクチャ戦略 - iOSDC2024
techtver
PRO
1
930
全部見せます! クラシルリワードのSwiftTesting移行プロジェクト
uetyo
0
210
REXML改善のその後
naitoh
0
190
意外とフォントが大事だった話 / Font Issues on Internationalization
fumi23
0
110
メモリ最適化を究める!iOSアプリ開発における5つの重要なポイント
yhirakawa333
0
410
Desafios e Lições Aprendidas na Migração de Monólitos para Microsserviços em Java
jessilyneh
2
150
Featured
See All Featured
Making Projects Easy
brettharned
113
5.8k
Being A Developer After 40
akosma
84
590k
RailsConf 2023
tenderlove
28
810
Atom: Resistance is Futile
akmur
261
25k
Scaling GitHub
holman
458
140k
How To Stay Up To Date on Web Technology
chriscoyier
786
250k
Gamification - CAS2011
davidbonilla
79
5k
Code Review Best Practice
trishagee
62
16k
Adopting Sorbet at Scale
ufuk
73
8.9k
The World Runs on Bad Software
bkeepers
PRO
64
11k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
157
15k
A better future with KSS
kneath
235
17k
Transcript
SCALE AGNOSTIC PYTHON HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT
ANY CODE CHANGES*
SEAN T. ALLEN VP OF ENGINEERING AT SENDENCE AUTHOR OF
“STORM APPLIED” @SEANTALLEN
SCALE AGNOSTIC COMPUTING
THE PROBLEM THE LITTLE APPLICATION THAT COULD… UNTIL IT COULDN’T.
Scaling an application from “little data” to “a little more
data” to “big data” is hard.
OPTIONS
Rewrite the application Rewrite to scale across multiple processes Example:
“multiprocessing” Python library
Run more versions Smart loader to load data in. Perhaps
via a job queue like Celery.
Go scale agnostic Write you application against a scale agnostic
API that runs on a scale aware platform
SENDENCE WALLAROO SCALE AGNOSTIC COMPUTING FOR PYTHON
Sendence Wallaroo Simple Scale Agnostic API Managed in-memory state Guaranteed
Message Processing
“We handle the hard infrastructure plumbing so you don’t have
to.” – The Wallaroo Team
LEARN MORE… sendence.com Sendence Engineering on Twitter: @SendenceEng Pat Helland’s
“Life Beyond Distributed Transactions”