Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scale Agnostic Python

Avatar for Sean T Allen Sean T Allen
August 17, 2017
Programming
0
240

Scale Agnostic Python

Presented to the NYC Python meetup August 17, 2017
Avatar for Sean T Allen

Sean T Allen

August 17, 2017
Tweet

More Decks by Sean T Allen

See All by Sean T Allen
On Deny Capabilities for Safe, Fast Actors
Avatar for Sean T Allen seantallen
1
120
Data corrupting architectures we know and love - VelocityConf San Jose 2019
Avatar for Sean T Allen seantallen
1
120
Data corrupting architectures we know and love
Avatar for Sean T Allen seantallen
0
120
Scale-Independent Python
Avatar for Sean T Allen seantallen
2
240
Pat Helland and Me: How to Build Stateful Distributed Applications That Can Scale Almost Infinitely - Velocity NY October 2018
Avatar for Sean T Allen seantallen
0
94
Adventures in Cgo Preformance
Avatar for Sean T Allen seantallen
0
660
Pat Helland and me: A talk about “Life Beyond Distributed Transactions: An Apostate’s Opinion”
Avatar for Sean T Allen seantallen
0
680
Pat Helland and me: How to build stateful distributed applications that can scale almost infinitely - Salesforce July 2018
Avatar for Sean T Allen seantallen
0
180
Pony: How I learned to stop worrying and embrace an unproven technology - OSCON 2018
Avatar for Sean T Allen seantallen
0
510

Other Decks in Programming

See All in Programming
MDN Web Docs に日本語翻訳でコントリビュートしたくなる
Avatar for uutan1108 ohmori_yusuke
1
130
『自分のデータだけ見せたい！』を叶える──Laravel × Casbin で複雑権限をスッキリ解きほぐす 25 分
Avatar for AkitoTsukahara akitotsukahara
2
640
設計やレビューに悩んでいるPHPerに贈る、クリーンなオブジェクト設計の指針たち
Avatar for panda_program panda_program
6
2.2k
#kanrk08 / 公開版 PicoRubyとマイコンでの自作トレーニング計測装置を用いたワークアウトの理想と現実
Avatar for bash0C7 bash0c7
1
790
코딩 에이전트 체크리스트: Claude Code ver.
Avatar for nacyot nacyot
0
760
システム成長を止めない！本番無停止テーブル移行の全貌
Avatar for さかうぇ sakawe_ee
1
210
Porting a visionOS App to Android XR
Avatar for Akio Itaya akkeylab
0
600
状態遷移図を書こう / Sequence Chart vs State Diagram
Avatar for Kuniwak orgachem
PRO
1
130
ソフトウェア品質を数字で捉える技術。事業成長を支えるシステム品質の マネジメント
Avatar for takuya542 takuya542
2
14k
猫と暮らす Google Nest Cam生活🐈 / WebRTC with Google Nest Cam
Avatar for Yutaro Muta yutailang0119
0
160
Rails Frontend Evolution: It Was a Setup All Along
Avatar for Svyatoslav Kryukov skryukov
0
170
AI Agent 時代のソフトウェア開発を支える AWS Cloud Development Kit (CDK)
Avatar for Kenji Kono konokenj
4
380

Featured

See All Featured
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.3k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
26
2.9k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
126
53k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
207
24k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
32
2.4k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
72
4.9k
Visualization
Avatar for Eitan Lees eitanlees
146
16k
It's Worth the Effort
Avatar for 3n 3n
185
28k
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
31
8.7k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.7k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
7
510

Transcript

  1. SCALE AGNOSTIC PYTHON HOW TO SCALE YOUR PYTHON APPLICATION WITHOUT

    ANY CODE CHANGES*

  2. SEAN T. ALLEN VP OF ENGINEERING AT SENDENCE AUTHOR OF

    “STORM APPLIED” @SEANTALLEN

  3. SCALE AGNOSTIC COMPUTING

  4. THE PROBLEM THE LITTLE APPLICATION THAT COULD… UNTIL IT COULDN’T.

  5. Scaling an application from “little data” to “a little more

    data” to “big data” is hard.

  6. OPTIONS

  7. Rewrite the application Rewrite to scale across multiple processes Example:

    “multiprocessing” Python library

  8. Run more versions Smart loader to load data in. Perhaps

    via a job queue like Celery.

  9. Go scale agnostic Write you application against a scale agnostic

    API that runs on a scale aware platform

  10. SENDENCE WALLAROO SCALE AGNOSTIC COMPUTING FOR PYTHON

  11. Sendence Wallaroo Simple Scale Agnostic API Managed in-memory state Guaranteed

    Message Processing

  12. “We handle the hard infrastructure plumbing so you don’t have

    to.” – The Wallaroo Team

  13. LEARN MORE… sendence.com Sendence Engineering on Twitter: @SendenceEng Pat Helland’s

    “Life Beyond Distributed Transactions”