Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Effective Datomic Imports
Search
Ryan Neufeld
March 24, 2014
Programming
1
150
Effective Datomic Imports
Ryan Neufeld
March 24, 2014
Tweet
Share
More Decks by Ryan Neufeld
See All by Ryan Neufeld
Simulant in Anger; An Experience Report
rkneufeld
0
460
Datomic for the 96% - Redux
rkneufeld
5
700
So, you want to write a book?
rkneufeld
1
100
Web Apps on a Pedestal
rkneufeld
3
1.9k
Clojure Cookbook - Jam Session
rkneufeld
1
190
Other Decks in Programming
See All in Programming
GoのIteratorに詳しくなってしまう
inatonix
1
200
Ebitengineの1vs1ゲーム WebRTCの活用
ponyo877
0
380
オートマトン学習しろ / Do automata learning
makenowjust
3
130
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
0
120
Some more adventure of Happy Eyeballs
coe401_
2
190
What is Parser
yui_knk
9
4.1k
仮想ファイルシステムを導入して開発環境のストレージ課題を解消する
segadevtech
2
550
Desafios e Lições Aprendidas na Migração de Monólitos para Microsserviços em Java
jessilyneh
2
150
Rubyとクリエイティブコーディングの輪の広がり / The Growing Circle of Ruby and Creative Coding
chobishiba
1
270
Go1.23で入った errorsパッケージの小さなアプデ
kuro_kurorrr
2
390
私のEbitengineの第一歩
qt_luigi
0
450
KSPの導入・移行を前向きに検討しよう!
shxun6934
PRO
0
280
Featured
See All Featured
How to train your dragon (web standard)
notwaldorf
85
5.6k
Making the Leap to Tech Lead
cromwellryan
128
8.8k
GraphQLとの向き合い方2022年版
quramy
43
13k
Raft: Consensus for Rubyists
vanstee
135
6.5k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
0
120
How To Stay Up To Date on Web Technology
chriscoyier
786
250k
YesSQL, Process and Tooling at Scale
rocio
167
14k
Design by the Numbers
sachag
277
19k
Navigating Team Friction
lara
183
13k
The Cult of Friendly URLs
andyhume
76
6k
Making Projects Easy
brettharned
113
5.8k
Clear Off the Table
cherdarchuk
91
320k
Transcript
Effective Datomic Imports
Ryan Neufeld @rkneufeld
Ryan Neufeld @rkneufeld
Effective Datomic Imports
Staples Innovation Labs
Big Reporting
Trouble Out
Trouble Out Trouble In
Stop.
Craig Time.
100
(def real-tx d/transact) ! (with-redefs [d/transact (fn [conn tx-data] (println
tx-data) @(real-tx conn tx-data))] ;; A bunch of business logic ) Gross Hacks
Tip: Separate Tx Data from Txing
Pipeline
Pipeline Shape
Real-life Transactor
DynamoDB
Did I use 500 write units… or six?
Throttled
Free & Clear
Take-aways • Separate Tx from Tx’ing • Batch to 100
datoms/tx • Pipeline txes asynchronously • Use realistic backend/ settings • Use CloudWatch to watch StorageBackoff and AlarmBackPressure (carefully!) • Capacity Planning Docs
Staples is hiring! http:/ /careers.staples.com/sanmateo/ • Clojure Engineers • Data
Scientists • Product Managers • Quality Assurance • DevOps Engineers • UI/UX Designer
So is Cognitect! http:/ /cognitect.com/jobs • Datomic Support Engineer •
Clojure Developers (Contract)
Questions? Ryan Neufeld @rkneufeld rkn.io