Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Scaling Science
Search
Matt Wood
November 21, 2012
Science
610
3
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Scaling Science
Introducing five principles for reproducibility.
Matt Wood
November 21, 2012
Transcript
117 slides
Scaling Science
[email protected]
Dr. Matt Wood
Hello
Science
Beautiful, unique.
Impossible to re-create
Snowflake Science
Reproducibility
Reproducibility scales science
Reproduce. Reuse. Remix.
Value++
None
How do we get from here to there? 5PRINCIPLES REPRODUCIBILITY
OF
1. Data has Gravity 5 PRINCIPLES REPRODUCIBILITY OF
Increasingly large data collections
1000 Genomes Project: 200Tb
Challenging to obtain and manage
Expensive to experiment
Large barrier to reproducibility
Data size will increase
Data integration will increase
Data dependencies will increase
Move data to the users
Move data to the users X
Move tools to the data
Place data where it can consumed by tools
Place tools where they can access data
None
None
None
Canonical source
None
More data, more users, more uses, more locations
Cost
Force multiplier
Cost
Complexity
Cost and complexity kill reproducibility
Utility computing
Availability
Pay-as-you-go
Flexibility
Performance
CPU + IO
Intel Xeon E5 NVIDIA Tesla GPUs
240 TFLOPS
90 - 120k IOPS on SSDs
Performance through productivity
Cost
On-demand access
Reserved capacity
100% Reserved capacity
100% Reserved capacity On-demand
100% Reserved capacity On-demand
Spot instances
Utility computing enhanced reproducibility
None
2. Ease of use is a pre-requisite 5 PRINCIPLES REPRODUCIBILITY
OF
http://headrush.typepad.com/creating_passionate_users/2005/10/getting_users_p.html
Help overcome the suck threshold
Easy to embrace and extend
Choose the right abstraction for the user
$ ec2-run-instances
$ starcluster start
None
Package and automate
Package and automate Amazon machine images, VM import
Package and automate Amazon machine images, VM import Deployment scripts,
CloudFormation, Chef, Puppet
Expert-as-a-service
None
None
1000 Genomes Cloud BioLinux
None
Your HiSeq data Illumina BaseSpace
Architectural freedom
Freedom of abstraction
3. Reuse is as important as reproduction 5 PRINCIPLES REPRODUCIBILITY
OF
Seven Deadly sins of Bioinformatics: http://www.slideshare.net/dullhunk/the-seven-deadly-sins-of-bioinformatics
Seven Deadly sins of Bioinformatics: http://www.slideshare.net/dullhunk/the-seven-deadly-sins-of-bioinformatics
Infonauts are hackers
They have their own way of working
The ‘Big Red Button’
Fire and forget reproduction is a good first step, but
limits longer term value.
Monolithic, one-stop-shop
Work well for intended purpose
Challenging to install, dependency heavy
Di cult to grok
Inflexible
Infonauts are hackers: embrace it.
Small things. Loosely coupled.
Easier to grok
Easier to reuse
Easier to integrate
Lower barrier to entry
Scale out
Build for reuse. Be remix friendly. Maximize value.
4. Build for collaboration 5 PRINCIPLES REPRODUCIBILITY OF
Workflows are memes
Reproduction is just the first step
Bill of materials: code, data, configuration, infrastructure
Full definition for reproduction
Utility computing provides a playground for bioinformatics
Code + AMI + custom datasets + public datasets +
databases + compute + result data
Code + AMI + custom datasets + public datasets +
databases + compute + result data
Code + AMI + custom datasets + public datasets +
databases + compute + result data
Code + AMI + custom datasets + public datasets +
databases + compute + result data
Package, automate, contribute.
Utility platform provides scale for production runs
Drug discovery on 50k cores: Less than $1000
5. Provenance is a first class object 5 PRINCIPLES REPRODUCIBILITY
OF
Versioning becomes really important
Especially in an active community
Doubly so with loosely coupled tools
Provenance metadata is a first class entity
Distributed provenance
1. Data has gravity 2. Ease of use is a
pre-requisite 3. Reuse is as important as reproduction 4. Build for collaboration 5. Provenance is a first class object 5PRINCIPLES REPRODUCIBILITY OF
None
Thank you aws.amazon.com @mza
[email protected]
More Decks by Matt Wood
See All by Matt Wood
Field Notes from Expeditions in the Cloud
mza
2
530
A Platform for Big Data
mza
6
880
The Data Lifecycle
mza
5
620
Provision Throughput Like a Boss
mza
0
550
Impact of Cloud Computing: Life Sciences
mza
2
960
Latency's Worst Nightmare: Performance Tuning Tips and Tricks
mza
4
1.2k
Under the Covers of DynamoDB
mza
4
1.3k
From Analytics to Intelligence: Amazon Redshift
mza
9
1.1k
High Performance Web Applications
mza
6
730
Other Decks in Science
See All in Science
20261012_hcmpl2026
takusamar
0
210
Anomalies de terrain remontées à l'ONAB
institutdelelevage
PRO
0
390
はじめてのグラフ信号サンプリング
arthur1
0
160
暗号解読における量子計算の展望
neutron63zf
0
500
不動産業界における業界特化のデータ整備とAI活用 ─Vertical DataとVertical AI─
estie
1
1.2k
Cognitive Debt - What AI will do to us
martinlippert
1
150
Massey Ratings for Match Outcome Prediction in Table Tennis: Evidence of Greater Stability than the ITTF World Ranking
konakalab
0
200
現代AI入門: 大規模言語モデルから思考するシステムへ — Test-Time Scaling, Loop, Harness, RSI
stillpedant
PRO
49
25k
生成AIが科学とRAにもたらしていること:メタサイエンスの視点から
rmaruy
0
190
Засідання студентського наукового гуртка «Садово-паркове господарство»
mariiabarkan12
0
120
[Relay webinaire eBIS actu n°16] Conclusion
institutdelelevage
PRO
0
320
第67回コンピュータビジョン勉強会論文紹介「RoboWheel: A Data Engine from Real-World Human Demonstrations for Cross-Embodiment Robotic Learning」
x_ttyszk
0
260
Featured
See All Featured
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
203
77k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
33
5.8k
The Straight Up "How To Draw Better" Workshop
denniskardys
239
140k
Abbi's Birthday
coloredviolet
5
11k
Navigating Team Friction
lara
192
16k
Embracing the Ebb and Flow
colly
88
5.2k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
232
55k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
38
3.1k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
31
10k
Redefining SEO in the New Era of Traffic Generation
szymonslowik
1
530
Reflections from 52 weeks, 52 projects
jeffersonlam
356
22k
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
techseoconnect
PRO
0
530