Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Atlas - owl vs deer
Search
MetaBroadcast
June 19, 2013
Programming
0
240
Atlas - owl vs deer
Talk given by MetaBroadcast's Engineer Fred van den Driessche. Jun 19th, 2013.
MetaBroadcast
June 19, 2013
Tweet
Share
More Decks by MetaBroadcast
See All by MetaBroadcast
PhotoGlut
metabroadcast
2
350
Machine learning: boldly going where Twitter's APIs don't
metabroadcast
0
120
monitoring: it gets better
metabroadcast
1
560
The ABCs of MetaBroadcast APIs
metabroadcast
0
160
APIs for app developers
metabroadcast
1
140
Polishing Varnish
metabroadcast
0
820
Atlas - 3.0 to 4.0
metabroadcast
0
240
Storm - an overview
metabroadcast
0
120
The world of HTML5
metabroadcast
1
76
Other Decks in Programming
See All in Programming
Ebitengineの1vs1ゲーム WebRTCの活用
ponyo877
0
380
Kotlin 2.0 and Beyond
antonarhipov
2
150
How to Break into Reading Open Source
kaspth
2
210
Kotlin 2.0が与えるAndroid開発の進化
masayukisuda
1
370
Google Sign-inの移行から始めるCredential Manager活用
clockvoid
0
220
GenU導入でCDKに初挑戦し、悪戦苦闘した話
hideg
0
160
connect-go で面倒くささと戦う / 2024-08-27 #newmo_layerx_go
izumin5210
2
640
Swiftコードバトル必勝法
toshi0383
0
150
開発を加速する共有Swift Package実践
elmetal
PRO
0
410
Ruby Parser progress report 2024
yui_knk
2
230
Jakarta EE meets AI
ivargrimstad
0
380
Prolog入門
qnighy
4
1k
Featured
See All Featured
Testing 201, or: Great Expectations
jmmastey
36
7k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
326
21k
What's in a price? How to price your products and services
michaelherold
242
11k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
190
16k
Code Reviewing Like a Champion
maltzj
517
39k
Designing for humans not robots
tammielis
248
25k
Producing Creativity
orderedlist
PRO
340
39k
What’s in a name? Adding method to the madness
productmarketing
PRO
21
3k
Practical Orchestrator
shlominoach
185
10k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
36
1.7k
How to name files
jennybc
75
98k
Product Roadmaps are Hard
iamctodd
PRO
48
10k
Transcript
Atlas 4.0 owl vs deer Fred van den Driessche Engineer
@fredvdd
What is Atlas? “the global video and audio index”
What is Atlas? • aggregates metadata from multiple sources •
stores in a uniform model • APIs + feeds provide consolidated data
What is Atlas? ATLAS DB BBC PA C4 etc... /content
/schedules /topics sitemaps radioplayer interlinking
Atlas Data Model brand item series version broadcast location
History •2008: 0.5 • MySQL • URIs • RDF •
POST to Update • /content
History •2009: 1.0 • Adapters • POST to Update
History •2010: 2.0 “otter” • MongoDB • denormalization • /discover
• /schedules • uploading
History •2011: 3.0 “owl” • MongoDB :-( • less denormalization
• /discover • annotations
DEMO
Objectives for 4.0 “deer” Easy scaling • Discovery • Faster
updates • More consistent, rational API • extensive use of HTTP
External Changes - quite small • IDs not URIs •
URL structures: /content/<id> not /content?uri=<uri> • More flexible filtering • Better annotations • Richer output • Better error handling • Consistently fast
Internal Changes - almost everything • New Technologies • New
Persistence Layer • Flexible Denormalisation • Bootstrapping • Queue
DEMO
Optional Extras • improvements to storage and indexing • monitor
all the things • small core • decentralization • queue-triggered processing • all data submitted via POST? • generalization of feed output • new equivalence algorithm?
Questions? more at http://atlas.metabroadcast.com follow @mb_atlas