Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Atlas - owl vs deer
Search
MetaBroadcast
June 19, 2013
Programming
0
240
Atlas - owl vs deer
Talk given by MetaBroadcast's Engineer Fred van den Driessche. Jun 19th, 2013.
MetaBroadcast
June 19, 2013
Tweet
Share
More Decks by MetaBroadcast
See All by MetaBroadcast
PhotoGlut
metabroadcast
2
350
Machine learning: boldly going where Twitter's APIs don't
metabroadcast
0
120
monitoring: it gets better
metabroadcast
1
560
The ABCs of MetaBroadcast APIs
metabroadcast
0
160
APIs for app developers
metabroadcast
1
140
Polishing Varnish
metabroadcast
0
820
Atlas - 3.0 to 4.0
metabroadcast
0
240
Storm - an overview
metabroadcast
0
120
The world of HTML5
metabroadcast
1
76
Other Decks in Programming
See All in Programming
Vaporモードを大規模サービスに最速導入して学びを共有する
kazukishimamoto
4
4.3k
Macとオーディオ再生 2024/11/02
yusukeito
0
190
C#/.NETのこれまでのふりかえり
tomokusaba
1
160
Googleのテストサイズを活用したテスト環境の構築
toms74209200
0
270
LLM生成文章の精度評価自動化とプロンプトチューニングの効率化について
layerx
PRO
2
140
レガシーな Android アプリのリアーキテクチャ戦略
oidy
1
170
WEBエンジニア向けAI活用入門
sutetotanuki
0
300
Why Spring Matters to Jakarta EE - and Vice Versa
ivargrimstad
0
980
Jakarta Concurrencyによる並行処理プログラミングの始め方 (JJUG CCC 2024 Fall)
tnagao7
1
230
Snowflake x dbtで作るセキュアでアジャイルなデータ基盤
tsoshiro
2
430
詳細解説! ArrayListの仕組みと実装
yujisoftware
0
480
推し活としてのrails new/oshikatsu_ha_iizo
sakahukamaki
3
1.7k
Featured
See All Featured
Git: the NoSQL Database
bkeepers
PRO
425
64k
How to Think Like a Performance Engineer
csswizardry
19
1.1k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
355
29k
Designing for humans not robots
tammielis
249
25k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
246
1.3M
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
27
1.9k
Automating Front-end Workflow
addyosmani
1365
200k
Rails Girls Zürich Keynote
gr2m
93
13k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
32
1.8k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
31
2.7k
The World Runs on Bad Software
bkeepers
PRO
65
11k
Writing Fast Ruby
sferik
626
61k
Transcript
Atlas 4.0 owl vs deer Fred van den Driessche Engineer
@fredvdd
What is Atlas? “the global video and audio index”
What is Atlas? • aggregates metadata from multiple sources •
stores in a uniform model • APIs + feeds provide consolidated data
What is Atlas? ATLAS DB BBC PA C4 etc... /content
/schedules /topics sitemaps radioplayer interlinking
Atlas Data Model brand item series version broadcast location
History •2008: 0.5 • MySQL • URIs • RDF •
POST to Update • /content
History •2009: 1.0 • Adapters • POST to Update
History •2010: 2.0 “otter” • MongoDB • denormalization • /discover
• /schedules • uploading
History •2011: 3.0 “owl” • MongoDB :-( • less denormalization
• /discover • annotations
DEMO
Objectives for 4.0 “deer” Easy scaling • Discovery • Faster
updates • More consistent, rational API • extensive use of HTTP
External Changes - quite small • IDs not URIs •
URL structures: /content/<id> not /content?uri=<uri> • More flexible filtering • Better annotations • Richer output • Better error handling • Consistently fast
Internal Changes - almost everything • New Technologies • New
Persistence Layer • Flexible Denormalisation • Bootstrapping • Queue
DEMO
Optional Extras • improvements to storage and indexing • monitor
all the things • small core • decentralization • queue-triggered processing • all data submitted via POST? • generalization of feed output • new equivalence algorithm?
Questions? more at http://atlas.metabroadcast.com follow @mb_atlas