Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Atlas - owl vs deer
Search
MetaBroadcast
June 19, 2013
Programming
0
240
Atlas - owl vs deer
Talk given by MetaBroadcast's Engineer Fred van den Driessche. Jun 19th, 2013.
MetaBroadcast
June 19, 2013
Tweet
Share
More Decks by MetaBroadcast
See All by MetaBroadcast
PhotoGlut
metabroadcast
2
350
Machine learning: boldly going where Twitter's APIs don't
metabroadcast
0
120
monitoring: it gets better
metabroadcast
1
560
The ABCs of MetaBroadcast APIs
metabroadcast
0
170
APIs for app developers
metabroadcast
1
140
Polishing Varnish
metabroadcast
0
820
Atlas - 3.0 to 4.0
metabroadcast
0
240
Storm - an overview
metabroadcast
0
120
The world of HTML5
metabroadcast
1
76
Other Decks in Programming
See All in Programming
EMになってからチームの成果を最大化するために取り組んだこと/ Maximize team performance as EM
nashiusagi
0
100
Enabling DevOps and Team Topologies Through Architecture: Architecting for Fast Flow
cer
PRO
0
370
リアーキテクチャxDDD 1年間の取り組みと進化
hsawaji
1
230
3 Effective Rules for Using Signals in Angular
manfredsteyer
PRO
1
110
エンジニアとして関わる要件と仕様(公開用)
murabayashi
0
310
AWS Lambdaから始まった Serverlessの「熱」とキャリアパス / It started with AWS Lambda Serverless “fever” and career path
seike460
PRO
1
270
2024/11/8 関西Kaggler会 2024 #3 / Kaggle Kernel で Gemma 2 × vLLM を動かす。
kohecchi
5
970
Remix on Hono on Cloudflare Workers
yusukebe
1
320
カンファレンスの「アレ」Webでなんとかしませんか? / Conference “thing” Why don't you do something about it on the Web?
dero1to
1
130
どうして僕の作ったクラスが手続き型と言われなきゃいけないんですか
akikogoto
1
130
ECS Service Connectのこれまでのアップデートと今後のRoadmapを見てみる
tkikuc
2
260
A Journey of Contribution and Collaboration in Open Source
ivargrimstad
0
1.2k
Featured
See All Featured
Typedesign – Prime Four
hannesfritz
40
2.4k
Measuring & Analyzing Core Web Vitals
bluesmoon
4
140
4 Signs Your Business is Dying
shpigford
180
21k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
10
730
Speed Design
sergeychernyshev
25
620
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
27
4.3k
Navigating Team Friction
lara
183
14k
RailsConf 2023
tenderlove
29
910
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
47
2.1k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
169
50k
Bash Introduction
62gerente
608
210k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
506
140k
Transcript
Atlas 4.0 owl vs deer Fred van den Driessche Engineer
@fredvdd
What is Atlas? “the global video and audio index”
What is Atlas? • aggregates metadata from multiple sources •
stores in a uniform model • APIs + feeds provide consolidated data
What is Atlas? ATLAS DB BBC PA C4 etc... /content
/schedules /topics sitemaps radioplayer interlinking
Atlas Data Model brand item series version broadcast location
History •2008: 0.5 • MySQL • URIs • RDF •
POST to Update • /content
History •2009: 1.0 • Adapters • POST to Update
History •2010: 2.0 “otter” • MongoDB • denormalization • /discover
• /schedules • uploading
History •2011: 3.0 “owl” • MongoDB :-( • less denormalization
• /discover • annotations
DEMO
Objectives for 4.0 “deer” Easy scaling • Discovery • Faster
updates • More consistent, rational API • extensive use of HTTP
External Changes - quite small • IDs not URIs •
URL structures: /content/<id> not /content?uri=<uri> • More flexible filtering • Better annotations • Richer output • Better error handling • Consistently fast
Internal Changes - almost everything • New Technologies • New
Persistence Layer • Flexible Denormalisation • Bootstrapping • Queue
DEMO
Optional Extras • improvements to storage and indexing • monitor
all the things • small core • decentralization • queue-triggered processing • all data submitted via POST? • generalization of feed output • new equivalence algorithm?
Questions? more at http://atlas.metabroadcast.com follow @mb_atlas