Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Leveraging Open Source to Create Virtual Live C...
Search
Flávio Ribeiro
July 01, 2020
Programming
240
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Leveraging Open Source to Create Virtual Live Channels from On-Demand Video
Flávio Ribeiro
July 01, 2020
More Decks by Flávio Ribeiro
See All by Flávio Ribeiro
Building a Live Streaming Stack for Big Brother
flavioribeiro
0
75
Engineering a Live Streaming Workflow for Super Bowl 53 at CBS
flavioribeiro
0
210
Live Streaming Challenges & How we are Dealing with Them
flavioribeiro
0
310
How Video Works?
flavioribeiro
2
820
Improving the Video Delivery at The New York Times
flavioribeiro
1
380
Building a Closed Captions Ecosystem at The New York Times
flavioribeiro
0
220
Snickers: Open Source HTTP API for Media Encoding
flavioribeiro
0
350
The New York Times: Flash Free Video in 2016
flavioribeiro
0
120
Towards the Application of WebRTC Peer-to-Peer to Scale Live Video Streaming over the Internet
flavioribeiro
1
200
Other Decks in Programming
See All in Programming
気圧・高度・GPSを記録&可視化するアプリ「Koudo」を作った話
hjmkth
1
360
【やさしく解説 設計編・中級 #4】ルールの寿命と、システムの年輪
panda728
PRO
2
140
Laravelで学ぶ Webアプリケーションチューニング入門/web_application_tuning_101
hanhan1978
4
770
ビデオ通話が繋がる0.2秒で何が起きているのか
supurazako
2
150
5分で問診!Composer セキュリティ健康診断
codmoninc
0
330
AIキャラアプリkaiwaの低遅延音声通話基盤をどう作ったか - AWS Gravitonで支える低遅延・低コストAI Agent基盤
mogamit
0
170
Haskell/Servantを通してWebミドルウェアを捉え直す
pizzacat83
1
580
symfony/aiとlaravel/boost
77web
0
130
Generative UI & AI-Assistants for Your Angular Solutions
manfredsteyer
PRO
1
190
LLMによるContent Moderationの本番運用の裏側と品質担保への挑戦
suikabar
3
860
Hatena Engineer Seminar #37「言語モデルの活用に関する研究」
slashnephy
0
520
『コードを書く以外の』エンジニアリング〜課金基盤移行プロジェクト推進のためのTips4選
yuriko1211
0
500
Featured
See All Featured
Organizational Design Perspectives: An Ontology of Organizational Design Elements
kimpetersen
PRO
1
770
Ruling the World: When Life Gets Gamed
codingconduct
0
280
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
reverentgeek
1
500
Marketing to machines
jonoalderson
1
5.6k
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
kimpetersen
PRO
0
390
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
141
35k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
11
970
Efficient Content Optimization with Google Search Console & Apps Script
katarinadahlin
PRO
1
730
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
akihiro_kokubo
PRO
72
40k
Reality Check: Gamification 10 Years Later
codingconduct
0
2.2k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
123
22k
StorybookのUI Testing Handbookを読んだ
zakiyama
31
6.8k
Transcript
Leveraging Open Source to Create Virtual Live Channels from On-Demand
Video July, 2020
@flavioribeiro /in/flavioribeiro /flavioribeiro Flavio Ribeiro Director of Engineering, Video Technology
Group ViacomCBS Digital
None
None
None
None
AGENDA • Why? • How?
WHY? • recycle on-demand catalog • possible new revenue streams
• pop-up channels • personalized channels • cheap "rundown/playout" alternative • cheap (no encoding) streaming alternative
ON THE FLY PACKAGING from https://open.nytimes.com/improving-our-video-experience-part-one-our-on-demand-video-platform-cf818e03353d
OUR DEPLOYMENT
OUR DEPLOYMENT
Goofy is a R&D Project For Virtual 24/7 Linear Channels
from VoD Assets
Architecture AWS S3 Scheduler Playout MP4 MP4 MP4 Google Cloud
Storage MP4 MP4 MP4 File Streamer https://github.com/nytimes/gcs-helper https://github.com/crunchyroll/evs-s3helper
SCHEDULER • REST API • Mediainfo ◦ calculate asset duration
• detect overlap/content collision
SCHEDULER $ http POST http://scheduler <<< ' { "title": "STAR
TREK SEASON 01 EP 01", "airing_time_start": "2020-07-01T18:14:52Z", "renditions": [ { "label": "720p", "url": "http://gcs-helper:2000/proxy/STARTREK_S01E01_720p.mp4" }, { "label": "540p", "url": "http://gcs-helper:2000/proxy/STARTREK_S01E01_540p.mp4" }, { "label": "360p", "url": "http://gcs-helper:2000/proxy/STARTREK_S01E01_360p.mp4" }, ]
None
PLAYOUT • fetch & display "rolling window" of scheduled content
• format JSON payload expected by the NGINX VOD Module
PLAYOUT $ http GET http://playout { "clipSegments": [305, 305], "durations":
[3045000, 3049000], "clipTimes": [ 1593174206000, 1593618600000, ], "currentTime": 1593618583000, "discontinuity": true, "initialClipIndex": 890, "initialSegmentIndex": 84913, "playlistType": "live", "sequences": [ { "clips": [ {"path": "/proxy/STARTREK_S01E01_720p.mp4", "type": "source"}, {"path": "/proxy/STARTREK_S01E02_720p.mp4", "type": "source"} ], "language": "eng" }, { "clips": [ {"path": "/proxy/STARTREK_S01E01_640p.mp4", "type": "source"}, {"path": "/proxy/STARTREK_S01E02_640p.mp4", "type": "source"} ], "language": "eng" } ] }
PLAYOUT $ http GET http://playout { "clipSegments": [305, 305], "durations":
[3045000, 3049000], "clipTimes": [ 1593174206000, 1593618600000, ], "currentTime": 1593618583000, "discontinuity": true, "initialClipIndex": 890, "initialSegmentIndex": 84913, "playlistType": "live", "sequences": [ { "clips": [ {"path": "/proxy/STARTREK_S01E01_720p.mp4", "type": "source"}, {"path": "/proxy/STARTREK_S01E02_720p.mp4", "type": "source"} ], "language": "eng" }, { "clips": [ {"path": "/proxy/STARTREK_S01E01_640p.mp4", "type": "source"}, {"path": "/proxy/STARTREK_S01E02_640p.mp4", "type": "source"} ], "language": "eng" } ] } from scheduler airing time since epoch # of clips in the past (+1) # of segments in the past sum(clip durations) / segment length
NGINX http { vod_mode mapped; vod_upstream_location /goofy-playout-map; vod_hls_segment_file_name_prefix "segment"; vod_segment_duration
10000; vod_align_segments_to_key_frames on; vod_live_window_duration 60000; upstream goofy-playout { server playout:2828; } server { listen 80; server_name localhost; location /goofy-playout-map { rewrite ^/goofy-playout-map/h/(.*)$ /$2 break; proxy_pass http://goofy-playout; proxy_http_version 1.1; proxy_set_header Connection ""; } location /h { vod hls; add_header Access-Control-Allow-Headers '*'; add_header Access-Control-Allow-Methods 'GET, HEAD, OPTIONS'; add_header Access-Control-Allow-Origin '*'; } }
NGINX http { vod_mode mapped; vod_upstream_location /goofy-playout-map; vod_hls_segment_file_name_prefix "segment"; vod_segment_duration
10000; vod_align_segments_to_key_frames on; vod_live_window_duration 60000; upstream goofy-playout { server playout:2828; } server { listen 80; server_name localhost; location /goofy-playout-map { rewrite ^/goofy-playout-map/h/(.*)$ /$2 break; proxy_pass http://goofy-playout; proxy_http_version 1.1; proxy_set_header Connection ""; } location /h { vod hls; add_header Access-Control-Allow-Headers '*'; add_header Access-Control-Allow-Methods 'GET, HEAD, OPTIONS'; add_header Access-Control-Allow-Origin '*'; } } point vod module to the playout service Initiate vod module in mapped mode create a location for the hls delivery
None
FUTURE • UI/CMS for linear "programming"
None
FUTURE • UI/CMS for linear "programming" • ads support (via
scte-35 manifest decoration)
FUTURE • UI/CMS for linear "programming" • ads support (via
scte-35 manifest decoration) • support for mixed "real" live and virtual live
FUTURE • UI/CMS for linear "programming" • ads support (via
scte-35 manifest decoration) • support for mixed "real" live and virtual live • support for personalized slots on the linear feed • DASH (variant bitrates on the VOD library)
Thanks!