Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Pushing WebRTC Up That Broadcast Hill
Search
danjenkins
June 01, 2023
Technology
0
42
Pushing WebRTC Up That Broadcast Hill
danjenkins
June 01, 2023
Tweet
Share
More Decks by danjenkins
See All by danjenkins
Building ICEPerf.com
danjenkins
0
51
Using GStreamer to build real-time applications with Golang
danjenkins
0
750
VON: Builder - Controlling Physical Devices with WebRTC
danjenkins
0
31
When Worlds Collide: The Blurring Lines of Real-Time and Traditional Media
danjenkins
0
86
Passkeys, FIDO2, WebAuthn… What does it all mean?
danjenkins
0
92
Spiderman's Uncle Ben and his advice for casting your Web(RTC)
danjenkins
0
68
Don't talk SRT about my WHIP
danjenkins
0
670
WebRTC 101 - How to get started building your first WebRTC application
danjenkins
1
180
WebRTC Reborn London Node User Group
danjenkins
0
120
Other Decks in Technology
See All in Technology
日経電子版におけるリアルタイムレコメンドシステム開発の事例紹介/nikkei-realtime-recommender-system
yng87
1
510
30万人が利用するチャットをFirebase Realtime DatabaseからActionCableへ移行する方法
ryosk7
5
350
AWS re:Inventを徹底的に楽しむためのTips / Tips for thoroughly enjoying AWS re:Invent
yuj1osm
1
570
ガバメントクラウド先行事業中間報告を読み解く
sugiim
1
1.4k
WINTICKETアプリで実現した高可用性と高速リリースを支えるエコシステム / winticket-eco-system
cyberagentdevelopers
PRO
1
190
いまならこう作りたい AWSコンテナ[本格]入門ハンズオン 〜2024年版 ハンズオンの構想〜
horsewin
9
2.1k
生成AIとAWS CDKで実現! 自社ブログレビューの効率化
ymae
2
330
Amazon FSx for NetApp ONTAPを利用するにあたっての要件整理と設計のポイント
non97
1
160
Aurora_BlueGreenDeploymentsやってみた
tsukasa_ishimaru
1
130
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
huffon
0
370
生成AIと知識グラフの相互利用に基づく文書解析
koujikozaki
1
140
ExaDB-D dbaascli で出来ること
oracle4engineer
PRO
0
3.6k
Featured
See All Featured
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
191
16k
It's Worth the Effort
3n
183
27k
The Cost Of JavaScript in 2023
addyosmani
45
6.6k
Keith and Marios Guide to Fast Websites
keithpitt
408
22k
How GitHub (no longer) Works
holman
311
140k
Writing Fast Ruby
sferik
626
61k
Unsuck your backbone
ammeep
668
57k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
27
1.9k
How STYLIGHT went responsive
nonsquared
95
5.2k
The Straight Up "How To Draw Better" Workshop
denniskardys
232
140k
Scaling GitHub
holman
458
140k
Side Projects
sachag
452
42k
Transcript
Streaming Tech Sweden 2023 Pushing WebRTC Up That Broadcast Hill
Dan Jenkins
Dan Jenkins WebRTC & Real Time Media Geek @dan_jenkins @
[email protected]
Founder - Everycast Labs / Nimble Ape Organiser CommCon (19-23 June - UK)
Broadcast Bridge - bring remote collaborators into your professional work
fl ow @everycastlabs broadcastbridge.app everycastlabs.uk
Pushing WebRTC Up That Broadcast Hill
WebRTC Is Now 12 Years Old.
And It Has Barely Been A "Thing" Inside Broadcast Media.
So First... Let's Define WebRTC
WebRTC Allows Two Peers behind NATs To Connect to One
Another
It Uses an ICE Process To Make Those Connections.
WebRTC Allows for Media and Data To Be Sent Over
a Peer Connection
WebRTC Is Encrypted by Default.
A Peer Doesn't Need To Be a Client
An SFU or MCU Is Also a Peer.
WebRTC Media Is Sent as RTP
Which Allows for RTP Extensions To Be Used.
RTX
Absolute Capture Time
Audio Levels
Absolute Send Time
Video Orientation
Playout Delay
Video Content Type
That's Just a Few.
It's a Fantastic Toolset To Have at Your Fingertips.
Some May Say It's Rather Prosumer https://twitter.com/OpenBroadcastSy/status/1662075098172358657
But In Order To Understand Some Of The Whys...
We Need To Look at WebRTCs Past
Google Acquired Global IP Solutions...
And Then Open Sourced WebRTC (YAY!)
The IETF And The W3C Were Then Involved With Standardisation
But at its Core...
WebRTC Was Designed for Conference Calls
"Real Time Media on the Web"
And the IETF Process Was Led by VoIP People
Real Time Media = (Web) Real Time Media
And This Led to Decisions.
Like Using SDP To Handle Negotiation of a Session.
But The Biggest* Decision Was Having No Standard Signalling Method.
(*At Least in my mind)
People Could Use What They Wanted.
JSON Over Websocket
SIP Over Websocket
XMPP
GraphQL
Some Proprietary Binary Format Over Websocket
*N
You Could Do It Your Way
Whatever Made Sense for Your Application
Include SDP? Sure!
Get Rid Of SDP And Fill It In Later?
That Works Too!
But No Standard Signalling Isn't Ecosystem Friendly
SRT, RTMP, NDI, HLS & DASH (And many others)
They Just Work (Mostly)
The Lack of a Common Signalling Layer Was Both Great
and Terrible
Now...
The Lack Of Common Signalling Wasn't The Only Issue.
Lack Of Controllable Latency
Lack Of Encode/ Decode Control In A Browser
Lack Of Control Generally.
Pray Be To The Browser Gods.
But.
WebRTC Has Its Own Superpowers
None
WebRTCs Superpower Is That It Works on Billions of Devices
Without Installing A Thing
Use The Right Tool For The Right Job.
WebRTC In A Browser Is The Right Tool.
For The Right Job.
It Might Just Be A Different Job Than You Expected.
Now...
Let's Take A Look at WebRTCs Present
Works In All Browsers Yes, even on Mobile (Safari, Chrome,
Firefox - Edge is a clone)
Supports New Codecs (AV1, H265)
OPUS RED.
More Than Just libWebRTC (Pion, WebRTC.rs, aiortc, |pipe| to name
a few)
SVC (One Video encoded once resulting in one stream with
multiple qualities)
...But Different Support in Every Browser
Simulcast (Multiple encoded videos sent independently as multiple streams) (Now
includes VP9 and AV1 in Chrome)
...But Different Support in Every Browser
X & Y Features
...But Different Support in Every Browser
Scaling Isn't Simple
Scaling To 100,000s Of Connections
It's Tricky
And Expensive
So WebRTCs Present Is Just Tricky.
However.
Something Is Becoming Simpler...
Standardised & Simple Signalling
WHIP (WebRTC HTTP Ingest Protocol)
WHEP (WebRTC HTTP Egress Protocol) https://eyevinntechnology.medium.com/whip-whpp-for-webrtc-based-broadcast-streaming-2cf469e95299
They Go Hand In Hand.
Let's Take A Look At WHIP
At The Heart Of Both Is A HTTP POST Request/
Response
POST /whip/endpoint/test HTTP/1.1 Host: localhost:7080 Content-Type: application/sdp Authorization: Bearer verysecret
Accept-Encoding: gzip, de fl ate Connection: Keep-Alive Content-Length: 1162 v=0 [..sdp] (WHIP) POST with an OFFER
HTTP/1.1 201 Created Location: /whip/resource/test Content-Type: application/sdp Connection: keep-alive Transfer-Encoding:
chunked Content-Length: 569 v=0 [..sdp] (WHIP) POST RESPONSE WITH ANSWER
WHEP Is the SAME
Super Simple.
And Finally Means Ecosystem Friendliness
Both WHIP and WHEP Are Getting Industry Support
Dolby.io
Cloudflare
Osprey Talon Encoders
OBS
Flowcaster
LiveU
And Lastly...
Broadcast Bridge
What's Coming in WebRTCs Future?
Or...
What Do I Hope We Will See Soon?
WebCodec Support
DRED (Deep Audio Redundancy)
Bringing All Browsers Up To The Same Spec
LOL.
This Is a Web Problem Generally.
So What's In It For You?
Lack of Control?
Issues Scaling?
You're Not Selling Me on This Dan...
But Seriously.
Use WebRTC Right...
And It Will Work Well for You.
WebRTC Isn't Right for Broadcasting to 100,000 People
WebRTC Isn't Right for Broadcasting to 100,000 People (Usually)
WebRTC Is Not Right for Transporting Media Inside a Studio.
WebRTC Is Right for Real Time Collaboration
Where You Need the Lowest Friction
WebRTC Is Right for Weird Network Scenarios
It Is a Tool in the Toolbelt.
And Even Though Web Browsers Frustrate Me
A LOT.
It Is Only Because of the Web Browser That WebRTC
Has Its Superpower
It Works Everywhere
Not Everything Is a Nail Needing a Hammer.
I've Seen Stranger Things Than WebRTC Being Used in Broadcast
That's Me!
Cheers!
Thanks! We're hiring in the UK! https://jobs.everycastlabs.uk @dan_jenkins @
[email protected]
@everycastlabs