Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
LINE Call: 8 year journey to the top level quality
Search
LINE DevDay 2019
November 21, 2019
Technology
0
300
LINE Call: 8 year journey to the top level quality
Dongwon Lee
LINE Plus Dev 3 Software Engineer
https://linedevday.linecorp.com/jp/2019/sessions/F2-5
LINE DevDay 2019
November 21, 2019
Tweet
Share
More Decks by LINE DevDay 2019
See All by LINE DevDay 2019
What is the engineering organization that LINE DevRel is aiming for
line_devday2019
3
2.4k
The IoT technology inside LINE DEVELOPER DAY 2019
line_devday2019
6
1.1k
How to reduce Android app launch time by scoping your dependencies using Koin DI
line_devday2019
3
800
Efficient integrating data from multiple data providers
line_devday2019
0
460
Now supporting Dark Mode on LINE messenger
line_devday2019
0
1.8k
LIFF v2, the latest Webview SDK lets you leverage LINE
line_devday2019
0
1.7k
Modern Web Testing with Cypress.io
line_devday2019
0
630
Speed up iOS Development with LLDB Code Injection and Framework Live Preview
line_devday2019
1
380
Faster iOS Builds with Bazel
line_devday2019
0
1.5k
Other Decks in Technology
See All in Technology
フルカイテン株式会社 採用資料
fullkaiten
0
36k
プロダクト成長に対応するプラットフォーム戦略:Authleteによる共通認証基盤の移行事例 / Building an authentication platform using Authlete and AWS
kakehashi
1
150
「視座」の上げ方が成人発達理論にわかりやすくまとまってた / think_ perspective_hidden_dimensions
shuzon
2
3.6k
プロダクトエンジニアが活躍する環境を作りたくて 事業責任者になった話 ~プロダクトエンジニアの行き着く先~
gimupop
1
480
現地でMeet Upをやる場合の注意点〜反省点を添えて〜
shotashiratori
0
520
生成AIと知識グラフの相互利用に基づく文書解析
koujikozaki
1
140
とあるユーザー企業におけるリスクベースで考えるセキュリティ業務のお話し
4su_para
3
320
カメラを用いた店内計測におけるオプトインの仕組みの実現 / ai-optin-camera
cyberagentdevelopers
PRO
1
120
Datachain会社紹介資料(2024年11月) / Company Deck
datachain
3
16k
話題のGraphRAG、その可能性と課題を理解する
hide212131
4
1.5k
なんで、私がAWS Heroに!? 〜社外の広い世界に一歩踏み出そう〜
minorun365
PRO
6
1.1k
【若手エンジニア応援LT会】AWSで繋がり、共に成長! ~コミュニティ活動と新人教育への挑戦~
kazushi_ohata
0
180
Featured
See All Featured
A designer walks into a library…
pauljervisheath
202
24k
What's in a price? How to price your products and services
michaelherold
243
12k
Fantastic passwords and where to find them - at NoRuKo
philnash
50
2.8k
Into the Great Unknown - MozCon
thekraken
31
1.5k
Fireside Chat
paigeccino
32
3k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.2k
Navigating Team Friction
lara
183
14k
Scaling GitHub
holman
458
140k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
28
7.9k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
364
22k
Designing for humans not robots
tammielis
249
25k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
48k
Transcript
2019 DevDay LINE Call: 8 Year Journey to the Top
Level Quality > Dongwon Lee > LINE Plus Dev 3 Software Engineer
Agenda > What Defines the Best Call Quality? > How
to Assess Call Quality > Global Quality Monitoring System
The Best Call Quality
Tele-communication
The New Paradigm Communication
The New Paradigm Communication Connecting to Each Other
Close Distance: 45 cm Communication Distance Social Distance: 1.2 m
~ 3.6 m Personal Distance: 45 cm ~ 1.2 m [openclipart.org] 1 m
Assessment of Quality
Reference Signal Digitalize Compress Degraded Signal Audio Converter Packet Network
Time Stamp IP Address Add Address UDP header #5 #4 #3 #2 #1 IP Receiver Time Sequence #5 #3 #4 #2 #1 #5 #4 #3 #2 #1 Voice Over Internet
MOS: Mean Opinion Score 5 EXCELLENT 4 GOOD 3 FAIR
2 POOR 1 BAD
Listening test Original Voice 1 Voice 2 5 EXCELLENT 4
GOOD 3 FAIR 2 POOR 1 BAD
Objective measurements POLQA v3 Perceptual Objective Listening Quality Assessment PAMS
Perceptual Analysis Measurement System PESQ Perceptual Evaluation of Speech Quality PSQM Perceptual Speech Quality Measure 1997 2001 2011 1998 2018 POLQA Full Band
? Call quality over the world? 200+ Countries Expedition Team
Expedition Team
Global Monitoring System
> To measure the call quality of not only LINE
but also competing apps > Easy to monitor and compare the measured metrics > To measure the objective metrics obtained by the expedition team Global Quality Monitoring System
Global Quality Monitoring System
None
Analysis - Good Voice
Analysis - Bad Voice
Encoding Packetization Input Signal Network Depacketization Decoding Reference Signal Output
Signal Full Reference (FR) Degraded Signal No Reference (NR) Media Stream Media Stream Video Quality Measurement
Nature of Video Code: Blockiness [Original] [Blocky]
VMAF PSNR MS-SSIM PSNR-HVS FR Methods
[Practical Evaluation of VMAF Perceptual Video Quality for WebRTC Applications,
Boni García,, Luis López-Fernández, 31,Jul,2019,MDPI electrinics] Performance Comparison
[Practical Evaluation of VMAF Perceptual Video Quality for WebRTC Applications,
Boni García,, Luis López-Fernández, 31,Jul,2019,MDPI electrinics] Comparison with Human Score
Video Data Acquisition [Sender] [Receiver] 1 2 3 1 3
3 1 4 2 1 4 3 2 Video Data
Acquisition [Sender] [Receiver] FR Method
Result of Video Assessment VMAF Freezing Skipness https://www.youtube.com/watch?v=6ArXfcKeZWY
Subtitle Title 120pt Bad Quality Video
Auditory System Pinna Ear Canal Cochlea
Measured Like the Human Ear HATS: Head And Torso Simulator
Customer Satisfaction Survey 53% 33%
Thank you