Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Paper-Survey: Objects as Points
Search
fam_taro
April 19, 2019
Science
0
2.3k
Paper-Survey: Objects as Points
fam_taro
April 19, 2019
Tweet
Share
More Decks by fam_taro
See All by fam_taro
NeRFの概要と 派生系についてのふんわり紹介
fam_taro
3
4.2k
実践 PyTorch Lightning (2019/11/30 分析コンペLT会 #1)
fam_taro
3
4.5k
Paper:ShapeMask
fam_taro
0
70
Summary: Objects as Points
fam_taro
0
3.2k
Tensorコアを使った PyTorch の高速化について
fam_taro
4
4k
Sequence to Sequence Learning with Neural Networks
fam_taro
1
1.1k
Other Decks in Science
See All in Science
Masseyのレーティングを用いたフォーミュラレースドライバーの実績評価手法の開発 / Development of a Performance Evaluation Method for Formula Race Drivers Using Massey Ratings
konakalab
0
190
点群ライブラリPDALをGoogleColabにて実行する方法の紹介
kentaitakura
1
420
データベース04: SQL (1/3) 単純質問 & 集約演算
trycycle
PRO
0
1k
CV_3_Keypoints
hachama
0
210
安心・効率的な医療現場の実現へ ~オンプレAI & ノーコードワークフローで進める業務改革~
siyoo
0
340
AI(人工知能)の過去・現在・未来 —AIは人間を超えるのか—
tagtag
1
140
KH Coderチュートリアル(スライド版)
koichih
1
47k
Transport information Geometry: Current and Future II
lwc2017
0
200
【RSJ2025】PAMIQ Core: リアルタイム継続学習のための⾮同期推論・学習フレームワーク
gesonanko
0
140
地質研究者が苦労しながら運用する情報公開システムの実例
naito2000
0
280
データマイニング - グラフ構造の諸指標
trycycle
PRO
0
180
academist Prize 4期生 研究トーク延長戦!「美は世界を救う」っていうけど、どうやって?
jimpe_hitsuwari
0
170
Featured
See All Featured
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
127
53k
Thoughts on Productivity
jonyablonski
70
4.8k
A designer walks into a library…
pauljervisheath
208
24k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
30
9.7k
Building Applications with DynamoDB
mza
96
6.6k
How To Stay Up To Date on Web Technology
chriscoyier
791
250k
Building Better People: How to give real-time feedback that sticks.
wjessup
368
20k
Being A Developer After 40
akosma
90
590k
Fireside Chat
paigeccino
40
3.7k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
32
2.2k
Building an army of robots
kneath
306
46k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
51k
Transcript
จLT: Objects as Points h"ps:/ /arxiv.org/abs/1904.07850 2019/04/19 ౻ຊ༟հ 1
࣍ • ஶऀใ • ֓ཁ • ͜Ε·ͰͷϞσϧͱͷҧ͍ • ਫ਼ •
ͦͷଞײ 2
ஶऀใ • Xingyi Zhou(UT Aus1n) • Dequan Wang(UC Berkeley) •
Philipp Krähenbühl(UT Aus1n) 3
ಛ • ମݕग़Ϟσϧ • ༗໊ͳྫ: SSD, YOLOv3, Re.naNet, M2Det... •
ݕग़ͷΈͳΒͣ࢟ɾdepthɾ͖ɾ3d size ʹద༻͍ͯ͠Δ • backbone ͱͯ͠ DLA(deep layers aggrega.on) Hourglass(CornerNet Ͱ ༻) Λ༻ 4
ಛ • bounding box ΛΘͣʹݕग़Λߦ͏Ϟσϧ(keypointਪఆ) • bounding box ༻ͷ grid
ͷΘΓʹ͕ࡉ͔͍ heatmap(H, W Λ4Ͱׂͬͨఔ ͷͷ) Λग़ྗ • heatmap ͕ߴ͍ॴ() Λମͷத৺ͱਪఆ • த৺ͱͳΔॴͷ feature ͔Βମͷେ͖͞ɾࢄԽޡࠩΛਪఆ • ࢄԽޡࠩ = heatmap ʹͨ͠ࡍͷޡࠩ • େ͖͞ʹ͍ͭͯ scale ͍ͯ͠ͳ͍(ͦͷ··ͷ) 5
ಛ • ༧ଌϘοΫε = heatmap ͷ࠲ඪ + ༧ଌϘοΫεαΠζ + ༧ଌࢄԽޡࠩ
• ֶशʹ͏ heatmap ͷ 1ମʹ͖ͭ 1ͭͷΈ • SSD ͷΑ͏ʹ IoU ͷॏͳΓ۩߹Ͱ background ͔൱͔Λ͚ͳ͍ • ෳ box ग़͞ͳ͍͜ͱΛલఏͱ͍ͯ͠Δ • ಉ͡ΫϥεͰॏͳͬͯ͠·͏߹͕͋Δ͕શମͷ 0.1 % ະຬͰ RCNN(2% ະ ຬ) ΑΓখ͍͞ 6
Πϝʔδਤ 7
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetശͷॏͳΓͰͳ͘ҐஔͷΈʹج͍ͮͯʮΞϯΧʔʯΛׂ • લܠͱഎܠͷྨʹؔ͢Δखಈͷ͖͍͠ͳ͍(IoU 0.5 > ͱ͔) • ମຖʹϙδςΟϒͳΞϯΧʔ1͚ͭͩͳͷͰ NMS Λඞཁͱ͠ͳ͍ • We simply extract local peaks in the keypoint heatmap • keypoint heatmap ͔ΒϩʔΧϧϐʔΫΛநग़͢Δ͚ͩͰྑ͍ 8
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetΑΓେ͖ͳग़ྗղ૾Λ͏ • mask r-cnn ͱ͔ͱൺֱͯ͠ • output stride of 16 • ͜ΕʹΑΓෳͷΞϯΧʔ͕ෆཁͱͳΔʁʁʁʁ • [1711.08189] An Analysis of Scale Invariance in Object Detec*on - SNIP 9
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on by keypoint es*ma*on(CornerNet, ExtremeNet )ͱͷҧ͍ •
্ه 2ͭ keypoint ݕग़ޙʹ Έ߹ΘͤΛ grouping ͢Δඞཁ͕͋Δ • ͘ͳͬͯ͠·͏ • CenterNet ඞཁͱ͠ͳ͍ • ͍ʂ 10
ਫ਼ 11
ਫ਼(M2Det ͷ݁ՌΛࢹͰՃͯ͠Έͨ) 12
ͦͷଞײ • Backbone ͱͯ͠ DLA Λ͑ΔͷΛॳΊͯͬͨ • Ή͠Ζ DLA ॳΊͯΓ·ͨ͠
! • NMS ͕ෆཁʹͳΔͷຯʹخ͍͠ • anchor ͕ফ͑Δͷخ͍͠ • খ͍͞ମʹରͯ͠ͲΕ͚ͩରԠͰ͖Δ͔֬ೝ͠ͳ͍ͱ 13