Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Paper-Survey: Objects as Points
Search
fam_taro
April 19, 2019
Science
0
2.3k
Paper-Survey: Objects as Points
fam_taro
April 19, 2019
Tweet
Share
More Decks by fam_taro
See All by fam_taro
NeRFの概要と 派生系についてのふんわり紹介
fam_taro
3
4.1k
実践 PyTorch Lightning (2019/11/30 分析コンペLT会 #1)
fam_taro
3
4.5k
Paper:ShapeMask
fam_taro
0
62
Summary: Objects as Points
fam_taro
0
3.1k
Tensorコアを使った PyTorch の高速化について
fam_taro
4
3.9k
Sequence to Sequence Learning with Neural Networks
fam_taro
1
1.1k
Other Decks in Science
See All in Science
テンソル分解を用いた教師なし学習による変数選択法のシングルセルマルチオミックスデータ解析への応用
tagtag
1
130
Celebrate UTIG: Staff and Student Awards 2024
utig
0
620
As We May Interact: Challenges and Opportunities for Next-Generation Human-Information Interaction
signer
PRO
0
430
02_西村訓弘_プログラムディレクター_人口減少を機にひらく未来社会.pdf
sip3ristex
0
250
Healthcare Innovation through Business Entrepreneurship
clintwinters
0
200
All-in-One Bioinformatics Platform Realized with Snowflake ~ From In Silico Drug Discovery, Disease Variant Analysis, to Single-Cell RNA-seq
ktatsuya
0
330
Factorized Diffusion: Perceptual Illusions by Noise Decomposition
tomoaki0705
0
360
FRAM - 複雑な社会技術システムの理解と分析
__ymgc__
1
120
ACL読み会2024@名大 REANO: Optimising Retrieval-Augmented Reader Models through Knowledge Graph Generation
takuma_matsubara
0
180
Explanatory material
yuki1986
0
130
統計学入門講座 第1回スライド
techmathproject
0
260
(論文読み)贈り物の交換による地位の競争と社会構造の変化 - 文化人類学への統計物理学的アプローチ -
__ymgc__
1
190
Featured
See All Featured
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
30
1.1k
Fontdeck: Realign not Redesign
paulrobertlloyd
83
5.4k
How GitHub (no longer) Works
holman
314
140k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.2k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
227
22k
A designer walks into a library…
pauljervisheath
205
24k
Designing for humans not robots
tammielis
250
25k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
12
610
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
160
15k
Thoughts on Productivity
jonyablonski
69
4.5k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.1k
Documentation Writing (for coders)
carmenintech
69
4.7k
Transcript
จLT: Objects as Points h"ps:/ /arxiv.org/abs/1904.07850 2019/04/19 ౻ຊ༟հ 1
࣍ • ஶऀใ • ֓ཁ • ͜Ε·ͰͷϞσϧͱͷҧ͍ • ਫ਼ •
ͦͷଞײ 2
ஶऀใ • Xingyi Zhou(UT Aus1n) • Dequan Wang(UC Berkeley) •
Philipp Krähenbühl(UT Aus1n) 3
ಛ • ମݕग़Ϟσϧ • ༗໊ͳྫ: SSD, YOLOv3, Re.naNet, M2Det... •
ݕग़ͷΈͳΒͣ࢟ɾdepthɾ͖ɾ3d size ʹద༻͍ͯ͠Δ • backbone ͱͯ͠ DLA(deep layers aggrega.on) Hourglass(CornerNet Ͱ ༻) Λ༻ 4
ಛ • bounding box ΛΘͣʹݕग़Λߦ͏Ϟσϧ(keypointਪఆ) • bounding box ༻ͷ grid
ͷΘΓʹ͕ࡉ͔͍ heatmap(H, W Λ4Ͱׂͬͨఔ ͷͷ) Λग़ྗ • heatmap ͕ߴ͍ॴ() Λମͷத৺ͱਪఆ • த৺ͱͳΔॴͷ feature ͔Βମͷେ͖͞ɾࢄԽޡࠩΛਪఆ • ࢄԽޡࠩ = heatmap ʹͨ͠ࡍͷޡࠩ • େ͖͞ʹ͍ͭͯ scale ͍ͯ͠ͳ͍(ͦͷ··ͷ) 5
ಛ • ༧ଌϘοΫε = heatmap ͷ࠲ඪ + ༧ଌϘοΫεαΠζ + ༧ଌࢄԽޡࠩ
• ֶशʹ͏ heatmap ͷ 1ମʹ͖ͭ 1ͭͷΈ • SSD ͷΑ͏ʹ IoU ͷॏͳΓ۩߹Ͱ background ͔൱͔Λ͚ͳ͍ • ෳ box ग़͞ͳ͍͜ͱΛલఏͱ͍ͯ͠Δ • ಉ͡ΫϥεͰॏͳͬͯ͠·͏߹͕͋Δ͕શମͷ 0.1 % ະຬͰ RCNN(2% ະ ຬ) ΑΓখ͍͞ 6
Πϝʔδਤ 7
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetശͷॏͳΓͰͳ͘ҐஔͷΈʹج͍ͮͯʮΞϯΧʔʯΛׂ • લܠͱഎܠͷྨʹؔ͢Δखಈͷ͖͍͠ͳ͍(IoU 0.5 > ͱ͔) • ମຖʹϙδςΟϒͳΞϯΧʔ1͚ͭͩͳͷͰ NMS Λඞཁͱ͠ͳ͍ • We simply extract local peaks in the keypoint heatmap • keypoint heatmap ͔ΒϩʔΧϧϐʔΫΛநग़͢Δ͚ͩͰྑ͍ 8
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetΑΓେ͖ͳग़ྗղ૾Λ͏ • mask r-cnn ͱ͔ͱൺֱͯ͠ • output stride of 16 • ͜ΕʹΑΓෳͷΞϯΧʔ͕ෆཁͱͳΔʁʁʁʁ • [1711.08189] An Analysis of Scale Invariance in Object Detec*on - SNIP 9
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on by keypoint es*ma*on(CornerNet, ExtremeNet )ͱͷҧ͍ •
্ه 2ͭ keypoint ݕग़ޙʹ Έ߹ΘͤΛ grouping ͢Δඞཁ͕͋Δ • ͘ͳͬͯ͠·͏ • CenterNet ඞཁͱ͠ͳ͍ • ͍ʂ 10
ਫ਼ 11
ਫ਼(M2Det ͷ݁ՌΛࢹͰՃͯ͠Έͨ) 12
ͦͷଞײ • Backbone ͱͯ͠ DLA Λ͑ΔͷΛॳΊͯͬͨ • Ή͠Ζ DLA ॳΊͯΓ·ͨ͠
! • NMS ͕ෆཁʹͳΔͷຯʹخ͍͠ • anchor ͕ফ͑Δͷخ͍͠ • খ͍͞ମʹରͯ͠ͲΕ͚ͩରԠͰ͖Δ͔֬ೝ͠ͳ͍ͱ 13