Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Paper-Survey: Objects as Points
Search
fam_taro
April 19, 2019
Science
0
2.3k
Paper-Survey: Objects as Points
fam_taro
April 19, 2019
Tweet
Share
More Decks by fam_taro
See All by fam_taro
NeRFの概要と 派生系についてのふんわり紹介
fam_taro
3
4.1k
実践 PyTorch Lightning (2019/11/30 分析コンペLT会 #1)
fam_taro
3
4.5k
Paper:ShapeMask
fam_taro
0
62
Summary: Objects as Points
fam_taro
0
3.1k
Tensorコアを使った PyTorch の高速化について
fam_taro
4
3.9k
Sequence to Sequence Learning with Neural Networks
fam_taro
1
1.1k
Other Decks in Science
See All in Science
LIMEを用いた判断根拠の可視化
kentaitakura
0
500
地質研究者が苦労しながら運用する情報公開システムの実例
naito2000
0
140
All-in-One Bioinformatics Platform Realized with Snowflake ~ From In Silico Drug Discovery, Disease Variant Analysis, to Single-Cell RNA-seq
ktatsuya
0
360
大規模言語モデルの論理構造の把握能力と予測モデルの生成
fuyu_quant0
0
130
The thin line between reconstruction, classification, and hallucination in brain decoding
ykamit
1
1.4k
小杉考司(専修大学)
kosugitti
2
640
応用心理学Ⅰテキストマイニング講義資料講義編(2024年度)
satocos135
0
130
オンプレミス環境にKubernetesを構築する
koukimiura
0
180
科学で迫る勝敗の法則(名城大学公開講座.2024年10月) / The principle of victory discovered by science (Open lecture in Meijo Univ. 2024)
konakalab
0
300
白金鉱業Meetup Vol.16_数理最適化案件のはじめかた・すすめかた
brainpadpr
3
1.6k
白金鉱業Meetup Vol.15 DMLによる条件付処置効果の推定_sotaroIZUMI_20240919
brainpadpr
2
750
mathematics of indirect reciprocity
yohm
1
100
Featured
See All Featured
How to Ace a Technical Interview
jacobian
276
23k
Why Our Code Smells
bkeepers
PRO
336
57k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
160
15k
Reflections from 52 weeks, 52 projects
jeffersonlam
349
20k
Rebuilding a faster, lazier Slack
samanthasiow
80
8.9k
Rails Girls Zürich Keynote
gr2m
94
13k
Gamification - CAS2011
davidbonilla
81
5.2k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
What's in a price? How to price your products and services
michaelherold
245
12k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
8
670
Building Flexible Design Systems
yeseniaperezcruz
329
38k
Transcript
จLT: Objects as Points h"ps:/ /arxiv.org/abs/1904.07850 2019/04/19 ౻ຊ༟հ 1
࣍ • ஶऀใ • ֓ཁ • ͜Ε·ͰͷϞσϧͱͷҧ͍ • ਫ਼ •
ͦͷଞײ 2
ஶऀใ • Xingyi Zhou(UT Aus1n) • Dequan Wang(UC Berkeley) •
Philipp Krähenbühl(UT Aus1n) 3
ಛ • ମݕग़Ϟσϧ • ༗໊ͳྫ: SSD, YOLOv3, Re.naNet, M2Det... •
ݕग़ͷΈͳΒͣ࢟ɾdepthɾ͖ɾ3d size ʹద༻͍ͯ͠Δ • backbone ͱͯ͠ DLA(deep layers aggrega.on) Hourglass(CornerNet Ͱ ༻) Λ༻ 4
ಛ • bounding box ΛΘͣʹݕग़Λߦ͏Ϟσϧ(keypointਪఆ) • bounding box ༻ͷ grid
ͷΘΓʹ͕ࡉ͔͍ heatmap(H, W Λ4Ͱׂͬͨఔ ͷͷ) Λग़ྗ • heatmap ͕ߴ͍ॴ() Λମͷத৺ͱਪఆ • த৺ͱͳΔॴͷ feature ͔Βମͷେ͖͞ɾࢄԽޡࠩΛਪఆ • ࢄԽޡࠩ = heatmap ʹͨ͠ࡍͷޡࠩ • େ͖͞ʹ͍ͭͯ scale ͍ͯ͠ͳ͍(ͦͷ··ͷ) 5
ಛ • ༧ଌϘοΫε = heatmap ͷ࠲ඪ + ༧ଌϘοΫεαΠζ + ༧ଌࢄԽޡࠩ
• ֶशʹ͏ heatmap ͷ 1ମʹ͖ͭ 1ͭͷΈ • SSD ͷΑ͏ʹ IoU ͷॏͳΓ۩߹Ͱ background ͔൱͔Λ͚ͳ͍ • ෳ box ग़͞ͳ͍͜ͱΛલఏͱ͍ͯ͠Δ • ಉ͡ΫϥεͰॏͳͬͯ͠·͏߹͕͋Δ͕શମͷ 0.1 % ະຬͰ RCNN(2% ະ ຬ) ΑΓখ͍͞ 6
Πϝʔδਤ 7
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetശͷॏͳΓͰͳ͘ҐஔͷΈʹج͍ͮͯʮΞϯΧʔʯΛׂ • લܠͱഎܠͷྨʹؔ͢Δखಈͷ͖͍͠ͳ͍(IoU 0.5 > ͱ͔) • ମຖʹϙδςΟϒͳΞϯΧʔ1͚ͭͩͳͷͰ NMS Λඞཁͱ͠ͳ͍ • We simply extract local peaks in the keypoint heatmap • keypoint heatmap ͔ΒϩʔΧϧϐʔΫΛநग़͢Δ͚ͩͰྑ͍ 8
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet )ͱͷҧ͍
• CenterNetΑΓେ͖ͳग़ྗղ૾Λ͏ • mask r-cnn ͱ͔ͱൺֱͯ͠ • output stride of 16 • ͜ΕʹΑΓෳͷΞϯΧʔ͕ෆཁͱͳΔʁʁʁʁ • [1711.08189] An Analysis of Scale Invariance in Object Detec*on - SNIP 9
͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on by keypoint es*ma*on(CornerNet, ExtremeNet )ͱͷҧ͍ •
্ه 2ͭ keypoint ݕग़ޙʹ Έ߹ΘͤΛ grouping ͢Δඞཁ͕͋Δ • ͘ͳͬͯ͠·͏ • CenterNet ඞཁͱ͠ͳ͍ • ͍ʂ 10
ਫ਼ 11
ਫ਼(M2Det ͷ݁ՌΛࢹͰՃͯ͠Έͨ) 12
ͦͷଞײ • Backbone ͱͯ͠ DLA Λ͑ΔͷΛॳΊͯͬͨ • Ή͠Ζ DLA ॳΊͯΓ·ͨ͠
! • NMS ͕ෆཁʹͳΔͷຯʹخ͍͠ • anchor ͕ফ͑Δͷخ͍͠ • খ͍͞ମʹରͯ͠ͲΕ͚ͩରԠͰ͖Δ͔֬ೝ͠ͳ͍ͱ 13