Paper-Survey: Objects as Points

Transcript

1. ࿦จLT: Objects as Points h"ps:/ /arxiv.org/abs/1904.07850 2019/04/19 ౻ຊ༟հ 1
2. ໨࣍ • ஶऀ৘ใ • ֓ཁ • ͜Ε·ͰͷϞσϧͱͷҧ͍ • ਫ਼౓ • ͦͷଞײ૝ 2
3. ஶऀ৘ใ • Xingyi Zhou(UT Aus1n) • Dequan Wang(UC Berkeley) • Philipp Krähenbühl(UT Aus1n) 3
4. ಛ௃ • ෺ମݕग़Ϟσϧ • ༗໊ͳྫ: SSD, YOLOv3, Re.naNet, M2Det... • ݕग़ͷΈͳΒͣ࢟੎ɾdepthɾ޲͖ɾ3d size ౳ʹ΋ద༻͍ͯ͠Δ • backbone ͱͯ͠ DLA(deep layers aggrega.on) ΍ Hourglass(CornerNet ౳Ͱ࢖ ༻) Λ࢖༻ 4
5. ಛ௃ • bounding box Λ࢖Θͣʹݕग़Λߦ͏Ϟσϧ(keypointਪఆ) • bounding box ༻ͷ grid ͷ୅ΘΓʹ໨͕ࡉ͔͍ heatmap(H, W Λ4Ͱׂͬͨఔ ౓ͷ΋ͷ) Λग़ྗ • heatmap ͕ߴ͍৔ॴ(௖఺) Λ෺ମͷத৺ͱਪఆ • த৺ͱͳΔ৔ॴͷ feature ͔Β෺ମͷେ͖͞ɾ཭ࢄԽޡࠩΛਪఆ • ཭ࢄԽޡࠩ = heatmap ʹͨ͠ࡍͷޡࠩ • େ͖͞ʹ͍ͭͯ͸ scale ͍ͯ͠ͳ͍(ͦͷ··ͷ஋) 5
6. ಛ௃ • ༧ଌϘοΫε = heatmap ͷ࠲ඪ + ༧ଌϘοΫεαΠζ + ༧ଌ཭ࢄԽޡࠩ • ֶशʹ࢖͏ heatmap ͷ఺͸ 1෺ମʹ͖ͭ 1ͭͷΈ • SSD ౳ͷΑ͏ʹ IoU ͷॏͳΓ۩߹Ͱ background ͔൱͔Λ෼͚ͳ͍ • ෳ਺ box ग़͞ͳ͍͜ͱΛલఏͱ͍ͯ͠Δ • ಉ͡ΫϥεͰॏͳͬͯ͠·͏৔߹͕͋Δ͕શମͷ 0.1 % ະຬͰ RCNN(2% ະ ຬ) ΑΓখ͍͞ 6
7. Πϝʔδਤ 7
8. ͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet ౳)ͱͷҧ͍ • CenterNet͸ശͷॏͳΓͰ͸ͳ͘ҐஔͷΈʹج͍ͮͯʮΞϯΧʔʯΛׂ౰ • લܠͱഎܠͷ෼ྨʹؔ͢Δखಈͷ͖͍͠஋͸ͳ͍(IoU 0.5 > ͱ͔) • ෺ମຖʹϙδςΟϒͳΞϯΧʔ͸1͚ͭͩͳͷͰ NMS Λඞཁͱ͠ͳ͍ • We simply extract local peaks in the keypoint heatmap • keypoint heatmap ͔ΒϩʔΧϧϐʔΫΛநग़͢Δ͚ͩͰྑ͍ 8
9. ͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on with implicit anchors(SSD, YOLO, Re*naNet ౳)ͱͷҧ͍ • CenterNet͸ΑΓେ͖ͳग़ྗղ૾౓Λ࢖͏ • mask r-cnn ͱ͔ͱൺֱͯ͠ • output stride of 16 • ͜ΕʹΑΓෳ਺ͷΞϯΧʔ͕ෆཁͱͳΔʁʁʁʁ • [1711.08189] An Analysis of Scale Invariance in Object Detec*on - SNIP 9
10. ͜Ε·ͰͷϞσϧͱͷҧ͍ • Object detec*on by keypoint es*ma*on(CornerNet, ExtremeNet ౳)ͱͷҧ͍ • ্ه 2ͭ͸ keypoint ݕग़ޙʹ ૊Έ߹ΘͤΛ grouping ͢Δඞཁ͕͋Δ • ஗͘ͳͬͯ͠·͏ • CenterNet ͸ඞཁͱ͠ͳ͍ • ଎͍ʂ 10
11. ਫ਼౓ 11
12. ਫ਼౓(M2Det ͷ݁ՌΛ໨ࢹͰ௥Ճͯ͠Έͨ) 12
13. ͦͷଞײ૝ • Backbone ͱͯ͠ DLA Λ࢖͑ΔͷΛॳΊͯ஌ͬͨ • Ή͠Ζ DLA ॳΊͯ஌Γ·ͨ͠ ! • NMS ͕ෆཁʹͳΔͷ͸஍ຯʹخ͍͠ • anchor ͕ফ͑Δͷ΋خ͍͠ • খ͍͞෺ମʹରͯ͠ͲΕ͚ͩରԠͰ͖Δ͔֬ೝ͠ͳ͍ͱ 13