Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ABEJA Innovation Meetup NIPS PointNet++
Search
望月紅葉さんと幸せな家庭を築きたい
January 01, 2018
Programming
1
490
ABEJA Innovation Meetup NIPS PointNet++
望月紅葉さんと幸せな家庭を築きたい
January 01, 2018
Tweet
Share
More Decks by 望月紅葉さんと幸せな家庭を築きたい
See All by 望月紅葉さんと幸せな家庭を築きたい
shadow-detection-with-conditional-generative-adversarial-networks
momijifullmoon
0
150
unsupervised-learning-of-depth-and-ego-motion-from-monocular-video-using-3d-geometric-constraints
momijifullmoon
0
430
NIPS2017reading_3Dreconstruction
momijifullmoon
0
1.5k
Other Decks in Programming
See All in Programming
大規模アプリのDIフレームワーク刷新戦略 ~過去最大規模の並行開発を止めずにアプリ全体に導入するまで~
mot_techtalk
0
380
いま中途半端なSwift 6対応をするより、Default ActorやApproachable Concurrencyを有効にしてからでいいんじゃない?
yimajo
2
340
詳しくない分野でのVibe Codingで困ったことと学び/vibe-coding-in-unfamiliar-area
shibayu36
3
4.3k
メモリ不足との戦い〜大量データを扱うアプリでの実践例〜
kwzr
1
850
CSC305 Lecture 02
javiergs
PRO
1
260
CSC509 Lecture 03
javiergs
PRO
0
330
PostgreSQLで手軽にDuckDBを使う!DuckDB&pg_duckdb入門/osk2025-duckdb
takahashiikki
1
240
Advance Your Career with Open Source
ivargrimstad
0
330
Railsだからできる 例外業務に禍根を残さない 設定設計パターン
ei_ei_eiichi
0
190
育てるアーキテクチャ:戦い抜くPythonマイクロサービスの設計と進化戦略
fujidomoe
1
150
非同期jobをtransaction内で 呼ぶなよ!絶対に呼ぶなよ!
alstrocrack
0
510
2025年版 サーバーレス Web アプリケーションの作り方
hayatow
23
25k
Featured
See All Featured
Six Lessons from altMBA
skipperchong
28
4k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
285
14k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
What's in a price? How to price your products and services
michaelherold
246
12k
Agile that works and the tools we love
rasmusluckow
331
21k
A designer walks into a library…
pauljervisheath
209
24k
Navigating Team Friction
lara
189
15k
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.7k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
34
6.1k
Into the Great Unknown - MozCon
thekraken
40
2.1k
Side Projects
sachag
455
43k
Art, The Web, and Tiny UX
lynnandtonic
303
21k
Transcript
PointNet++: Deep Hierarchical Feature Learning on Point Sets
in a Metric Space NIPSಡΈձˏABEJA 1
PointNet++ͷ֓ཁ ▸ ஶऀ: Charles R. Qi, Li Yi, Hao Su,
Leonidas J. Guibas ɹɹ ˏελϯϑΥʔυ ▸ ֓ཁ ▸ ܈Λͦͷ··ೖྗ͠ɺͦͷΫϥεྨɺ SegmentationΛߦ͏PointNetͷվྑใࠂ ▸ PointNetͷऑͰ͋ͬͨ܈ີґଘΛࠀɺ ͓Αͼ֊తͳֶशΛͰ͖ΔΑ͏ʹ ʮSampling Layerʯͱ ʮGrouped LayerʯΛఏҊ 2
എܠ ▸ ̏࣍ݩͷधཁ 3 ࣗಈӡస AR ઃܭ
ͷྲྀΕ ▸ എܠ ▸ PointNetʹ͍ͭͯ ▸ ख๏ ▸ ࣮ݧ ▸
·ͱΊ 4
എܠ ▸ ̏࣍ݩͷσʔλ 5 ɹɹ܈ɹɹ ɹɹϝογϡɹɹ Voxel Өɹ RGB-D
എܠ ▸ طଘͷख๏ ▸ ܈Λผͷදݱʹม͍ͯͨ͠ 6 Unstructured, Unordered ͳ܈Λͦͷ··ೖྗ Ͱ͏·͍͘͘Α͏ͳख๏
==> PointNetΛఏҊ@CVPR2017
PointNetͷ͓͞Β͍ ▸ ղ͘λεΫ 7 Classification Segmentation Scene Parsing ೖྗ
PointNetͷ͓͞Β͍ ▸ ઃܭ 8
PointNetͷ͓͞Β͍ ▸ ՝ 9 PointNet֤ʹ͓͍ͯɺlocalͷใ͕ফ͑Δ ֊తಛֶशͰ͖ͳ͍ ෳ֊ͷநԽͰ͖ͳ͍ GlobalͷಛֶशͷΈ ͋Δ͘͠શͯͷ
PointNetͷ͓͞Β͍ ▸ localͷใ͕ফ͑Δͱ 10 globalͷใɺઈର࠲ඪʹґଘͯ͠͠·͏ͷͰɺ segmentationͰະͷͷʹରԠͰ͖ͳ͍
PointNet++Ͱ ▸ ֊తֶश ▸ localͳใΛ͢ 11 ▸ ܈ີʹϩόετʹ
ΞʔΩςΫνϟ 12
֊తͳֶश 13
֊తͳֶश ▸ Sampling layer ▸ Farthest Point Sampling (FPS) 14
https://www.groundai.com/project/parametric-manifold-learning-via-sparse-multidimensional-scaling/
▸ Grouping layer ▸ radius based ball query ֊తͳֶश 15
PointNet layer Convolution layer Input Δԋࢉ ԋࢉͰݟΔ ൣғ Radius ball query ɹ܈ɹ PointNetʢॱ൪ීวʣ ߦྻʢݻఆͷϐΫηϧʣ ΈࠐΈʢॱ൪ґଘʣ ɹີͳߦྻɹ
֊తͳֶश ▸ PointNet layer 16 N1ݸͷʹର͠ C1ݸͷಛ࡞ ॏΈshare
֊తͳֶश ▸ PointNet layer 17 x1,y1,z1,ΫΤϦ1,ಛ1 x2,y2,z2,ΫΤϦ2,ಛ2 x3,y3,z3,ΫΤϦ3,ಛ3 xN1,yN1,zN1,ΫΤϦN1ಛN1 MLP
MLP MLP MLP x1,y1,z1,ಛ1 x2,y2,z2,ಛ2 x3,y3,z3,ಛ3 xN1,yN1,zN1,ಛN1 ॏΈShare
ີґଘࠀख๏ ▸ ̏࣍ݩͷଌఆͰ܈ີ͕Ұൠతͳ՝ 18 ==> ܈ີʹϩόετʹ͍ͨ͠
ີґଘࠀख๏ ▸ SamplingͱGroupingΛෳ༻ҙ 19 MRGͷํ͕࣍ͰपลͱͷಛΛर͑Δ
Classification ࣮ݧ 20
▸ ModelNet40ʹରͯ͠ Classification ࣮ݧ 21 PointNetʹൺɺPointNet++ྨਫ਼্ CNNϕʔεͷख๏ʹউར
ີґଘ࣮ݧ 22 ಛʹ܈͕গͳ͍ͱɺMRG͕༗ޮ
Segmentation ࣮ݧ 23 ૠɿɹIDW (ٯڑՃॏ) Unitpointnet: ֤ͰMLP
Segmentation ࣮ݧ ▸ ݁Ռ 24 MSGΛೖΕΔ͜ͱͰɺෆۉҰͳ܈Ͱ͏·͍͘͘
Segmentation ࣮ݧ ▸ ݁Ռ 25 PointNetΑΓՈ۩ͷsegmentation্͕ख͍͘͘
ඇϢʔΫϦου ڑۭؒͰͷ࣮ݧ 26 WKS , HKS, multi-scale Gaussian curvature
Feature Visualization ▸ ࠷ॳͷͷॏΈΛՄࢹԽ 27 ฏ໘ɺίʔφʔͱ͔Λֶश
·ͱΊ ▸ PointNetΛ֦ுͨ͠ख๏PointNet++Λൃද ▸ CVPR2017=>NIPS2017ʹ̍ຊ௨͍ͯ͠Δɻɻɻ ▸ Sampling layerɺGrouped layerΛऔΓೖΕ֊తͳֶश ▸
MRGɺMSGΛఏҊ͠ɺ܈ີʹґଘ͠ͳֶ͍श ▸ ̏࣍ݩ܈ͷσʔληοτʹରͯ͠ɺSoTAୡ ▸ ݱʹߦͬͨײ ▸ ஶऀͱ͢͜ͱͰࡉ͔ͳใΛर͑Δ 28