Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
AR Face Detection
Search
Tachibana Kaoru
October 25, 2017
2
3.6k
AR Face Detection
Tachibana Kaoru
October 25, 2017
Tweet
Share
More Decks by Tachibana Kaoru
See All by Tachibana Kaoru
GeoLocationAnchor and MKTileOverlay
toyship
0
290
Custom Group Activities
toyship
3
1.3k
Synchronized iPhones, Again!
toyship
2
1.4k
ARKit4.pdf
toyship
1
2.1k
Custom Gesture Recognizer on iOS
toyship
3
1.3k
HEVC Video with Alpha Channel
toyship
1
1.1k
RealityKit & Reality Composer
toyship
3
490
ARKit3
toyship
4
7k
UIViewPropertyAnimator and Easing
toyship
2
940
Featured
See All Featured
Building a Modern Day E-commerce SEO Strategy
aleyda
38
6.9k
Building Flexible Design Systems
yeseniaperezcruz
327
38k
The World Runs on Bad Software
bkeepers
PRO
65
11k
Fireside Chat
paigeccino
34
3k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
25
1.8k
Become a Pro
speakerdeck
PRO
25
5k
Stop Working from a Prison Cell
hatefulcrawdad
267
20k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
159
15k
Making Projects Easy
brettharned
115
5.9k
Imperfection Machines: The Place of Print at Facebook
scottboms
265
13k
Teambox: Starting and Learning
jrom
133
8.8k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
0
100
Transcript
AR FACE DETECTION @TACHIBANAKAORU 2017/10/25
AR FACE DETECTION ࣗݾհ ▸ @TachibanaKaoru ▸ ϑϦʔϥϯε iOSΤϯδχΞ ▸
ϘϧμϦϯά͕͖Ͱɺ࠷ۙϦʔυΫϥΠϛ ϯάνϟϨϯδதɻ ▸ Blog : http://www.toyship.org/Kaoru
ARKIT
AR FACE DETECTIONTEXT ARKIT ▸ Augmented RealityΛ؆୯ʹ࣮͢ΔϑϨʔϜϫʔΫ ▸ iOS11͔Βհ͞Εͨ ▸
CPU͕A9Ҏ্ͷͰར༻Մೳ
AR FACE DETECTION ARKITͷಛ ▸ ࣮͕؆୯ ▸ σόΠεͷՃใΛར༻ ▸ ඳըΤϯδϯΛબͰ͖Δ
AR FACE DETECTION ARKITͷಛ ▸ ࣮͕؆୯ ▸ Xcode9͔ΒɺςϯϓϨʔτϓϩδΣΫτʹ ʮAugmented Reality
Appʯ͕͋Γɺ͜ΕΛϏϧυ͢Δ ͚ͩͰɺγϯϓϧͳARΞϓϦέʔγϣϯͱͳΓ·͢ɻ ▸ ࣗͰ࣮͢Δ߹ʹɺARSCNViewͳͲͷΦϒδΣΫ τΛ࡞Δ͚ͩͰಈըॲཧͳͲΛ͢Δඞཁ͕ͳ͘ɺγϯϓ ϧɻ
AR FACE DETECTION ARKITͷಛ ▸ σόΠεͷՃใͱΧϝϥը૾Λಉ࣌ʹղ ੳ͢ΔͨΊτϥοΩϯά͕ਖ਼֬
AR FACE DETECTION ARKITͷಛ ▸ ඳըΤϯδϯΛબͰ͖Δ ▸ SceneKitɺSpriteKitɺMetalͷඳըϑϨʔϜϫʔΫʹରԠ ▸ UnityUnreal
EngineʹରԠ
AR FACE DETECTION ෆࢥٞͷࠃͷΞϦεAR
AR FACE DETECTIONTEXT AR WORLD TRACKING WITH ARKIT ▸ ARSCNViewΛ࡞͠ɺWorld
Tracking༻ͷConfiguretonΛઃఆ͢Δɻ ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
TEXT AR WORLD TRACKING WITH ARKIT ▸ ฏ໘ݕ͕onʹͳ͍ͬͯΔͱɺݕͨ͠߹ʹDelegateʹ௨͞ΕΔ
AR FACE DETECTION ARKIT FACE DETECTION ▸ ळͷΠϕϯτͰiPhoneXͱಉ࣌ʹൃද ▸ ݱࡏͷͱ͜ΖɺiPhoneXͷΈͰར༻Ͱ͖Δػೳ
AR FACE DETECTION
AR FACE DETECTIONTEXT IPHONEX SENSORS
AR FACE DETECTIONTEXT
AR FACE DETECTIONTEXT ʢը૾ΠϝʔδͰ͢ʣ
AR FACE DETECTION AR FACE DETECTION ▸ True Depth CameraʹΑΓɺإͷਂใΛऔಘ͢Δ
▸ 50ݸҎ্ʹ͓ΑͿإͷৄࡉύʔπϞσϧΛผՄೳ ▸ VisionϑϨʔϜϫʔΫͰإύʔπͷೝࣝՄೳ͕ͩɺೝࣝͰ͖Δύʔπ͕গ ͳ͍
AR FACE DETECTION
AR FACE DETECTIONTEXT AR WORLD TRACKING WITH ARKIT ▸ ARSCNViewΛ࡞͠ɺFace
Detection༻ͷConfiguretonΛઃఆ͢Δɻ ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
AR FACE DETECTION FACE DETECTION ▸ إ͕ೝࣝ͞Εͨ࣌ʹDelegateʹ௨͞ΕΔ
AR FACE DETECTION FRONT OR REAR CAMERA ▸ ARCSNViewΛ࡞ͬͯWorld TrackingΛ͠Α͏ͱ͢ΔͱɺσϑΥϧτͷঢ়ଶͰ
iPhoneͷϦΞΧϝϥ͕ΘΕ·͢ɻ ▸ ͜ΕϑϩϯτΧϝϥʹม͑Δ͜ͱͰ͖ΔͷͰ͠ΐ͏͔ʁ ▸ Ͱ͖·ͤΜ
AR FACE DETECTION FRONT OR REAR CAMERA ▸ ͱ͜Ζ͕ɺiPhoneͷإೝࣝͰɺવTrue Depth
Camera͕͋ΔϑϩϯτΧϝϥ ͷө૾͕ΘΕ·͢ɻ ▸ ͜ΕϦΞΧϝϥʹม͑Δ͜ͱͰ͖ΔͷͰ͠ΐ͏͔ʁ ▸ Ͱ͖·ͤΜ
AR FACE DETECTIONTEXT FRONT OR REAR CAMERA ▸ ͓ͦΒ͘ɺConfigurationʹΑΓɺར༻͢ΔΧϝϥ͕ҟͳΔͱ͓ΘΕ·͢ ▸
World Tracking Configurationͷ߹ʹϦΞΧϝϥ ▸ Face Detection Configurationͷ߹ʹϑϩϯτΧϝϥ
AR FACE DETECTION FACE DETECTION SAMPLE CODE ▸ ळͷΠϕϯτͱಉ࣌ʹFace DetectionͷAR͕ൃද͞Εɺಉ࣌ʹαϯϓϧίʔυ
ఏڙ͞Ε͍ͯ·͢ɻ ▸ ͨͩ͠ɺ࣮ػ(iPhoneX)Ͱ͔͠ػೳ͠ͳ͍ͷͰɺίʔυΛΑΉ͔͠ͳ͍ͷͰ͢ ͕……ɻ
AR FACE DETECTION DEPTH DATA IN ARFRAME
AR FACE DETECTION ·ͱΊ ▸ AR World Tracking/ AR Face
DetectionͲͪΒ࣮͕ඇৗʹ؆୯ ▸ AR Face Detection࣮ػͰ͔͠ࢼͤͳ͍ ▸ iPhoneXཉ͍͠ʂ