Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
AR Face Detection
Search
Tachibana Kaoru
October 25, 2017
2
3.7k
AR Face Detection
Tachibana Kaoru
October 25, 2017
Tweet
Share
More Decks by Tachibana Kaoru
See All by Tachibana Kaoru
GeoLocationAnchor and MKTileOverlay
toyship
0
330
Custom Group Activities
toyship
3
1.4k
Synchronized iPhones, Again!
toyship
2
1.5k
ARKit4.pdf
toyship
1
2.2k
Custom Gesture Recognizer on iOS
toyship
3
1.4k
HEVC Video with Alpha Channel
toyship
1
1.2k
RealityKit & Reality Composer
toyship
3
600
ARKit3
toyship
4
7.3k
UIViewPropertyAnimator and Easing
toyship
2
1.1k
Featured
See All Featured
Code Reviewing Like a Champion
maltzj
524
40k
Thoughts on Productivity
jonyablonski
69
4.8k
Designing for humans not robots
tammielis
253
25k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
21
1.4k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
283
13k
The Invisible Side of Design
smashingmag
301
51k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.7k
RailsConf 2023
tenderlove
30
1.2k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.4k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Transcript
AR FACE DETECTION @TACHIBANAKAORU 2017/10/25
AR FACE DETECTION ࣗݾհ ▸ @TachibanaKaoru ▸ ϑϦʔϥϯε iOSΤϯδχΞ ▸
ϘϧμϦϯά͕͖Ͱɺ࠷ۙϦʔυΫϥΠϛ ϯάνϟϨϯδதɻ ▸ Blog : http://www.toyship.org/Kaoru
ARKIT
AR FACE DETECTIONTEXT ARKIT ▸ Augmented RealityΛ؆୯ʹ࣮͢ΔϑϨʔϜϫʔΫ ▸ iOS11͔Βհ͞Εͨ ▸
CPU͕A9Ҏ্ͷͰར༻Մೳ
AR FACE DETECTION ARKITͷಛ ▸ ࣮͕؆୯ ▸ σόΠεͷՃใΛར༻ ▸ ඳըΤϯδϯΛબͰ͖Δ
AR FACE DETECTION ARKITͷಛ ▸ ࣮͕؆୯ ▸ Xcode9͔ΒɺςϯϓϨʔτϓϩδΣΫτʹ ʮAugmented Reality
Appʯ͕͋Γɺ͜ΕΛϏϧυ͢Δ ͚ͩͰɺγϯϓϧͳARΞϓϦέʔγϣϯͱͳΓ·͢ɻ ▸ ࣗͰ࣮͢Δ߹ʹɺARSCNViewͳͲͷΦϒδΣΫ τΛ࡞Δ͚ͩͰಈըॲཧͳͲΛ͢Δඞཁ͕ͳ͘ɺγϯϓ ϧɻ
AR FACE DETECTION ARKITͷಛ ▸ σόΠεͷՃใͱΧϝϥը૾Λಉ࣌ʹղ ੳ͢ΔͨΊτϥοΩϯά͕ਖ਼֬
AR FACE DETECTION ARKITͷಛ ▸ ඳըΤϯδϯΛબͰ͖Δ ▸ SceneKitɺSpriteKitɺMetalͷඳըϑϨʔϜϫʔΫʹରԠ ▸ UnityUnreal
EngineʹରԠ
AR FACE DETECTION ෆࢥٞͷࠃͷΞϦεAR
AR FACE DETECTIONTEXT AR WORLD TRACKING WITH ARKIT ▸ ARSCNViewΛ࡞͠ɺWorld
Tracking༻ͷConfiguretonΛઃఆ͢Δɻ ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
TEXT AR WORLD TRACKING WITH ARKIT ▸ ฏ໘ݕ͕onʹͳ͍ͬͯΔͱɺݕͨ͠߹ʹDelegateʹ௨͞ΕΔ
AR FACE DETECTION ARKIT FACE DETECTION ▸ ळͷΠϕϯτͰiPhoneXͱಉ࣌ʹൃද ▸ ݱࡏͷͱ͜ΖɺiPhoneXͷΈͰར༻Ͱ͖Δػೳ
AR FACE DETECTION
AR FACE DETECTIONTEXT IPHONEX SENSORS
AR FACE DETECTIONTEXT
AR FACE DETECTIONTEXT ʢը૾ΠϝʔδͰ͢ʣ
AR FACE DETECTION AR FACE DETECTION ▸ True Depth CameraʹΑΓɺإͷਂใΛऔಘ͢Δ
▸ 50ݸҎ্ʹ͓ΑͿإͷৄࡉύʔπϞσϧΛผՄೳ ▸ VisionϑϨʔϜϫʔΫͰإύʔπͷೝࣝՄೳ͕ͩɺೝࣝͰ͖Δύʔπ͕গ ͳ͍
AR FACE DETECTION
AR FACE DETECTIONTEXT AR WORLD TRACKING WITH ARKIT ▸ ARSCNViewΛ࡞͠ɺFace
Detection༻ͷConfiguretonΛઃఆ͢Δɻ ▸ ࣗಈతʹΧϝϥը૾͕ॲཧ͞ΕΔɻ
AR FACE DETECTION FACE DETECTION ▸ إ͕ೝࣝ͞Εͨ࣌ʹDelegateʹ௨͞ΕΔ
AR FACE DETECTION FRONT OR REAR CAMERA ▸ ARCSNViewΛ࡞ͬͯWorld TrackingΛ͠Α͏ͱ͢ΔͱɺσϑΥϧτͷঢ়ଶͰ
iPhoneͷϦΞΧϝϥ͕ΘΕ·͢ɻ ▸ ͜ΕϑϩϯτΧϝϥʹม͑Δ͜ͱͰ͖ΔͷͰ͠ΐ͏͔ʁ ▸ Ͱ͖·ͤΜ
AR FACE DETECTION FRONT OR REAR CAMERA ▸ ͱ͜Ζ͕ɺiPhoneͷإೝࣝͰɺવTrue Depth
Camera͕͋ΔϑϩϯτΧϝϥ ͷө૾͕ΘΕ·͢ɻ ▸ ͜ΕϦΞΧϝϥʹม͑Δ͜ͱͰ͖ΔͷͰ͠ΐ͏͔ʁ ▸ Ͱ͖·ͤΜ
AR FACE DETECTIONTEXT FRONT OR REAR CAMERA ▸ ͓ͦΒ͘ɺConfigurationʹΑΓɺར༻͢ΔΧϝϥ͕ҟͳΔͱ͓ΘΕ·͢ ▸
World Tracking Configurationͷ߹ʹϦΞΧϝϥ ▸ Face Detection Configurationͷ߹ʹϑϩϯτΧϝϥ
AR FACE DETECTION FACE DETECTION SAMPLE CODE ▸ ळͷΠϕϯτͱಉ࣌ʹFace DetectionͷAR͕ൃද͞Εɺಉ࣌ʹαϯϓϧίʔυ
ఏڙ͞Ε͍ͯ·͢ɻ ▸ ͨͩ͠ɺ࣮ػ(iPhoneX)Ͱ͔͠ػೳ͠ͳ͍ͷͰɺίʔυΛΑΉ͔͠ͳ͍ͷͰ͢ ͕……ɻ
AR FACE DETECTION DEPTH DATA IN ARFRAME
AR FACE DETECTION ·ͱΊ ▸ AR World Tracking/ AR Face
DetectionͲͪΒ࣮͕ඇৗʹ؆୯ ▸ AR Face Detection࣮ػͰ͔͠ࢼͤͳ͍ ▸ iPhoneXཉ͍͠ʂ