Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ARKit4.pdf
Search
Tachibana Kaoru
July 10, 2020
1
2.2k
ARKit4.pdf
Tachibana Kaoru
July 10, 2020
Tweet
Share
More Decks by Tachibana Kaoru
See All by Tachibana Kaoru
GeoLocationAnchor and MKTileOverlay
toyship
0
310
Custom Group Activities
toyship
3
1.3k
Synchronized iPhones, Again!
toyship
2
1.5k
Custom Gesture Recognizer on iOS
toyship
3
1.3k
HEVC Video with Alpha Channel
toyship
1
1.1k
RealityKit & Reality Composer
toyship
3
560
ARKit3
toyship
4
7.2k
UIViewPropertyAnimator and Easing
toyship
2
1k
Synchronized iPhones!
toyship
3
4.6k
Featured
See All Featured
Documentation Writing (for coders)
carmenintech
69
4.7k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.5k
Building an army of robots
kneath
304
45k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
23
2.6k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
19
1.1k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
Rails Girls Zürich Keynote
gr2m
94
13k
Build your cross-platform service in a week with App Engine
jlugia
229
18k
What’s in a name? Adding method to the madness
productmarketing
PRO
22
3.4k
Done Done
chrislema
183
16k
StorybookのUI Testing Handbookを読んだ
zakiyama
29
5.6k
Music & Morning Musume
bryan
47
6.5k
Transcript
ARKit4.0 @TachibanaKaoru 2020/7/10 #potatotips
About Me @TachibanaKaoru Freelance iOS Engineer
ARKit History
ARKit History ARKit iOS ver release main feature 1.0 11.0
2017/06 ۭؒݕɺฏ໘ʢਫฏ໘ʣݕɺإදݕ 1.5 11.3 2018/01 ฏ໘ʢਨ໘ݕʣɺը૾ݕ 2.0 12.0 2018/06 ը૾ݕϞʔυՃɺARঢ়ଶอଘରԠɺ Object SacnରԠɺࢹઢɾઉݕ 3.0 13.0 2019/06 BodyScanɺPeople Occupation 3.5 13.4 2020/03 scene detection with LiDAR 4.0 14.0 2020/06 GeoAnchor
ARKit Information 1.0 https://speakerdeck.com/toyship/ar-face-detection 1.5 https://www.toyship.org/2018/01/26/115705 2.0 https://speakerdeck.com/toyship/arkit-2-dot-0 https://www.toyship.org/2018/06/05/193435 3.0
https://speakerdeck.com/toyship/arkit3 3.5 https://www.toyship.org/2020/03/30/150924
What's new with ARKit4 Geo Anchor Scene Geometry with LiDAR
Depth with LiDAR Face Tracking
GeoAnchor
ARGeoAnchorͱ ҐஔʢҢ/ܦʣΛࢦఆͯ͠ΞϯΧʔΛ͓͘͜ ͱ͕Ͱ͖Δ Apple͕MapใΛऔಘ͢Δͱ͖ʹऩू࣮ͨ͠ࡍ ͷݐͷ3DใͱɺΧϝϥը૾͔Βੳͨ͠3D ใͱɺͷGPSใΛΈ߹ΘͤͨΈ ඇৗʹਖ਼֬ͳҐஔଌఆ͕Մೳ
Why Geo Anchor? Ή͔͠Ή͔͠ɺ·ͩiPhoneʹARػೳͳΜͯશ͘ͳ͔ͬͨ͜ΖʹɺηΧΠ Χϝϥͱ͍͏ΞϓϦ͕͋Γ·ͨ͠ɻ ʢΒͳ͍ํάά͍ͬͯͩ͘͞ʣ ʢ2009ɻࢥ͑ૣ͗͢·ͨ͠……ɻʣ ηΧΠΧϝϥͱಉ͜͡ͱ͕ඇৗʹ؆୯ʹ࣮Ͱ͖ΔΑ͏ʹͳΓ·͢ɻ
Pros and Cons Pros GPSͷΈΛ͔ͭͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Χϝϥͷө૾ΛͬͨҐஔಛఆΑΓߴ͍ਫ਼ͰҐஔΛଌఆͰ͖Δ Cons ݶΒΕͨॴͰ͔͑͠ͳ͍ɻ ಓ࿏͔Βݟ͑ͳ͍ॴʢApple Mapʹใ͕ͳ͍ॴʣͰ͑ͳ͍
Where can we use this? ݱ࣌ͰԼهͷॴͰ͚ͩ͑·͢ αϯϑϥϯγείɺγΧΰɺϚΠΞϛ χϡʔϤʔΫɺϩαϯθϧε Նʹ͏গ͠Ճ͞ΕΔΒ͍͚͠Ͳɺݱ࣌Ͱৄࡉෆ໌
How To Use // GeoTracking͕͑Δ͔Ͳ͏͔ௐΔ ARGeoTrackingConfiguration.checkAvailability { (available, error) in
if !available { // ʮ͑·ͤΜʯදࣔΛ͢Δɻ } } // GeoTrackingͷઃఆͰηογϣϯΛ։࢝͢Δɻ arView.session.run( ARGeoTrackingConfiguration() )
without ARGeoAnchor... ARGeoAnchor ͷର۠Ҭ֎ͰࣅͨΑ͏ͳ͜ͱΛ ͍ͨ͠߹ɺ ARConfiguration.WorldAlignment.gravityAndHeadi ng ΛͬͯΈ·͠ΐ͏ɻ x͕࣠౦ɺy͕࣠ॏྗํɺz͕࣠ೆʹݻఆ͞ Εͨঢ়ଶͱͳΓ·͢ɻ
Scene Geometry and Depth with LiDAR
LiDAR Light Detection and Ranging ύϧεঢ়ʹൃޫ͢ΔϨʔβʔরࣹΛߦ͍ɺ ࢄཚޫ͔ΒҐஔରͷछྨΛଌఆ͢Δ ηϯαʔ only on
latest iPad Pro
How LiDAR works ηϯαʔ͔ΒޫΛরࣹ ࣹޫΛऩू
Scene detection with LiDAR LiDAR Ͱମ·Ͱͷڑ͓Αͼମͷछྨ͕Θ ͔ΔΑ͏ʹͳ͍ͬͯ·͢ɻ ఆՄೳͳମఱҪɺυΞɺচɺҜࢠɺςʔ ϒϧɺนɺ૭ɺͦͷଞɺͷ̔छྨɻ
Depth and scene detection with LiDAR ͍··ͰͷARKit 3.5Ͱମ·ͰͷڑͱछྨऔಘͰ͖ͨͷͰ͕͢ɺ ARKit4ͰAPI͕ଟগ͍͘͢ͳΓ·ͨ͠ɻ
App With LiDAR LiDARͷ Scene Detection Λͬͯɺମ·ͰͷڑͱछྨΛ͠Όͬͯ ͘ΕΔΞϓϦΛ͍ͩͯ͠ΔͷͰɺΑ͔ͬͨΒͬͯΈ͍ͯͩ͘͞ɻ https://apps.apple.com/jp/app/whatsoverthere/id1505077334 ʮ3
m ઌʹ૭͕͋Γ·͢ʯͳͲͱ ͠Όͬͯڭ͑ͯ͘Ε·͢ɻ
Face Detection ࠓ·Ͱ TrueDepthΧϝϥࡌͷΈͰ͕ͨ͠ɺA12 Ҏ্ͷϓϩηο αʔͰ͑ΔΑ͏ʹͳΓ·ͨ͠ɻ
Reality Converter ଞͷϞσϦϯάπʔϧͷϑΝΠϧ͔ΒUSDZϑΝ Πϧͷίϯόʔλʔ 20201݄ ϦϦʔε
Reality Converter ࠓ·ͰίϚϯυϥΠϯ ͷ usdz มπʔϧ͋ͬͨͷ͚ͩͲɺखॱ͕ ͘͠ɺΤϥʔଟ͔ͬͨɻ Reality Converter
3DϞσϧϑΝΠϧΛ D&D ͢Δ͚ͩͰ͍͘͢ɺର ԠϑΥʔϚοτଟ͍ɻ
Reality Composer USDZ ϑΝΠϧͷΤΫεϙʔτʹରԠ ʢڈ·ͰRealityϑΝΠϧ͔͠ग़ྗͰ͖· ͤΜͰͨ͠ɻʣ
None
Reality Composer and Converter ͜Μͳํʹ͓͢͢ΊͰ͢ ARΛͪΐͬͱࢼͯ͠Έ͍ͨΜ͚ͩͲɺ͍͍Ϟσϧ͕ͳ͍ʂ 3DϞσϧΛࣗͰ࡞Ζ͏ͱ͚ͨ͠Ͳ࠳ંͨ͠ʂ Unity ָ͔ͭ͑ͳΜͩΖ͏͚Ͳɺͦ͜·ͰΔ͕࣌ؒͳ͍……ɻ
·ͱΊ Geo MarkerରԠҬ͕૿͑Δͱ͍͍Ͱ͢Ͷɻ ࠓUSDZ ϑΝΠϧ·ΘΓͷऔΓѻ͍͕ͱָͯʹͳΓ·ͨ͠ɻ ࣍ͷ iPhone ʹઈର LiDAR ͕ࡌ͞Ε·͢ʂ͜ͷΧγΦϛχΛ͔͚ͯ
͍͍Ͱ͢ʂ