So you want to build an ARKit app- Swiftfest 2019

ARKit has shown how AR can be integrated into apps to make them more engaging and fun. Although AR has mainly been introduced by games such as Pokémon Go!, it has many practical applications. If you are thinking about using ARKit in your app, this talk is for you. Last year I co-authored the ARKit by Tutorials book, and developed a couple of ARKit apps. This talk covers challenges I experienced building these apps such as ensuring good app performance, handling problematic scenarios and improving plane detection. Learn how to use ARKit to its full potential, keep your AR apps performant and deliver a polished end-user experience.

Transcript

1. SO YOU WANT TO BUILD AN ARKIT APP NAMRATA BANDEKAR
2. ARKIT BY TUTORIALS
3. AGENDA ▸ Getting Started ▸ Diving Deeper ▸ Do’s and Don’ts
5. PORTAL
6. PORTAL
7. PORTAL ARSKETCH
8. PORTAL ARSKETCH
9. AUGMENTED REALITY EXPERIENCE
10. AUGMENTED REALITY EXPERIENCE ▸ Detect and understand environment geometry
11. AUGMENTED REALITY EXPERIENCE ▸ Detect and understand environment geometry ▸ Render virtual 3D content
12. AUGMENTED REALITY EXPERIENCE ▸ Detect and understand environment geometry ▸ Render virtual 3D content ▸ User guidance
13. GETTING STARTED
14. GETTING STARTED ▸ Device Compatibility
15. GETTING STARTED ▸ Device Compatibility ▸ A9 processor (iPhone 6) or later
16. GETTING STARTED ▸ Device Compatibility ▸ A9 processor (iPhone 6) or later ▸ iOS 11 and up
17. GETTING STARTED ▸ Device Compatibility ▸ A9 processor (iPhone 6) or later ▸ iOS 11 and up ▸ Handle unsupported devices and iOS versions
18. GETTING STARTED ▸ Device Compatibility ▸ A9 processor (iPhone 6) or later ▸ iOS 11 and up ▸ Handle unsupported devices and iOS versions AR Required
19. GETTING STARTED ▸ Device Compatibility ▸ A9 processor (iPhone 6) or later ▸ iOS 11 and up ▸ Handle unsupported devices and iOS versions
20. GETTING STARTED ▸ Device Compatibility ▸ A9 processor (iPhone 6) or later ▸ iOS 11 and up ▸ Handle unsupported devices and iOS versions AR Optional
21. GETTING STARTED ▸ Device permissions
22. GETTING STARTED ▸ Privacy and data handling
23. DIVING DEEPER
24. TRACKING
25. TRACKING ▸ ARAnchors fix position in real world ⚓
26. TRACKING ▸ ARAnchors fix position in real world ⚓ ▸ ARAnchors adjust for drift
27. TRACKING ▸ ARAnchors fix position in real world ⚓ ▸ ARAnchors adjust for drift ▸ Don’t use feature points to place content
28. TRACKING ▸ ARAnchors fix position in real world ⚓ ▸ ARAnchors adjust for drift ▸ Don’t use feature points to place content
29. TRACKING QUALITY
30. TRACKING QUALITY ▸ Ambient light
31. TRACKING QUALITY ▸ Ambient light
32. TRACKING QUALITY ▸ Ambient light
33. TRACKING QUALITY ▸ Ambient light
34. TRACKING QUALITY ▸ Ambient light
35. TRACKING QUALITY ▸ Ambient light ▸ Static environments
36. TRACKING QUALITY ▸ Ambient light ▸ Static environments
37. TRACKING QUALITY ▸ Ambient light ▸ Static environments
38. TRACKING QUALITY ▸ Ambient light ▸ Static environments ▸ Surface texture
39. TRACKING QUALITY ▸ Ambient light ▸ Static environments ▸ Surface texture
40. TRACKING QUALITY ▸ Ambient light ▸ Static environments ▸ Surface texture
41. TRACKING QUALITY ▸ Ambient light ▸ Static environments ▸ Surface texture ▸ Sensor data quality
42. TRACKING QUALITY
43. TRACKING QUALITY
44. TRACKING QUALITY
45. TRACKING QUALITY
46. TRACKING QUALITY
47. TRACKING QUALITY
48. PERSISTING VIRTUAL CONTENT
49. PERSISTING VIRTUAL CONTENT ▸ ARWorldMap - serializable
50. PERSISTING VIRTUAL CONTENT ▸ ARWorldMap - serializable ▸ Use NSSecureCoding protocol
51. PERSISTING VIRTUAL CONTENT ▸ ARWorldMap - serializable ▸ Use NSSecureCoding protocol ▸ ARAnchors store object state and position
52. CAPTURING THE ARWORLDMAP
53. CAPTURING THE ARWORLDMAP
54. CAPTURING THE ARWORLDMAP ▸ Use WorldMappingStatus
55. WORLD MAPPING
56. WORLD MAPPING ▸ Don’t display UI until ready
57. WORLD MAPPING ▸ Don’t display UI until ready
58. DO’S ✅ AND DON’TS
59. USE THE ENTIRE SCREEN ✅
60. COMFORTABLE AND SAFE TECHNOLOGY KISS - Keep it short and safe
61. ENABLE ONE-HANDED APP USE
62. ENABLE ONE-HANDED APP USE
63. INITIALIZATION TAKES TIME ⏳
64. Do ✅ Don’t ❌ Try moving around, turning on more lights and making sure your environment has sufficiently textured surfaces Surface detection is taking too long Move your phone slower Excessive motion detected Tap a location to place the [name of object to be placed] Tap a plane to anchor an object
65. GHOST EFFECT
66. GHOST EFFECT
68. DON’T ASSUME IDEAL ENVIRONMENT
69. MAPPING FROM A DISTANCE
72. SCENEKIT DELEGATES
73. SCENEKIT DELEGATES ⚠ Private Queue
74. BATTERY DRAIN!
75. SET YOUR USERS UP FOR SUCCESS
76. SET YOUR USERS UP FOR SUCCESS
77. THANK YOU! @NAMRATACODES NAMRATABANDEKAR https://tinyurl.com/swiftfest-arkit