オンデバイスで学習可能になったCreate MLで画像分類器を作ってみた💪 / Developing an app to train an image classifier on iOS Device using Create ML

[Online] potatotips #75 iOS/Android開発Tips共有会
https://potatotips.connpass.com/event/218185/

サンプルアプリ: https://github.com/rockname/PhotoSelectionClassifier

Transcript

1. ΦϯσόΠεͰֶशՄೳʹͳͬͨ Create MLͰը૾෼ྨثΛ࡞ͬͯΈͨ💪 גࣜձࣾϛΫγΟ ΈͯͶࣄۀ෦ ϩΫωϜ @_rockname
2. mixi, Inc. ࣗݾ঺հ ϩΫωϜ / rockname • ϛΫγΟͰʮՈ଒ΞϧόϜΈͯͶʯͱ͍͏ΞϓϦΛ
 ։ൃͯ͠Δ • iOSϝΠϯɺAndroid, RailsͳͲ΋ॻ͍ͯΔ • εϚϒϥ͕޷͖
3. mixi, Inc. Create MLͱ͸ • Mac OS্ͰػցֶशϞσϧΛ࡞੒͓ΑͼτϨʔχϯά͢Δ͜ͱ͕Ͱ͖ΔFramewor k • ੜ੒ͨ͠Ϟσϧ͸Core MLΛ༻͍ͯΞϓϦͰ࢖༻͢Δ͜ͱ͕Ͱ͖Δ
4. mixi, Inc. Create MLΛ࢖ͬͯΦϯσόΠεͰϞσϧͷֶश͕Մೳʹʂ • WWDC 21ͷηογϣϯʮBuild dynamic iOS apps with the Create ML frameworkʯͰ͸ɺࠓ·ͰMac OS্Ͱ ͔͠ಈ͔͢͜ͱ͕Ͱ͖ͳ͔ͬͨCreate ML͕iOSσόΠε্Ͱ΋ར༻ՄೳʹͳΔͱ͍͏Ξφ΢ϯε͕͋Γ·͠ ͨ (΋ͪΖΜiOS15Ҏ߱ͷ࿩)
5. mixi, Inc. iOSσόΠε্Ͱը૾෼ྨثΛֶश͢ΔΞϓϦΛ࡞ͬͯΈͨ💪 https://github.com/rockname/PhotoSelectionClassifier • બ୒͞ΕͨࣸਅΛֶशͯࣸ͠ਅͷબ୒/ඇબ୒Λ෼ྨ͢ΔϞσϧΛ࡞੒͠ɺࣸਅͷࣗಈબ ୒ػೳΛఏڙ͢ΔΞϧόϜΞϓϦΛ࡞ͬͯΈ·ͨ͠
6. mixi, Inc. Demo • ৯΂෺ͷࣸਅͷத͔ΒϋϯόʔΨʔͷࣸਅͷΈΛબ୒ͯ͠ΞϧόϜʹڞ༗͢Δ͜ͱͰɺϞσϧ͕ े෼ʹֶश͞ΕͨΒϋϯόʔΨʔͷࣸਅ͕ࣗಈબ୒͞ΕΔɺͱ͍͏σϞΛߦ͍·͢
7. Ϟσϧͷֶश͔Β࢖༻·ͰͷྲྀΕ♻
8. mixi, Inc. 1. σʔλ͕े෼ʹ͋Δ͔Ͳ͏͔Λ൑ఆ
9. mixi, Inc. 2. બ୒/ඇબ୒ͷࣸਅ਺Λἧ͑Δ
10. mixi, Inc. 3. ը૾σʔλऔಘˠ୹ล300pxʹϦαΠζˠϑΝΠϧग़ྗ
11. mixi, Inc. 4. ෼ྨثͷֶश
12. mixi, Inc. 5. ੜ੒͞ΕͨϞσϧΛίϯύΠϧͯ͠อଘ
13. mixi, Inc. 6. Ϟσϧͷ࢖༻
14. ॾ஫ҙ🙊
15. mixi, Inc. iPhone XҎ߱ͷχϡʔϥϧΤϯδϯΛ౥ࡌͨ͠ ࣮ػͰ͔͠ϏϧυͰ͖ͳ͍ • Create ML͕χϡʔϥϧΤϯδϯΛ׆༻͢Δ౎߹্ɺCreateMLΛimportͨ͠ॠؒʹ SimulatorΛର৅ʹϏϧυͰ͖ͳ͘ͳΓ·͢ • iPhone XҎ߱ͷ ࣮ػΛର৅ʹϏϧυ͢Δඞཁ͕͋Γ·͢ ௥ه(2021/08/13) : χϡʔϥϧΤϯδϯΛ౥ࡌ͍ͯ͠ͳ͍࣮ػͰ΋ϏϧυՄೳͰͨ͠🙇🙇🙇
16. mixi, Inc. Ϟσϧͷֶश͸όοΫάϥ΢ϯυͰ • Ϟσϧͷֶश͸ͦΕͳΓʹ͕͔͔࣌ؒΓɺCPU΋৯͏ͷͰɺΞϓϦ͕όοΫάϥ΢ϯυ ঢ়ଶͷ৔߹ʹߦ͑Δͱྑͦ͞͏Ͱ͢ • ۩ମతʹ͸ Background Tasks Λ࢖ͬͯσόΠε͕Wi f ԼͰॆిதʹͪ·ͪ·ֶशͰ͖ͯ ͍Δͱཧ૝తͰ͢
17. Thank you!!!