仮想世界がつくる未来の話 / Virtual World Creates Future

2020/05/05(火)のCo-KonPILe #4 の発表資料
https://cokonpile.connpass.com/event/174989/

Transcript

1. 仮想世界がつくる未来の話 湯村 翼　@yumu19 国立研究開発法人 情報通信研究機構 湯村 翼　@yumu19 国立研究開発法人 情報通信研究機構 Virtual World Creates Future Co-KoNPILe #4 2020/05/05
2. #cokonpile ࣗݾ঺հ • ౬ଜ ཌྷɹ@yumu19 • ࡳຈग़਎ɺੴ઒ݝຽ • ࠃཱݚڀ։ൃ๏ਓ ৘ใ௨৴ݚڀػߏ ๺཮StarBEDٕज़ηϯλʔ ݚڀһ • ઐ໳ɿωοτϫʔΫɺϢϏΩλείϯϐϡʔςΟϯάɺώϡʔϚϯίϯϐϡʔλΠϯλϥΫγϣϯ etc. • Ӊ஦σʔλϋοΧιϯ NASA SpaceApps Challenge (COVID-19 Challenge 5/30-31) • NTࡳຈ ൃىਓ 2 Ϟϊͮ͘Γܥ ϙουΩϟετ ඼ϞϊϥδΦ
3. #cokonpile NTࡳຈ2019 3 • 2019/12/01(೔) ϥιϥࡳຈ Πϕϯτίʔτ • ͜Ε͕ॳ։࠵ • ໿30૊ͷలࣔ
4. #cokonpile NTࡳຈ2019 4
5. #cokonpile NTࡳຈ2019 5 • NHK๺ւಓ ̙̙̌̓̑̑νϟϯωϧ (5෼൪૊) • ൪૊ͷಈըΞʔΧΠϒ͋Γ·͢ • https://www.nhk.or.jp/sapporo/articles/slug- n5e58c775c839
6. #cokonpile ࠓ೔ͷ಺༰ • Ծ૝ੈքͬͯԿʁ • Ծ૝ੈքͰͷίϛϡχέʔγϣϯπʔϧ • Ծ૝ੈք͕෺ཧੈքʹ΋໾ཱͭ 6
7. #cokonpile Ծ૝ੈքʁ 7 ϚτϦοΫε (1999) 8BSOFS#SPTDPN
   c
   5IF
   .BUSJY
   c
   .PWJFT
   ΑΓ
   IUUQTXXXXBSOFSCSPTDPNNPWJFTNBUSJY ϨσΟɾϓϨΠϠʔ̍ (2018) 8BSOFS#SPTDPN
   c
   3FBEZ
   1MBZFS
   0OF
   c
   .PWJFT
   ΑΓ
   IUUQTXXXXBSOFSCSPTDPNNPWJFTSFBEZQMBZFSPOF ιʔυΞʔτɾΦϯϥΠϯ(2012) 57ΞχϝʮιʔυΞʔτɾΦϯϥΠϯʯΦϑΟγϟϧαΠτ
   ΑΓ
   IUUQTXXXTXPSEBSUPOMJOFOFU
8. #cokonpile xRք۾ͷཤमՊ໨Ϧετ • Ξχϝɾөըɾখઆ͸ڞ௨ݴޠͳͷͰศར 8 https://bit.ly/xr-list
9. #cokonpile ΋͏গ͠਎ۙͳԾ૝ੈք 9 ͋ͭ·Ε Ͳ͏Ϳͭͷ৿ (2020) VR Chat (2014) cluster (2017)
10. #cokonpile ҙ֎ͱੲ͔Β͋ΔԾ૝ੈք • MMORPGͱݺ͹ΕΔδϟϯϧͷήʔϜ΋ଟ਺ • ֓೦తʹ͸ࠓ΋ੲ΋ͦΕ΄ͲมΘΒͳ͍ • ٕज़ͷਐา͕Θ͔ΔɿCGͷࡉ͔͞ɾಈ͖ͷ׈Β͔͞ɾಉ࣌઀ଓ਺ 10 ʮΞϝʔόϐάʯʹ΄͠ͷ͖͋ɺ҆ాඒࠫࢠ͕ొ৔
    
    "NFCB
    /FXTΑΓ
    IUUQTOFXTBNFCBKQFOUSZ Ξϝʔόϐά (2009) Second Life (2003) ΦϒδΣΫτ࡞੒ʹ͍ͭͯ
    ηΧϯυϥΠϑɹ4FDPOE-JGFɿʲΞΠϐϩDPNʳΑΓ
    IUUQXXXBJQJSPDPNDPOUFOUTJOEFYIUN
11. #cokonpile ͋ͭ·ΕͲ͏Ϳͭͷ৿ʢ͋ͭ৿ʣ • ແਓౡͰ஬΍ڕΛั·͑ͨΓՖΛҭͯͨΓ͓ۚΛͨΊ ͯՈ΍෰΍Ո۩Λങ͏ήʔϜ • ΦϯϥΠϯͰϑϨϯζͷౡʹ༡ͼʹߦ͚Δ • ෰ͱֆΛࣗ࡞Ͱ͖Δ • ݁ࠗࣜɾϝΠΧʔΠϕϯτΛ։࠵ͨ͠ྫ΋ 11 ʮ͋ͭ·ΕɹͲ͏Ϳͭͷ৿ʯͰ݁ࠗࣜΛڍ͛·ͨ͠ʛ͘ΒΒʛOPUF
    ΑΓ
    IUUQTOPUFDPNLSGBUPTOOFB झຯ5&$)ࡇ
12. #cokonpile cluster • όʔνϟϧSNSɾόʔνϟϧΠϕϯτۭؒ • https://cluster.mu • ϓϨθϯςʔγϣϯܗࣜͷΠϕϯτ͕։࠵Մೳ • ৗ࣌Φʔϓϯͷʮϫʔϧυʯ͕3݄ެ։ • Windows, Mac, εϚϗ (iPhone / Android), VRσόΠε(oculus / VIVE) ʹରԠ • ແྉʢҰ෦༗ྉΠϕϯτ͋Γʣ • ϦΞΫγϣϯ͕Մೳ 12
13. #cokonpile cluster | όʔνϟϧϜαϏల • ෢ଂ໺ඒज़େֶͷ࡞඼ల • 2020/04/20ʙ30։࠵ʢ࣮͸·ͩ։͍ͯΔʣ • ֆըɾࣸਅɾσβΠϯͳͲͷ੩ࢭըίϯςϯπ͕த৺ • ಈը΋͋Γ 13
14. #cokonpile cluster | ϫʔϧυ੍࡞ • UnityͰ੍࡞Մೳ (Unity༻cluster SDK͕഑෍) • Unity͕ී௨ʹ࢖͑Ε͹؆୯ʹ࡞ΕΔ 14
15. #cokonpile cluster | ϫʔϧυ੍࡞ • THETA(360°Χϝϥ)ͷશఱٿը૾ΛషΓ෇͚Δͱ࣮ࡍͷ ۭؒΛखܰʹ࠶ݱͰ͖Δ 15
16. #cokonpile cluster | ϫʔϧυ੍࡞ • ΞΠςϜઃஔɾอ࣋΋Մೳ 16
17. #cokonpile cluster | Ξόλʔࣗ࡞ • blender౳ͷϞσϦϯάιϑτͰθϩ͔Βࣗ࡞͢Δํ๏ • ࣸਅ͔Β3DϞσϧΛੜ੒͢Δํ๏ • ࠷ۙݚڀ͕ΊͬͪΌਐΜͰΔɺPIFu͍͢͝ʂ • @DMiyamo3 ͞Μͷࢿྉ͕ͱͯ΋Θ͔Γ΍͍͢ • https://docs.google.com/presentation/d/1RUsZVLidcDNzVoK- y8wQG7oNiqjhm-cHcKWMlx23JRI/edit#slide=id.p 17
18. #cokonpile cluster | Ξόλʔࣗ࡞ • ※ 3DϞσϧपΓʹ͸͍ΖΜͳπʔϧ͕͋Δ • ※ 3DϞσϧʹ͸͍ΖΜͳϑΥʔϚοτ͕͋Δ • PIFuͷϞσϧ͔ΒclusterͷΞόλʔ(VRMܗࣜ)Λ࡞Δ৔߹ͷྫ • Meshlab • PIFuͰ࡞ͬͨ3DϞσϧ(.obj)Λplyܗࣜʹม׵ • Blender • ৭ͷඳըํ๏Λ௖఺Χϥʔ͔ΒςΫενϟʹม׵ • ϙϦΰϯ਺࡟ݮ (cluster͸ϙϦΰϯ਺্ݶ32,000) • ϘʔϯͷຒΊࠐΈ • Unity • UniVRMͰVRMܗࣜϞσϧੜ੒ 18
19. Ծ૝ۭ͕ؒ෺ཧੈքʹ΋໾ཱͭʁ
20. #cokonpile ෺ཧੈքͰͷγεςϜ։ൃ͸େม • ྫɿUberͷࣗಈӡసऀͷ૸ߦςετͷͨΊͷڊେίʔε 20 Our Road to Self-Driving Vehicles | Uber ATG https://www.youtube.com/watch?v=27OuOCeZmwI
21. #cokonpile Learning in Simulation • Ծ૝ۭؒ(3DCG)ΛϩϘοτ౳ͷػցֶशσʔλͱͯ͠ ׆༻ 21 Savva et al.(2019), Habitat: A platform for embodied AI research ΑΓ
22. #cokonpile AirSim (Microsoft Research) • ࣗಈӡసंɾυϩʔϯͷػցֶशͷͨΊͷγϛϡϨʔλ • Unreal Engine4 22 Shah et al., AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles (FSR 2017)
23. #cokonpile The SYNTHIA Dataset • CVPR2016 • ඃҾ༻਺ 691 (2020/04/15, Google Scholarௐ΂) • Ծ૝ͷ֗ΛUnity(3DCG)Ͱߏங • ࡱӨͨ͠RGBը૾+ਂ౓+ηάϝϯςʔγϣϯΞϊςʔ γϣϯΛσʔληοτͱͯ͠ެ։ • 13,000ϑϨʔϜ(ϥϯμϜ)+4×50,000ϑϨʔϜ(γʔέϯ γϟϧ) 23
24. #cokonpile γϛϡϨʔγϣϯԾઆ • ʮ͜ͷੈք͸͢΂ͯγϛϡϨʔγϣϯͳͷͰ͸ͳ͍ ͔ʁʯͱ͢ΔԾઆ • ࢠڙͷࠒʹʢେਓʹͳͬͯ΋ʁʣҰ౓͸ߟ͑Δ͜ͱ • Պֶऀɾ఩ֶऀ͕ͨͪٞ࿦͍ͯ͠Δ • Ծ૝ۭؒͰͷίϛϡχέʔγϣϯ͕೔ৗʹͳͬͨΒ ʮ૬ख͸botͰ͸ʯͱ͍͏ٙ೦͸১͑Δͷ͔ʁ 24
25. #cokonpile ·ͱΊ 25 • Ծ૝ੈքΛ࢖ͬͨίϛϡχέʔγϣϯπʔϧ΋গͣͭ͠ਐԽ͍ͯ͠Δ • ແྉͰ࢖͑ΔαʔϏε͕ଟ͍ͷͰ৮ͬͯΈΑ͏ • Ծ૝ੈքɾγϛϡϨʔγϣϯ͕γεςϜ։ൃʹ໾ཱͭʂʢ͔΋ʣ ࣭໰ɺײ૝ɺίϝϯτͳͲ͋Ε͹Twitterʹͯड͚෇͚·͢ @yumu19