空間の中でアイドルとレッスンする技術 - 1st "Vision" / Spatial Lesson technologies with my idol - 1st "Vision"

2024-10-12
セッショントーク
アイマスハッカソン2024 #imas_hack
https://imas.connpass.com/event/328557/

トークは7分くらいからです
https://www.youtube.com/watch?v=_udLT9wXq7U&t=439s

参照先メイン
https://youtu.be/irXgL6I_mSg
https://github.com/banjun/VolumetricChromaKeyPlayer

参照先そのほか
https://github.com/banjun/PhotoStudioPlayer
https://github.com/banjun/GakumasDance
https://github.com/banjun/dayo
https://github.com/banjun/IdolHue
https://github.com/banjun/IdolCharts
https://github.com/banjun/MagicalWonderClock
https://github.com/banjun/AcrylStand
https://youtu.be/WbzmxDQjD04
https://youtu.be/soEs22k4Z9Y
https://youtu.be/YCF5Ebtu9OE
https://youtu.be/o6gfQWFh_gI
https://youtu.be/2v529J1ZtNY
https://youtube.com/shorts/sWzYBCe-tzs?feature=share
https://youtube.com/shorts/q65jPwKFtZI?feature=share
https://youtube.com/shorts/2uGvi5w9nUI?feature=share

Transcript

1. ͹Μ͡ΎΜ🍓 / @banjun ۭؒͷதͰΞΠυϧͱϨοεϯ͢Δٕज़ 1st “Vision”
3. ΞχϝU149Α͔ͬͨ ٦͋Γ͢ͷϑϥελ༻Πϥετඳ͍ͨΓ ΈΜͳͷΧοτύεͭͬͨ͘Γ ͠·ͨ͠
4. ຊ୊
5. 7JTJPO
   1SP͸͍͍ͧ ʜʜͬͯ࿩Λ͠ʹདྷ·ͨ͠
6. Apple Vision Pro ͍ΘΏΔVR,MRͰ͖ΔAppleͷϔουηοτ Ϗδϣϯϓϩͱུ͔ͯ͠AVPͱ͔ݴ͍·͢ 2024೥2݄ʹUSͰൃച͞ΕͨͷͰങ͍ʹ͍͖ͬͯ·ͨ͠
7. σϨες
   <ϏΪχϯάɾεΧΠ>
   ٦͋Γ͢
8. Apple Vision Pro @ Ϋύνʔϊ 2݄ ·͊͜Ε΋ɺ
   ҰछͷΞΠϚεΫͱݴ͑·͢Ͷ
9. ͱΓ͋͑ͣ… im@sparqlͷഎͷॱάϥϑΛ࣮ ෺େͰදࣔ
10. ؼࠃ ͦͯ͠ΊͪΌͪ͘Ό։ൃͨ͠
11. ͦΕ͔Β໿8ϲ݄… ͍Ζ͍Ζ΍͚ͬͨͲɺৄ͍͠࿩͸1ݸϐοΫΞοϓ • ඒ͍͠ΞΫελΛͭ͘ΔΞϓϦ • 10thͷΞΫϦϧΫϩοΫΛ࠶ݱ͢ΔΞϓϦ • ֶϚε360౓ಈըΈΔΞϓϦ • ֶϚεགྷͬͯΈͨ࿅शϛϥʔಈը࠶ੜΞϓϦ • ΠϝʔδΧϥʔΛ3Dදࣔ͢ΔΞϓϦ • ͋Γ͢͵͍Λྔ࢈͢ΔΞϓϦ • ͋Γ͢…͋Γͩ͢Α…ΞϓϦ • ෦԰Ͱ͋Γ͕͢Վͬͯགྷͬͯ͘ΕΔͷͰΘ͕ͨͦ͠Εʹ߹Θͤͯ ϐΞϊΛ஄͚ΔΑ͏ʹ࿅श͢ΔΞϓϦ
12. ෦԰Ͱ͋Γ͕͢Վͬͯགྷͬͯ͘ΕΔͷͰΘ͕ͨͦ͠Εʹ ߹ΘͤͯϐΞϊΛ஄͚ΔΑ͏ʹ࿅श͢ΔΞϓϦ ͜ΜͳΠϝʔδ ಈը͋Γ·͢
13. https://www.youtube.com/watch?v=irXgL6I_mSg https://www.youtube.com/watch?v=irXgL6I_mSg
14. σϞಈըࣗମͷղઆ ෦԰ͱϐΞϊ͸࣮෺ͷύεεϧʔ ϫΠϓ߹੒ͷ
    ͨΊͷ
    ࿥ըJ1IPOF ͔Θ͍͍ ͚ͩ͜͜
    ϫΠϓ߹੒ ΞΫελͷ
    ΞϓϦ΋࡞ͬͨ Θͨ͠ͷࢹքͷΩϟϓνϟ ΞϓϦͰΫϩϚΩʔ࠶ੜ͍ͯ͠Δ
    ٦͋Γ͢ͷಈը Վ੠΋͔͜͜Βௌ͑͜Δ
15. ߏ੒ཁૉͱٕज़ • σϨεςϑΥτελδΦͷϒϧʔόοΫͷಈըΛ࿥ը • ָثΛফͯ͠Ի੠ͷΈൈ͖ग़͠ • ΞϓϦͰ141cmͷαΠζͷ΢Πϯυ΢Λ࡞ͬͯಈըදࣔ • ಈը࠶ੜ࣌ʹΫϩϚΩʔॲཧͯ͠എܠΛফ͢ • ࠶ੜʹ߹ΘͤͯϐΞϊΛ஄͘
16. ߏ੒ཁૉͱٕज़ • σϨεςϑΥτελδΦͷϒϧʔόοΫͷಈ ըΛ࿥ը • ಈը࠶ੜ࣌ʹΫϩϚΩʔॲཧͯ͠എܠΛফ͢ https://github.com/banjun/PhotoStudioPlayer https://speakerdeck.com/banjun/photostudioplayer-technologies ͜͜͸1IPUP4UVEJP1MBZFSͷٕज़͕స༻Մೳʂ ˞࿥ը͕ඞཁͰɺϦΞλΠྲྀ͠ࠐΈ͸·ͩग़དྷͳ͍ ΫϩϚΩʔ
17. ߏ੒ཁૉͱٕज़ • σϨεςϑΥτελδΦ ͷϒϧʔόοΫͷಈըΛ ࿥ը • ಈը࠶ੜ࣌ʹΫϩϚΩʔ ॲཧͯ͠എܠΛফ͢ https://www.youtube.com/shorts/2uGvi5w9nUI https://www.youtube.com/shorts/2uGvi5w9nUI ΫϩϚΩʔʢ̎̌̍̓ʣ
18. ߏ੒ཁૉͱٕज़ • 2008 ΫϩϚΩʔʢ̎̌̌̔ʣ https://speakerdeck.com/banjun/photostudioplayer-technologies
19. ߏ੒ཁૉͱٕज़ • ָثΛফͯ͠Ի੠ͷΈൈ͖ग़͠ • Logic Pro 11ͷStem SplitterͰ Ի੠Ҏ֎Λফ͢ • ͜Ε΋ϦΞλΠॲཧͰ͖ͯͳ͍ ཁૉ https://www.apple.com/jp/newsroom/2024/05/logic-pro-takes-music-making-to-the-next-level-with-new-ai-features/ ΞΧϖϥԽ
20. ߏ੒ཁૉͱٕज़ https://www.apple.com/jp/newsroom/2024/05/logic-pro-takes-music-making-to-the-next-level-with-new-ai-features/ ΞΧϖϥԽ • ָثΛফͯ͠Ի੠ͷΈൈ͖ग़͠ • Logic Pro 11ͷStem SplitterͰ Ի੠Ҏ֎Λফ͢ • ͜Ε΋ϦΞλΠॲཧͰ͖ͯͳ͍ ཁૉ
21. ߏ੒ཁૉͱٕज़ let idolHeight: CGFloat = 141 let heightMargin: CGFloat = 8 PlayerView().frame( width: physicalMetrics.convert(width, from: .centimeters), height: physicalMetrics.convert(idolHeight + heightMargin, from: .centimeters)) ਎௕DNΛQUʹม׵ͯ͠
    WPMVNFUSJD
    XJOEPXʹஔ͘ https://www.youtube.com/watch?v=WbzmxDQjD04 https://www.youtube.com/watch?v=WbzmxDQjD04 ౳਎େදࣔ
22. ߏ੒ཁૉͱٕज़ 8JOEPX͔Β໐ΔԻ͸ۭؒΦʔσΟΦͳͷͰʜ ۭؒతʹ͔ͦ͜Βௌ͑͜Δ
    ˞Πϝʔδਤ Իָͷ࠶ੜͰ͸ͳ͘ɺͦ͜ͰՎͬͯ΋Β͏
23. ߏ੒ཁૉͱٕज़ ϐΞϊΛ஄͘ • ຖ೔࿅श͕Μ͹Γ·͠ΐ͏
24. ະདྷͷ՝୊ • U149ͷαϯτϥʹ͍ͭͯΔVocal LessonόʔδϣϯͷԻ΋࢖͍͍ͨ • ͦ΋ͦ΋ͦͷόʔδϣϯͷේ໘Λىͯ͜͠஄͘࿅श͢Δ • ϐΞϊ஄͍ͯΔҐஔʹ࠶ੜΛ߹Θ͍ͤͨ • ԋ૗ٕज़Ͱ͕Μ͹Εͱ͍͏࿦ഁ΋͍͍Ͱ͚͢Ͳ
 • AVP͸ϚΠΫೖྗ΋Bluetooth MIDIೖྗ΋Ͱ͖Δ • ࿥ըΛෆཁʹͯ͠ϦΞλΠॲཧ͍ͨ͠…ϫΠϠϨεͰ៉ྷʹΩϟϓνϟ͢Δٕ ज़͕ඞཁ
25. 🍓 50%0
    ͜͜Ͱ࢒Γ࣌ؒΛ֬ೝ͢Δ
26. ͦͷ΄͔ ࣌ؒ͋Ε͹͠Ό΂Γ·͢
    ͳ͚Ε͹ݸผʹฉ͍͍ͯͩ͘͞
27. ʲֶϚεʳ #ੈքҰՄѪ͍ࢲ #གྷͬͯΈͨ #AppleVisionPro Վͱμϯε্͕ख͘ͳΔΞΠυϧҭ੒γϛϡ ϨʔγϣϯήʔϜ
    ֶԂΞΠυϧϚελʔ
    ΑΓ
    ౻ా͜ͱͶʮੈքҰՄѪ͍ࢲʯΛ7JTJPO
    1SPͭ ͚ͯགྷͬͯΈ·ͨ͠ɻ্ͷө૾͸7JTJPO
    1SP಺ ͰΈ͍͑ͯΔө૾Ͱ͢ɻ 7JTJPO
    1SP
    གྷͬͯΈͨ
    ͰݕࡧͰ͖Δɺ
    ੈքͰҰ൪࠷ॳͷ:PV5VCFಈը
    ͨͿΜ
28. https://www.youtube.com/shorts/sWzYBCe-tzs https://www.youtube.com/shorts/sWzYBCe-tzs
30. ౓എܠ
    ΞΠυϧϚελʔνϟϯωϧ
    IUUQTXXXZPVUVCFDPNXBUDI WSSEG6&5#T
    
    ʲֶϚεʳʮੈքҰՄѪ͍ࢲʯϨοεϯಈըʢ4IPSU
    7FSʣ౻ా͜ͱͶʲΞΠυϧϚελʔʳ
    IUUQTXXXZPVUVCFDPNTIPSUTK$2:V#T
    
31. ͋Γ͢……͋Γͩ͢Α……! 7JTJPO
    1SPͰWJTJPO04
    ͷखͷΞϯΧʔͷ༧ଌ ஋Λ͔ͭͬͯɺ׈Β͔ʹखͷͻΒʹ௥ैͤ͞Δ ͜ͱ͕ग़དྷ·͢ɻ͵͍͸0CKFDU
    $BQUVSFͰε Ωϟϯ͠·ͨ͠ɻ͜ΕͰ͍ͭͰ΋͋Γ͢ʹ೚ҙ ͷ"·ͨ͸೚ҙͷ#ΛݟͤΔ͜ͱ͕Ͱ͖·͢ɻ
    IUUQTHJUIVCDPNCBOKVOEBZP
32. https://www.youtube.com/shorts/q65jPwKFtZI https://www.youtube.com/shorts/q65jPwKFtZI
33. im@sparqlͷՄࢹԽ΍Δ
34. https://www.youtube.com/watch?v=soEs22k4Z9Y https://www.youtube.com/watch?v=soEs22k4Z9Y
35. https://www.youtube.com/watch?v=YCF5Ebtu9OE https://www.youtube.com/watch?v=YCF5Ebtu9OE
36. 10thΞΫϦϧΫϩοΫͭ͘Δ
37. https://www.youtube.com/watch?v=o6gfQWFh_gI https://www.youtube.com/watch?v=o6gfQWFh_gI
38. ΞΫϦϧελϯυͭ͘Δ
39. https://www.youtube.com/watch?v=2v529J1ZtNY https://www.youtube.com/watch?v=2v529J1ZtNY
40. 🍓 ͓͠·͍