Share
Embed
Transcript
109 slides
-
IUUQTXXXVOSFBMFOHJOFDPNKBCMPHXFMDPNFUPVOSFBMFOHJOF GGXΛඪ४γΣʔμͱ͢ΔUnreal Engine 4͕ϦϦʔε͞ΕΔ ࣍ʹϏσΦήʔϜ࢈ۀʹ·Δٕज़ಡΊΔ GGXʹؔ͢Δ࠷ॳͷจ Bruce Walter, Stephen R.
Marschner, Hongsong Li, and Kenneth E. Torrance. 2007. Microfacet models for refraction through rough surfaces. In Proceedings of the 18th Eurographics conference on Rendering Techniques (EGSR'07), Jan Kautz and Sumanta Pattanaik (Eds.). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 195-206. DOI=http:// dx.doi.org/10.2312/EGWR/EGSR07/195-206 2007 Stephen McAuley, Stephen Hill, Naty Hoffman, Yoshiharu Gotanda, Brian Smits, Brent Burley, and Adam Martinez. 2012. Practical physically-based shading in film and game production. In ACM SIGGRAPH 2012 Courses (SIGGRAPH '12). ACM, New York, NY, USA, Article 10, 7 pages. DOI: https://doi.org/10.1145/2343483.2343493 σΟεχʔ͕GGXΛ͍ͬͯΔࣄΛެද 2012 2014 Unity͕ඪ४γΣʔμΛGGXʹมߋ IUUQTVOJUZEDPNKQVOJUZXIBUTOFXVOJUZ 2015 -
Coins $ - 7 gold pieces ---------- ------------ Armor #-........|
##...........+####### ---------- a - an uncursed +2 pair of leather gloves (being worn) |.........#####|.....)....| #####|........| b - an uncursed +1 robe (being worn) .........| ####...........-# #|........| Comestibles |........| # ------------# #|<.......| g - 3 uncursed food rations |........| # # #-........- h - 6 uncursed apples ----------## # #|........| i - 8 uncursed oranges #### # #---------- j - 4 uncursed fortune cookies # # ########### l - a food ration # # # # m - 2 jackal corpses ####### # # p - a kobold corpse ## ## ## Scrolls -------# # # d - an uncursed scroll of identify |[email protected]# # ## n - a scroll labeled ZLORFIK |...>.|# #------------# Spellbooks |.....| #|..........|# c - a blessed spellbook of protection |...... #...........-# Potions |.....| |..........| e - 2 uncursed potions of healing ------- --------|--- f - a blessed potion of healing # Tools Foo the Candidate St:15 Dx:14 Co:12 In:9 Wi:1 k - a magic marker (0:43) Dlvl:1 $:7 HP:14(14) Pw:5(5) AC:4 Xp:1 Stressed Gems/Stones o - 6 rocks (end) େ͖ͳΛখ͘͞࡞Δʹ ࣗಈੜ ॳ಄ʹطʹ μϯδϣϯΛࣗಈੜ͢ΔήʔϜ͕࡞ΒΕ͍ͯͨ -
? ԿΒ͔ͷϧʔϧ ͜͏͍͏࣌ ͜͏ͳͬͯཉ͍͠ ط ط ະ ͍͔ͭ͘ͷࣄྫ͔Β ͦͷഎޙʹ͋Δϧʔϧ͕ԿͰ͋Δ͔Λߟ͑ΔʹͳΔ ࣗಈੜԿͰϥϯμϜʹੜ͢Εྑ͍Θ͚Ͱͳ͘
ଟ͘ͷ߹͜Μͳ෩ʹੜ͍ͨ͠ͱ͍͏ඪ͕͋Δ -
͖݅ఢରతੜωοτϫʔΫΛ༻͍ͨ ຊΒ͍͠ܗͷੜ Éric Guérin, Julie Digne, Éric Galin, Adrien Peytavie,
Christian Wolf, Bedrich Benes, and Benoît Martinez. 2017. Interactive example-based terrain authoring with conditional generative adversarial networks. ACM Trans. Graph. 36, 6, Article 228 (November 2017), 13 pages. DOI: https://doi.org/10.1145/3130800.3130804 Ͱඳ͔Εͨεέον͔Βੜ͞Εͨܗ -
ܗࣜχϡʔϩϯ ೖྗ1 ೖྗ2 ೖྗ3 ೖྗ4 ೖྗ5 w1 w2 w3 w4
w5 શͯͷೖྗʹ͋ΔॏΈwΛ ͔͚ͨͷͷΛٻΊͯ ͜ΕΛແʹܨ͛ͨͷ ॏΈ࣍ୈͰ ҙͷؔΛۙࣅͰ͖Δ ReLU ग़ྗ ׆ੑԽؔ(ReLU) ʹ௨ͨ͠Λग़ྗ Formal Neuron -
w0k w1k w2k w3k w4k yk x0 x1 x2 x3
x4 yk = R (∑ n wnk xn) YͱX͕͔͍ͬͯͯZΛٻΊΔํ๏ ∂E ∂wjk = ∂E ∂xk R′ k (∑ n wnk xn) xj XͷมԽ͕ଛࣦؔʹ༩͑ΔӨڹXʹΑΔภඍ R′ k3F-6ΛLʹ͍ͭͯඍͨ͠ͷ R׆ੑԽؔ3F-6 -
∂E ∂wij = ∑ k ∂E ∂xk R′ k (∑
n wnk xn) wjk R′ j (∑ n wnj xn) xi i j k ࠷ޙ͔Βͷภඍ ߹ؔͷඍΛͬͯٻΊΔ ઌ΄ͲٻΊͨ࠷ޙͷͷภඍͷΛ͑Δ ࿈ Chain Rule -
ଛࣦؔͷΛখ͍ͨ͘͞͠ ଛࣦ͕ؔࢁͩͱ͢Δͱ Ұ൪͍ॴʹߦ͖͍ͨ ͨͩ͠ࢁશମͷܗΘ͔Βͳ͍ Xʹ͍ͭͯͷภඍ ࠓཱ͍ͬͯΔॴͷ ࣼ ࣼʹԊͬͯ ΑΓ͍ํҠಈ͍͚ͯ͠ Ұ൪͍ͱ͜ΖʹͨͲΓண͚Δؾ͕͢Δ
ֶश Training ภඍͷ݁ՌʹԊͬͯXΛগ͠ಈ͔ͤ ඪͱ͢Δؔʹগۙͮ͘͠ؾ͕͢Δ -
∂E ∂wij = ∑ k ∂E ∂xk R′ k (∑
n wnk xn) wjk R′ j (∑ n wnj xn) xi ஈḪΔຖʹ׆ੑԽؔͷඍֻ͕͔Δ ͜ͷ͕খ͍͞ͱ্ͷ·ͰXͷमਖ਼͕ಧ͔ͳ͍ ReLU ReLUͷඍ ඍ͕ͯ͠খ͘͞ͳΒͳ͍ ׆ੑԽؔ3F-6ͷൃݟʹΑΓ ͍ωοτϫʔΫ͕࣮༻తʹͳͬͨ σΟʔϓϥʔχϯά Deep Learning -
w13 w23 w33 w43 w53 y3 x1 x2 x3 x4
x5 w93 ʜ ͷΑ͏ͳԕ͘ͷϐΫηϧͱͷଓ ແବʹͳΔՄೳੑ͕ߴ͍ w93 -
ը૾ͷہॴతͳಛ ը૾ʹϑΟϧλΛద༻͢ΔࣄͰऔΓग़ͤΔ
× ྫΤοδݕग़ -
ຊͬΆ͍ܗ࡞Δ ຊͷܗ ੜͨ͠ܗ ܗ͕ຊ͔ผ͢Δ͠ผʹࣦഊͨ͠ͳΒ ੜͨ͠ܗ ຊΒ͍͠ܗͰ͋Δ ఢରతੜωοτϫʔΫ Generative Adversarial Network
I. J. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. C. Courville, and Y. Bengio. Generative adversarial nets. In Proceedings of NIPS, pages 2672– 2680, 2014. papers.nips.cc/paper/5423- generativeadversarial-nets.pdf. -
ఢରతੜωοτϫʔΫ Generative Adversarial Network ຊͬΆ͍ܗ࡞Δ ܗ͕ຊ͔ผ͢Δ ຊͷܗ ੜͨ͠ܗ ͠ผʹࣦഊͨ͠ͳΒ ੜͨ͠ܗ
ຊΒ͍͠ܗͰ͋Δ ্ԼͷωοτϫʔΫͷXΛަޓʹमਖ਼͢Δ ্ͷωοτϫʔΫͷXΛमਖ਼͢ΔࡍʹԼͷωοτϫʔΫݻఆ ԼͷωοτϫʔΫ͕ ΑΓผͰ͖ͳ͍ܗ͕ੜ͞ΕΔΑ͏ʹमਖ਼Λߦ͏ -
ຊͬΆ͍ܗ࡞Δ ܗ͕ຊ͔ผ͢Δ ຊͷܗ ੜͨ͠ܗ ͠ผʹࣦഊͨ͠ͳΒ ੜͨ͠ܗ ຊΒ͍͠ܗͰ͋Δ ԼͷωοτϫʔΫͷXΛमਖ਼͢Δࡍʹ্ͷωοτϫʔΫݻఆ ຊͷܗͱ্ͷωοτϫʔΫ͕ੜͨ͠ͷΛ ΑΓਖ਼ࣝ͘͠ผͰ͖ΔΑ͏ʹमਖ਼Λߦ͏
ఢରతੜωοτϫʔΫ Generative Adversarial Network -
͖݅ఢରతੜωοτϫʔΫΛ༻͍ͨ ຊΒ͍͠ܗͷੜ Éric Guérin, Julie Digne, Éric Galin, Adrien Peytavie,
Christian Wolf, Bedrich Benes, and Benoît Martinez. 2017. Interactive example-based terrain authoring with conditional generative adversarial networks. ACM Trans. Graph. 36, 6, Article 228 (November 2017), 13 pages. DOI: https://doi.org/10.1145/3130800.3130804 Ͱඳ͔Εͨεέον͔Βੜ͞Εͨܗ -
("/Λͬͨ%00.ͷεςʔδͷੜ (JBDPNFMMP &EPBSEPFUBMl%00.-FWFM(FOFSBUJPO6TJOH(FOFSBUJWF "EWFSTBSJBM/FUXPSLTz*&&&(BNFT &OUFSUBJONFOU .FEJB$POGFSFODF (&.
("/Ͱ ࣮ࡍͷ%ήʔϜͷεςʔδΛ ຊΒ͘͠ ੜͨ͠ࣄྫ ιʔείʔυ https://github.com/DanieleLoiacono/DoomGAN จ https://arxiv.org/abs/1804.09154 -
$ZDMF("/ΛԠ༻ͨ͠υοτֆͷੜ Chu Han, Qiang Wen, Shengfeng He, Qianshu Zhu, Yinjie
Tan, Guoqiang Han, and Tien- Tsin Wong. 2018. Deep unsupervised pixelization. In SIGGRAPH Asia 2018 Technical Papers (SIGGRAPH Asia '18). ACM, New York, NY, USA, Article 243, 11 pages. DOI: https://doi.org/10.1145/3272127.3275082 http://www.shengfenghe.com/deep- unsupervised-pixelization.html ࣸਅΠϥετΛ ಥͬࠐΜͩΒ υοτֆʹͳͬͯग़ͯ͘Δ ͨͩॖখ͢ΔͷͰͳ͘ ಛΛ͖ͬ͘Γͯ͠ ϑϥοτͳ৭͍ʹͳΔ ͜Ε ਓ͕ඳ͍ͨ߹ -
$ZDMF("/ "Λ#ʹม ຊͷ#ͱࠨͷੜΛࣝผ #Λ"ʹม ຊͷ"ͱӈͷੜΛࣝผ A B ຊͷ#ͱੜΛ ࣝผͰ͖ͳ͍ఔྑ͍ ຊͷ"ͱੜΛ
ࣝผͰ͖ͳ͍ఔྑ͍ #ˠ"ˠ#Ͱ ݩͱಉ͡ʹͳΔఔྑ͍ "ˠ#ˠ"Ͱ ݩͱಉ͡ʹͳΔఔྑ͍ Jun-Yan Zhu*, Taesung Park*, Phillip Isola, and Alexei A. Efros. "Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks", in IEEE International Conference on Computer Vision (ICCV), 2017. (* indicates equal contributions) -
$ZDMF("/ "Λ#ʹม ຊͷ#ͱࠨͷੜΛࣝผ #Λ"ʹม ຊͷ"ͱӈͷੜΛࣝผ A B #ˠ"ˠ#Ͱ ݩͱಉ͡ʹͳΔఔྑ͍ ຊͷ#ͱੜΛ
ࣝผͰ͖ͳ͍ఔྑ͍ ຊͷ"ͱੜΛ ࣝผͰ͖ͳ͍ఔྑ͍ "ˠ#ˠ"Ͱ ݩͱಉ͡ʹͳΔఔྑ͍ ຊͷ"ͱຊͷ#ରͰରԠ͍ͯ͠Δඞཁͳ͍ "ͷྫͱ#ͷྫ͕ࢁ͋Εํͷม͕ಘΒΕΔ -
υοτֆͷੜ ֦େ ຊͷ"ͱӈͷੜΛࣝผ A B ֦େˠॖখˠλονͰ ݩͱಉ͡ʹͳΔఔྑ͍ ॖখˠλονˠ֦େͰ ݩͱಉ͡ʹͳΔఔྑ͍ ࣸਅΠϥετ
υοτֆ ݩͷ৭ͱڥքΛ อ͍ͯͯΔఔྑ͍ ॖখ υοτֆͬΆ͍ λονʹ͢Δ ຊͷυοτֆͱੜΛࣝผ͢Δ ຊͱੜΛ ࣝผͰ͖ͳ͍ఔྑ͍ ਅٯͷૢ࡞ʹ ͳ͍ͬͯΔఔྑ͍ http://www.shengfenghe.com/pixelization.html ͜͜ʹੜྫ͕ࢁ͋Δ -
("/ΛࢁΈ߹Θͤͨ ࢢͷσΟςΟʔϧͷੜ Tom Kelly, Paul Guerrero, Anthony Steed, Peter Wonka,
and Niloy J. Mitra. 2018. FrankenGAN: guided detail synthesis for building mass models using style-synchonized GANs. In SIGGRAPH Asia 2018 Technical Papers (SIGGRAPH Asia '18). ACM, New York, NY, USA, Article 216, 14 pages. DOI: https://doi.org/10.1145/3272127.3275065 ೖྗ ग़ྗ http://geometry.cs.ucl.ac.uk/projects/2018/frankengan/ -
ཚ͔Β"Λੜ A' A ຊͱੜΛ ࣝผͰ͖ͳ͍ఔྑ͍ Z ຊͷ"ͱੜ͞Εͨ"Λࣝผ *OGP("/ C ఢରతੜωοτϫʔΫ
C' ࣅ͍ͯΔఔྑ͍ $͕"ͷॏཁͳಛʹ͍ؔͯ͠ΔͳΒ $ ; ˠ"ˠ$Ͱݩͷ$ʹΕΔഺ ΦʔτΤϯίʔμ $͕"ͷಛΛίϯτϩʔϧ͢Δ ύϥϝʔλʹͳΔ "͔Β$Λ෮ݩ X. Chen, Y. Duan, R. Houthooft, J. Schulman, I. Sutskever, and P. Abbeel. Infogan: interpretable representation learning by information maximizing generative adversarial nets. In NIPS, 2016. -
ཚΛແࢹͯ͠Λੜ ຊͱੜΛ ࣝผͰ͖ͳ͍ఔྑ͍ Z ΛࣝผͰ͖ͳ͍ Ϟʔυ่յ ࣝผث͕ ݟ͚ΒΕͳ͍ͳΒ ͳΜͰྑ͍ ೖྗͷཚ;Λແࢹͯ͠
ৗʹಉ͡Α͏ͳσʔλΛੜ͢Δ ωοτϫʔΫ͕ग़དྷ্͕Δࣄ͕͋Δ Mode Collapse -
;͔Β"Λੜ A' A ຊͱੜΛ ࣝผͰ͖ͳ͍ఔྑ͍ ຊͷ"ͱੜ͞Εͨ"Λࣝผ 7"&("/ ఢରతੜωοτϫʔΫ ΦʔτΤϯίʔμ ࣅ͍ͯΔఔྑ͍
ੜث͕;Λ͍ͬͯΔͳΒ "ˠ;ˠ"Ͱݩͷ"ʹΕΔഺ Ϟʔυ่յΛى͜͢ͱ ΦʔτΤϯίʔμଆͷଛࣦ͕૿͑Δ "ͷॏཁͳಛΛؚΉ;Λ࡞Δ Rosca, Mihaela & Lakshminarayanan, Balaji & Warde-Farley, David & Mohamed, Shakir. (2017). Variational Approaches for Auto- Encoding Generative Adversarial Networks. Z -
Z A' A ຊͱੜΛ ࣝผͰ͖ͳ͍ఔྑ͍ #JDZDMF("/ C' C Jun-Yan Zhu,
Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A. Efros, Oliver Wang: “Toward Multimodal Image-to-Image Translation”, 2017; arXiv:1711.11586 ࣅ͍ͯΔఔྑ͍ ࣅ͍ͯΔఔྑ͍ D("/Ͱ݅Λࢦఆ *OGP("/͕ ੜͷόϦΤʔγϣϯΛ࡞Γ 7"&("/͕Ϟʔυ่յΛ͙ -
্͔Βݟͨ ܗঢ় େࡶͳ ݐͷܗ ࣮ࡍͷ นͷը૾ ࣮ࡍͷ ࠜͷը૾ ૭ͷஔͷநग़ Ԏಥͷஔͷநग़
ԣ͔Β ݟͨܗঢ় ࠜͷԜತ ࠜͷ༷ ૭ͷஔ นͷ༷ นͷԜತ ߴղ૾ͳ ࠜͷ༷ ߴղ૾ͳ ૭ͷ༷ ૭ͷܗঢ় ߴղ૾ͳ นͷ༷ ࠜͷԜತ นͷԜತ ৄࡉͳ ݐͷ ܗͱ༷ FrankenGAN -
2ֶश Q Learning ͋Δঢ়ଶ͔Β͋ΔߦಈΛߦͳͬͨ߹ͷՁͷද
ঢ়ଶ ߦಈ Ձ ʜ ঢ়ଶߦಈͷ͕ଟ͍Ͱ ͜ͷදେ͖͘ͳΓ͗ͯ͢هԱͰ͖ͳ͍ -
/FVSBM'JUUFE2*UFSBUJPO ͦͷߦಈʹ ͜Ε͚ͩͷ Ձ͕͋Δ શͯͷߦಈͷՁΛهԱ͓ͯ͘͠ΘΓʹ ͋Δঢ়ଶ͔Β֤ߦಈΛߦͳͬͨ߹ͷՁΛਪఆ͢Δ χϡʔϥϧωοτϫʔΫͷֶशΛߦ͏ ࠓ͜͏͍͏ঢ়ଶͰ ͜͏͍͏ߦಈΛ ͨ͠߹
Riedmiller, Martin. Neural fitted Q iteration–first experiences with a data efficient neural reinforcement learning method. In: European Conference on Machine Learning. Springer, Berlin, Heidelberg, 2005. p. 317-328. -
ਪఆ ࣮ࡍ ਪఆ ࣮ࡍ ਪఆ ࣮ࡍ ਪఆ ࣮ࡍ Ձ ʹḷΓண͚ͨ
ͰߦಈͷՁ ͷ༧ͱҧͬͨ ࠓ"ͷঢ়ଶ ͜͏͍͏ଛࣦؔͰֶशΛߦ͏ ʹߦ͘ͱ͘Β͍ͷྑ͞ ͷྑ͞Ͳ͜ΖͰͳ͔ͬͨ ࣮ࡍͱͷ ޡࠩ " -
ਪఆ ࣮ࡍ ਪఆ ࣮ࡍ ਪఆ ࣮ࡍ Ձ ʹḷΓண͚ͳ͍߹ಉ༷ Ձ ʹߦ͘ͷ͕ߴՁ
ʹߦ͘ͷྑ͘ͳ͍ ࣮ࡍͱͷ ޡࠩ -
Q(st , at ) ← Q(st , at ) +
α (R(st , at ) + γmax (Q(st+1 , at+1 )) − Q(st , at )) XΛগ͠मਖ਼͢Δࡍͷগ͠۩߹ ࠓͷߦಈͰಘΒΕΔใु ݩʹ͕͋ΕͦͷՁ मਖ਼લͷχϡʔϥϧωοτϫʔΫ͕ਪఆͨ͠ ࣍ͷߦಈΛߦͳͬͯભҠͨ͠ઌͷߦಈͷՁ मਖ਼લͷχϡʔϥϧωοτϫʔΫ͕ਪఆͨ͠ ࠓͷߦಈͷՁ ͜Εͱ͜ΕͷࠩΛখ͘͢͞ΔΑ͏ʹXΛमਖ਼͢Δ -
Q(st , at ) ← Q(st , at ) +
α (R(st , at ) + γmax (Q(st+1 , at+1 )) − Q(st , at )) ޡࠩΛܭࢉ͢ΔաఔʹχϡʔϥϧωοτϫʔΫͷग़ྗ͕ඞཁ ֶशதXΛαϯϓϧຖʹมߋ͍ͯ͠Δҝ͜ͷ͕҆ఆ͠ͳ͍ ਪఆͨ͠Ձ͕ ٻΊͨՁʹ͍ۙ΄Ͳྑ͍ ࣌ʑίϐʔ Xͷमਖ਼͕Ձͷਪఆʹ ͙ʹө͞Εͳ͍Α͏ʹͯ͠ ଛࣦؔΛ҆ఆͤ͞Δ ਂ2ωοτϫʔΫ Deep Q Network Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013. -
Vlad Firoiu, William F. Whitney, Joshua B. Tenenbaum Beating the
World's Best at Super Smash Bros. with Deep Reinforcement Learning. arXiv preprint arXiv:1702.06230, 2017. ਂQωοτϫʔΫΛ༻͍ͨ େཚಆεϚογϡϒϥβʔζDXͷAIͷ࡞ https://youtu.be/dXJUlqBsZtE ڧԽֶश ϑΝϧίϯ ϓϩήʔϚʔ ϑΝϧίϯ "*͕ϓϩͱઓͬͯউͬͨࣄΛใ͡Δهࣄ https://www.businessinsider.com/super-smash-bros- pro-slox-mafia-artificial-intelligence-2017-2 -
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou,
Daan Wierstra, Martin Riedmiller Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013. Atari 2600ͷը໘Λೖྗͱͯ͠ దͳߦಈΛબ͢ΔڧԽֶश -
Guillaume Lample, Devendra Singh Chaplot Playing FPS Games with Deep
Reinforcement Learning. In: AAAI. 2017. p. 2140-2146. ը໘Λೖྗͱͯ͠ DOOMΛ߈ུ͢ΔڧԽֶश https://github.com/fhennecker/deepdoom https://youtu.be/L_9F9bO3-mI จͷஶऀʹΑΔσϞ ஶऀͱผͷਓʹΑΔ࣮ -
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou,
Daan Wierstra, Martin Riedmiller Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013. ը໘͔Β͙͢ʹ͖࣍͢ࣄ͕Θ͔ΔήʔϜͰ ڧԽֶशͷείΞਓؒͷείΞΛ͑Δ ظతͳઓུΛཁ͢ΔήʔϜͰਓ͕ؒѹউ͢Δ -
Daniel Holden, Taku Komura, and Jun Saito. 2017. Phase-functioned neural
networks for character control. ACM Trans. Graph. 36, 4, Article 42 (July 2017), 13 pages. DOI: https:// doi.org/10.1145/3072959.3073663 http://theorangeduck.com/page/phase-functioned-neural-networks-character-control ϞʔγϣϯΩϟϓνϟͱܗͷϖΞͰ χϡʔϥϧωοτϫʔΫͷֶशΛߦ͍ ༩͑ΒΕͨܗΛࣗવʹา͘ಈ͖Λ ੜ͢Δ ܗ ܗʹԊͬͨ า͖ํ -
࣍ʹલʹग़͖͕͢पظతʹʹมԽ͍ͯ͠Δ + + = = ಉ͡ܗͰ λΠϛϯάʹΑͬͯ దͳಈ͖ํมΘΔ w(0) w(1)
w(2) w(3) पظతʹΓସΘΔͭͷXΛ࣋ͭωοτϫʔΫͰਪఆ 1IBTF'VODUJPOFE/FVSBM/FUXPSL -
= = λΠϛϯάʹΑͬͯ దͳಈ͖ํมΘΔ w(0) w(1) w(2) w(3) पظతʹΓସΘΔͭͷXΛ࣋ͭωοτϫʔΫͰਪఆ ेͳྔͷֶशσʔλΛूΊΔͨΊʹ
࣮ࡍʹ༷ʑͳܗΛ࣌ؒʹΘͨͬͯา͖ճͬͨ߹ͷಈ͖Λ ϞʔγϣϯΩϟϓνϟͰूΊΔ ͏ͪΐͬͱָͰ͖ͳ͍͔ -
ڧԽֶशʹΑΔาߦϞʔγϣϯͷੜ Xue Bin Peng, Glen Berseth, Kangkang Yin, and Michiel
Van De Panne. 2017. DeepLoco: dynamic locomotion skills using hierarchical deep reinforcement learning. ACM Trans. Graph. 36, 4, Article 41 (July 2017), 13 pages. DOI: https://doi.org/ 10.1145/3072959.3073602 https://www.cs.ubc.ca/~van/papers/2017-TOG-deepLoco/ -
ʮา͘ҝͷͷಈ͔͠ํ͕ະͷঢ়ଶ͔Βඪ·Ͱา͚ͨΒใुʯ ͜Εใु͕ԕ্͗ͯ͢ख͍͔͘ͳ͍ ? ? ? 2ֶशใुΛۮવൃݟ͢Δ·Ͱ ϥϯμϜͳࢼߦ͔͠ग़དྷͳ͍ ਪఆ ਪఆ ใुΰʔϧ͚ͩͰͳ͘
ͦ͜·ͰͷಓఔΛ༠ಋ͢ΔΑ͏ʹ ஔ͞Ε͍ͯΔඞཁ͕͋Δ ? -
ݱࡏ ܗ ඪ ࢟ ԿॲΛ౿Ή͔ ࣍ͷҰาͷҝʹͲ͏ಈ͔͘ ࣍ͷҰาΛ ࢦఆ͞ΕͨҐஔͰ౿ΊͨΒ ใु ඪҐஔ·Ͱ
า͘͜ͱ͕Ͱ͖ͨΒ ใु ҰาΛਖ਼͘͠า͘͜ͱΛֶश͢ΔڧԽֶशͱ ඪ·ͰͲͷΑ͏ͳܦ࿏Ͱา͔͘Λֶश͢ΔڧԽֶशΛ Έ߹ΘͤΔ͜ͱͰ ඪ·Ͱา͘ҝͷಈ͖ํΛशಘͤ͞Δ ඵʹճ ඵʹճ -
ڧԽֶशʹΑΔө૾͔Βͷಈ͖ͷशಘ Xue Bin Peng, Angjoo Kanazawa, Jitendra Malik, Pieter Abbeel,
and Sergey Levine. 2018. SFV: reinforcement learning of physical skills from videos. In SIGGRAPH Asia 2018 Technical Papers (SIGGRAPH Asia '18). ACM, New York, NY, USA, Article 178, 14 pages. DOI: https://doi.org/10.1145/3272127.3275014 -
Xue Bin Peng, Angjoo Kanazawa, Jitendra Malik, Pieter Abbeel, and
Sergey Levine. 2018. SFV: reinforcement learning of physical skills from videos. In SIGGRAPH Asia 2018 Technical Papers (SIGGRAPH Asia '18). ACM, New York, NY, USA, Article 178, 14 pages. DOI: https://doi.org/10.1145/3272127.3275014 ө૾͔Β࢟Λਪఆ͠ ͓खຊͱͳΔಈ͖Λ࡞Δ ΩϟϥΫλʔ͕ཧతʹՄೳͳൣғͰ͓खຊʹ͍ۙಈ͖Λֶश͢Δ ཧγϛϡϨʔγϣϯԼͰ ಈ͘ΩϟϥΫλʔ͕ ֤ϑϨʔϜʹ͓͍ͯ ͓खຊʹ͍ۙϙʔζΛ͍ͯ͠Δఔ ߴ͍ใु -
ڧԽֶशʹΑΔΛணΔಈ͖ͷशಘ Alexander Clegg, Wenhao Yu, Jie Tan, C. Karen Liu,
and Greg Turk. 2018. Learning to dress: synthesizing human dressing motion via deep reinforcement learning. In SIGGRAPH Asia 2018 Technical Papers (SIGGRAPH Asia '18). ACM, New York, NY, USA, Article 179, 10 pages. DOI: https://doi.org/10.1145/3272127.3275048 ʹγϛϡϨʔγϣϯΛߦ͍͍ͨ ࣄલʹΩϟϓνϟͨ͠ಈ͖Ͱ ରͷΩϟϥΫλʔ ਖ਼͘͠ΛணΕͳ͍͔͠Εͳ͍ https://www.cc.gatech.edu/~aclegg3/projects/LearningToDress.html ڧԽֶशͰΩϟϥΫλʔʹ ࣗྗͰΛணΔํ๏Λֶशͯ͠Β͏ -
r(s) = w1 rp (s) + w2 rd (s) +
w3 rg (s) + w4 rt (s) + w5 rr (s) ΛணΔڧԽֶशͷใु rp (s) ਐḿใुକΛ௨աͨ͠಄ͷ͞ʹൺྫ͢Δใु rd (s) rg (s) rr (s) ͱΓ͋͑ͣକʹΛ௨ͦ͏ͱ͢ΔΑ͏ʹ༠ಋ มܗใु͕ҾͬுΒΕͯ৳ͼ͍ͯΔ΄Ͳݮগ͢Δใु Λഁ͘Α͏ͳಈ͖Λආ͚ΔΑ͏ʹ༠ಋ -
r(s) = w1 rp (s) + w2 rd (s) +
w3 rg (s) + w4 rt (s) + w5 rr (s) ΛணΔڧԽֶशͷใु rp (s) ਐḿใुକΛ௨աͨ͠಄ͷ͞ʹൺྫ͢Δใु rd (s) มܗใु͕ҾͬுΒΕͯ৳ͼ͍ͯΔ΄Ͳݮগ͢Δใु rg (s) ଌใु͕ഽʹ৮͍ͯ͠Δׂ߹ʹൺྫ͢Δใु rr (s) ͱΓ͋͑ͣକʹΛ௨ͦ͏ͱ͢ΔΑ͏ʹ༠ಋ Λഁ͘Α͏ͳಈ͖Λආ͚ΔΑ͏ʹ༠ಋ Λʹ͚͍ͭͯΔঢ়ଶΛࢦ͢Α͏ʹ༠ಋ ΰʔϧใुΛணͨঢ়ଶʹࣅ͍ͯΔ΄Ͳ૿Ճ͢Δใु କ͔Β಄Λग़ͦ͏ͱͨ͠Γ͠ͳ͍Α͏ʹ༠ಋ ͷछྨʹΑͬͯͷׂ߹Λௐ w -
ϊΠζͩΒ͚ͷϨϯμϦϯά݁ՌΛΦʔτΤϯίʔμʹ௨ͯ͠ ϊΠζ͕ແ͔ͬͨ߹ͷը૾Λਪఆͤ͞Δ Chakravarty R. Alla Chaitanya, Anton S. Kaplanyan, Christoph
Schied, Marco Salvi, Aaron Lefohn, Derek Nowrouzezahrai, and Timo Aila. 2017. Interactive reconstruction of Monte Carlo image sequences using a recurrent denoising autoencoder. ACM Trans. Graph. 36, 4, Article 98 (July 2017), 12 pages. DOI: https://doi.org/10.1145/3072959.3073601 https://research.nvidia.com/publication/interactive-reconstruction-monte-carlo-image-sequences-using-recurrent-denoising