Variational Auto Encoderでの Disentangled表現

※ Speaker Deck内ではURLリンクがクリックできないので、クリックしたい場合はpdfをダウンロードしてください

Transcript

1. 7BSJBUJPOBM
   "VUP
   &ODPEFSͰͷ
 %JTFOUBOHMFEදݱ OBSSBUJWF
   OJHIUTגࣜձࣾ
   ࡾ޷߁༞
 શ೴ΞʔΩςΫνϟୈճ4*(8#"Φϑձ

   

2. &BSMZ
   7JTVBM
   $PODFQU
   -FBSOJOH
   XJUI
   6OTVQFSWJTFE
   %FFQ
   -FBSOJOH Irina Higgins, Loic Matthey, Xavier Glorot, Arka Pal, Benigno Uria,
 Charles Blundell, Shakir Mohamed, Alexander Lerchner
 Google DeepMind, 2016 ͱΓ͋͛Δ࿦จ ˞όʔδϣϯʹΑͬͯύϥϝʔλ͕େ͖͘ҧ͍ͬͯΔɻ࠷৽ͷWΛར༻
3. %JTFOUBOHMFE
   SFQSFTFOUBUJPO w ҙຯۭؒͷදݱΛɺҐஔɺαΠζɺFUDʜͳͲͷߏ ੒ཁૉͷύϥϝʔλʹ෼͔Εͨঢ়ଶͰ֫ಘ͍ͨ͠
   w 7BSJBUJPOBM
   "VUP
   &ODPEFSͷજࡏม਺Ͱ͜ΕΒͷ දݱΛڭࢣͳ͠Ͱ֫ಘͰ͖ͳ͍͔ʁ
4. 7BSJBUJPOBM
   "VUP
   &ODPEFS 9 [ 9` FODPEFS EFDPEFS αϯϓϦϯά
5. 7BSJBUJPOBM
   "VUP
   &ODPEFS zͷࣄޙ෼෍ۙࣅq(z|x) 
 (=Τϯίʔμͷग़ྗ ͱ
 N(0,I)ͱͷڑ཭Λ࠷খԽ ෮ݩޡࠩΛ࠷খԽ
6. Ќͩͱzͷࣄޙ෼෍ۙࣅq(z|x)ΛΑΓ
 N(0,I)ʹ͚ۙͮΑ͏ͱ͢Δ ਖ਼ଇԽ߲ʹ܎਺ЌΛಋೖ Ќ͸೴ͷࢹ֮࿏ʹ͋ΔύϥϝʔλʁΛۙࣅ
7. w Y࠲ඪ Z࠲ඪͦΕͧΕύλʔϯ
   w TDBMF
   ύλʔϯ
   w ճస
   ύλʔϯ
   w ΦϒδΣΫτͷܗ ପԁɺϋʔτɺ࢛֯
   ύλʔϯ Yͷը૾ݸΛજࡏม਺ݸͷ7"&Ͱֶश [ FODPEFS EFDPEFS αϯϓϦϯά ૊ͷμ,σ
8. Ќ Ќ
9. N(0, I)ʹٵ͍ࠐ·Εͯ͠·͍ͬͯΔ જࡏม਺ݸͷ͏ͪͷͻͱͭͷЖ͚ͩΛม͑ͯ࢒ΓΛݻఆ ֤જࡏม਺͕ύϥϝʔλ͝ͱʹ
 ෼͔Ε͍ͯΔ જࡏม਺ͷ෼ࢄ જࡏม਺ͷЖΛdͰ
 ಈ͔͢
10. %FFQ.JOEʹΑΔͦͷଞͷ࣮ݧ݁Ռ IUUQUJOZVSMDPNKHCZ[LF "UBSJ
    %໎࿏
    FUD…
11. 7"&Ͱ%JTFOUBOHMF͞ΕΔʹ͸ w ม׵͕࿈ଓͰຶʹαϯϓϦϯά͞Ε͍ͯΔ
    w ཁૉ͕౷ܭతʹಠཱ
    w ৑௕ੑ͕ݮΒ͞Ε͍ͯΔ
12. w ີʹαϯϓϦϯά͞Ε͍ͯΕ͹ɺೋ͕ͭผͷΦϒδΣΫτͩͱೝࣝͰ͖Δ
13. ಈ͖͕࿈ଓͰີʹαϯϓϦϯά͞Ε͍ͯΕ͹ɺ
 ಉ͡ΦϒδΣΫτͩͱೝࣝͰ͖Δ ͜ΕΒೋͭͷύυϧ͸ಉ͡ΦϒδΣΫτͩΖ͏͔ʁ
14. ࠶ݱݕূ
    E
    TIBQF
15. ࠶ݱݕূ
    #SFBLPVU ΫϦοΫͰ࠶ੜ wϒϩοΫͷมԽ͕ͭ࢒ͬͨજࡏม਺ʹ·͕ͨͬͯऔΕ͍ͯΔ
 ࿦จͷ༷ͳύυϧͷಈ͖΍είΞͷมԽ͸·ͩऔΕ͍ͯͳ͍
    wЌΛڧ͘͢Δͱ࢒ͬͯ͘Δજࡏม਺͸ݮͬͯ͘Δ͕ɺಉ࣌ʹϘέ ۩߹͕େ͖͘ͳͬͯύυϧ͕ফ͑ͯ͠·͏ [ [ [