Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Variational Auto Encoderでの Disentangled表現
Search
Kosuke Miyoshi
November 03, 2016
Research
0
620
Variational Auto Encoderでの Disentangled表現
※ Speaker Deck内ではURLリンクがクリックできないので、クリックしたい場合はpdfをダウンロードしてください
Kosuke Miyoshi
November 03, 2016
Tweet
Share
More Decks by Kosuke Miyoshi
See All by Kosuke Miyoshi
Representation Learning with Contrastive Predictive Coding
miyosuda
1
190
Sutton "Reinforcement Learning" 2nd Edition Ch13: Policy Gradient Methods
miyosuda
0
200
Sutton "Reinforcement Learning" 2nd Edition Ch7: n-step Bootstrapping
miyosuda
0
82
Sutton "Reinforcement Learning" 2nd Edition Ch6: TD-learning
miyosuda
0
90
SCAN
miyosuda
0
820
TensorFlow & DeepMind Lab & UNREAL
miyosuda
1
2.6k
Other Decks in Research
See All in Research
Combinatorial Search with Generators
kei18
0
910
引力・斥力を制御可能なランダム部分集合の確率分布
wasyro
0
260
長期・短期メモリを活用したエージェントの個別最適化
isidaitc
0
160
Time to Cash: The Full Stack Breakdown of Modern ATM Attacks
ratatata
0
160
大規模な2値整数計画問題に対する 効率的な重み付き局所探索法
mickey_kubo
1
380
不確実性下における目的と手段の統合的探索に向けた連続腕バンディットの応用 / iot70_gp_rff_mab
monochromegane
2
180
AI エージェントを活用した研究再現性の自動定量評価 / scisci2025
upura
1
160
超高速データサイエンス
matsui_528
1
150
機械学習と数理最適化の融合 (MOAI) による革新
mickey_kubo
1
380
最適決定木を用いた処方的価格最適化
mickey_kubo
4
1.9k
【輪講資料】Moshi: a speech-text foundation model for real-time dialogue
hpprc
3
730
EarthSynth: Generating Informative Earth Observation with Diffusion Models
satai
3
360
Featured
See All Featured
GraphQLとの向き合い方2022年版
quramy
49
14k
Rails Girls Zürich Keynote
gr2m
95
14k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
19
1.2k
Automating Front-end Workflow
addyosmani
1371
200k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Why Our Code Smells
bkeepers
PRO
339
57k
Git: the NoSQL Database
bkeepers
PRO
431
66k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
How GitHub (no longer) Works
holman
315
140k
GitHub's CSS Performance
jonrohan
1032
460k
Practical Orchestrator
shlominoach
190
11k
Transcript
7BSJBUJPOBM"VUP&ODPEFSͰͷ %JTFOUBOHMFEදݱ OBSSBUJWFOJHIUTגࣜձࣾࡾ߁༞ શΞʔΩςΫνϟୈճ4*(8#"Φϑձ
&BSMZ7JTVBM$PODFQU-FBSOJOHXJUI 6OTVQFSWJTFE%FFQ-FBSOJOH Irina Higgins, Loic Matthey, Xavier Glorot, Arka Pal,
Benigno Uria, Charles Blundell, Shakir Mohamed, Alexander Lerchner Google DeepMind, 2016 ͱΓ͋͛Δจ ˞όʔδϣϯʹΑͬͯύϥϝʔλ͕େ͖͘ҧ͍ͬͯΔɻ࠷৽ͷWΛར༻
%JTFOUBOHMFE SFQSFTFOUBUJPO w ҙຯۭؒͷදݱΛɺҐஔɺαΠζɺFUDʜͳͲͷߏ ཁૉͷύϥϝʔλʹ͔Εͨঢ়ଶͰ֫ಘ͍ͨ͠ w 7BSJBUJPOBM"VUP&ODPEFSͷજࡏมͰ͜ΕΒͷ දݱΛڭࢣͳ͠Ͱ֫ಘͰ͖ͳ͍͔ʁ
7BSJBUJPOBM"VUP&ODPEFS 9 [ 9` FODPEFS EFDPEFS αϯϓϦϯά
7BSJBUJPOBM"VUP&ODPEFS zͷࣄޙۙࣅq(z|x) (=Τϯίʔμͷग़ྗ ͱ N(0,I)ͱͷڑΛ࠷খԽ ෮ݩޡࠩΛ࠷খԽ
Ќͩͱzͷࣄޙۙࣅq(z|x)ΛΑΓ N(0,I)ʹ͚ۙͮΑ͏ͱ͢Δ ਖ਼ଇԽ߲ʹЌΛಋೖ Ќͷࢹ֮࿏ʹ͋ΔύϥϝʔλʁΛۙࣅ
w Y࠲ඪ Z࠲ඪͦΕͧΕύλʔϯ w TDBMFύλʔϯ w ճసύλʔϯ w ΦϒδΣΫτͷܗ ପԁɺϋʔτɺ࢛֯
ύλʔϯ Yͷը૾ݸΛજࡏมݸͷ7"&Ͱֶश [ FODPEFS EFDPEFS αϯϓϦϯά ͷμ,σ
Ќ Ќ
N(0, I)ʹٵ͍ࠐ·Εͯ͠·͍ͬͯΔ જࡏมݸͷ͏ͪͷͻͱͭͷЖ͚ͩΛม͑ͯΓΛݻఆ ֤જࡏม͕ύϥϝʔλ͝ͱʹ ͔Ε͍ͯΔ જࡏมͷࢄ જࡏมͷЖΛdͰ ಈ͔͢
%FFQ.JOEʹΑΔͦͷଞͷ࣮ݧ݁Ռ IUUQUJOZVSMDPNKHCZ[LF "UBSJ %໎࿏FUD…
7"&Ͱ%JTFOUBOHMF͞ΕΔʹ w ม͕࿈ଓͰຶʹαϯϓϦϯά͞Ε͍ͯΔ w ཁૉ͕౷ܭతʹಠཱ w ੑ͕ݮΒ͞Ε͍ͯΔ
w ີʹαϯϓϦϯά͞Ε͍ͯΕɺೋ͕ͭผͷΦϒδΣΫτͩͱೝࣝͰ͖Δ
ಈ͖͕࿈ଓͰີʹαϯϓϦϯά͞Ε͍ͯΕɺ ಉ͡ΦϒδΣΫτͩͱೝࣝͰ͖Δ ͜ΕΒೋͭͷύυϧಉ͡ΦϒδΣΫτͩΖ͏͔ʁ
࠶ݱݕূ ETIBQF
࠶ݱݕূ #SFBLPVU ΫϦοΫͰ࠶ੜ wϒϩοΫͷมԽ͕ͭͬͨજࡏมʹ·͕ͨͬͯऔΕ͍ͯΔ จͷ༷ͳύυϧͷಈ͖είΞͷมԽ·ͩऔΕ͍ͯͳ͍ wЌΛڧ͘͢Δͱͬͯ͘Δજࡏมݮͬͯ͘Δ͕ɺಉ࣌ʹϘέ ۩߹͕େ͖͘ͳͬͯύυϧ͕ফ͑ͯ͠·͏ [ [
[