൪ͷϢχοτɽ ɹ ɿ ྡߦྻʢʹશ݁߹ʹର͢ΔϚεΫʣɽཁૉ ɼ ͔Β ʹҹ͕ଘࡏ͢Δ͜ͱ Λҙຯ͢Δɽ ɹ ɿͷॏΈύϥϝʔλɽ ɹ ɿͷόΠΞεύϥϝʔλɽ ɹ ɿͷ׆ੑɽ ͱ͓͘ɽ L Hl l z(l) h l h M(l) ∈ ℝHl−1 ×Hl m(l) h,h′ = 1 z(l) h′ z(l−1) h W(l) ∈ ℝHl−1 ×Hl l b ∈ ℝHl l a(l) l [2] “Learning the Structure of Deep Sparse Graphical Models”, 2010
Ψεࣄલɼ ʹΨϯϚࣄલΛ༩͑Δɽʢڞࣄલ ʣ w ͕খ͍͞ɹˠͷۃͳΛͱΔɽ w ͕େ͖͍ɹˠ΄΅ܾఆతͳΛͱΔɽ ͞Βʹɼ ͱ͢Δɽ z(l) h p(z(l) h |a(l) h , ν(l) h ) = (ϕ−1(z(l) h )|a(l) h , ν(l) h ) ∂ ˜ a(l) h ∂z(l) h = N(ϕ−1(z(l) h )|a(l) h , ν(l) h ) ϕ′(ϕ−1(z(l) h )) ϕ′(a) = d da ϕ(a) W(l) h b(l) ν(l) h ν(l) h ν(l) h z(0) h = xh ∈ (−1,1)