Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Monte_Carlo_Methods

 Monte_Carlo_Methods

モンテカルロ法
Chapter 17 in Deep learning Book
深層学習本(Deep learning book by Ian Goodfellow)
URL:http://www.deeplearningbook.org/

Tag: deep learning, machine learning, mathematics, monte carlo, probability, statistics

tanimutomo

May 08, 2018
Tweet

More Decks by tanimutomo

Other Decks in Science

Transcript

  1. 1 /

  2. lfil Shla k T lfil hla k lfil y v

    lfil g d thla k e lfil h bp sr n h bo sr W alcil w Msr m x • 25 C? 5 8 1B 9 5D?B 19 B8 • 4 25 C? • 5 7 B 1B 9 5D?B 25 C? • CBD 5 79 25 C? • 15D BG 5 1B 9 5D?B 19 B8 • . 66 25 C? • 3 9 5??9 9 B 1 I 69 H99 29C5D5 98 1B89 • 39 C9D B 1 I 69 H99 1B89 • 9C 15 /9?C 1 I
  3. • 91 • • 31 6 6 2 8 /

    / 6 ] 8[ • • 6
  4. 6/ 8 • • • 6 8 • 9 •

    • 8 1 6 9 • 6 6 4
  5. 8 /6 6 1 n 9 If Var[f(x)] < ∞:

    converges to 0 8 /6
  6. • f • 6 8 0 • • • )

    ( , ( • X / / • 8 X 91 • 8 1= X 9 1
  7. E 8 9 = 1 6 Z 6 = 5=

    V 8 1* / ( ) 1
  8. a ][ ] 1,9/ 6 8 , / , 6

    1 ][ ] dg S 6 7 e i 7B ][ ] E dg 9 9 I c
  9. GE GA • V • /9 • GE GA8 /

    8 • • L D GE GA 6 S 1 6 •
  10. M ) ) B • /  8 ( 1

    , 2 • ,E ,0 9 6 • E 0, 9 6 •   C
  11.    M 2 M 1   68M

       C 1 C / 1 / 1 8B E 0 M 69
  12. M = ) ( 9 1 = T / 8

    ( ) ) 2 C 6
  13. )()(M  C /0 1tM x M ʼ C 3

    1  2 M Mp 9 T • 8 29M q • 8 2 T C M M M | M 6
  14. 2 9 / 1 2 T2 8 6 A6 M2

    6 A/C 6t=04/
  15. M t 9 5 / 6 0 / 91 2

    /  9 C A 1 9 819 81 92 / 1 0 5
  16. 8 C M 1 8  1 8C 9 C

    96 8 96  1 8C / 2 1 
  17. 9 / 1 2 / 6 A ( ) 9M

    8 A6 M 6 C78
  18. ( ( 6 1 o 8 9 o 1 o9

    C k d .) ( 2 1 M l 2 1 8 0 / m e ) /2) a
  19. / / ࣍ͷ YJ ͷબ୒Λߟ͑Δ ˠ͜Ε͸ɼ৚݅෇͖֬཰ Q YJ cYJ ʹΑܾͬͯఆ͞ΕΔ

    ͜͜Ͱɼແ޲άϥϑʹ͓͍ͯɼ YJ ͕ۙ๣ͷม਺ YJ ʹؔͯ͠৚݅෇͖ಠཱ ˠ͜ͷΑ͏ͳ YJ ͕ෳ਺͋Δ৔߹ɼͦΕΒ͸ಉ࣌ʹαϯϓϦϯάՄೳ ˠ͜ͷख๏ΛϒϩοΫΪϒεαϯϓϦϯάͱݺͿ
  20. 1 5 5 5 →5 3 5 8 9 2

    6 8 / 2 6 8 6 8
  21. 6 6 / 71 8 9 / 31 / 37

    Difficult & Slow Easy & Fast
  22. /6 /6 β EBM 8 1 8 β 98 0

    → β ∞ → p = 0 → 38 = ∞→ β 0 → p = 1 → 38
  23. 6 6 86 β = 1 β < 1 39

     tempering β < 1 / 3 / , tempered transitions 6 1 → 6 /   parallel tempering 6 /
  24. 9 91 9 Bengio(2013) 81VAE RBM 6h9 6 /1 9

    1 6 6 1 /1 / / 4 1 99 9 6