Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
ベイズ統計モデリング 10 // Doing Bayesian Data Analysis C...
Search
Sponsored
·
Your Podcast. Everywhere. Effortlessly.
Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
→
todesking
August 24, 2018
Science
140
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
ベイズ統計モデリング 10 // Doing Bayesian Data Analysis Chapter 10
todesking
August 24, 2018
More Decks by todesking
See All by todesking
自作言語進捗 2020 Mar / ojaml-2020-mar
todesking
0
490
バンディット問題の理論とアルゴリズム 第8章 / bandit-8
todesking
0
140
オンライン広告におけるCTR/CVR推定関係の論文を30本くらい雑に紹介する / rtb-papers-ctr
todesking
3
1.8k
オンライン広告関連の論文を50本くらい雑に紹介する AdKDD編 / adkdd-all
todesking
4
2.5k
バンディット問題の理論とアルゴリズム 第二章 / bandit2
todesking
0
210
自作言語進捗 2019 May / ojaml-2019-may
todesking
0
990
自作言語進捗 2019 Mar
todesking
0
550
実行時におけるJVMバイトコード最適化手法
todesking
16
13k
Other Decks in Science
See All in Science
機械学習 - DBSCAN
trycycle
PRO
0
2.3k
Conwayの法則を"ちゃんと"使うために — 原典でConwayは何を言っていたのか
bonotake
10
7.7k
データベース09: 実体関連モデル上の一貫性制約
trycycle
PRO
0
1.9k
Kritische evaluatie van GenAI-output voor literatuuronderzoek
voginip
0
250
AI Safety, Seen Through Its Questions
kanekomasahiro
1
260
AI(人工知能)の過去・現在・未来 ~AIは人類を越えるのか~
tagtag
PRO
0
180
[第67回 CV勉強会@関東] CV × Scientific Figures / kantoCV 67th CVPR 2026
lychee1223
0
260
From Prediction to Understanding: Causal Discovery for Data Science and AI Applications
sshimizu2006
0
330
O(log n)-Approximation Algorithms for Bipartiteness Ratio
tasusu
0
290
因果探索の発展と展望
sshimizu2006
2
1.3k
知能とはなにか -ヒトとAIのあいだ-
tagtag
PRO
0
240
現代AI入門: 大規模言語モデルから思考するシステムへ — Test-Time Scaling, Loop, Harness, RSI
stillpedant
PRO
33
17k
Featured
See All Featured
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
akihiro_kokubo
PRO
74
43k
Become a Pro
speakerdeck
PRO
31
6.3k
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
rkaga
63
47k
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
uxyall
1
3.5k
Building Better People: How to give real-time feedback that sticks.
wjessup
371
20k
Getting science done with accelerated Python computing platforms
jacobtomlinson
2
550
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
sarafernandez
0
310
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
35
2.9k
The SEO Collaboration Effect
kristinabergwall1
1
600
Automating Front-end Workflow
addyosmani
1370
210k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
16
2.2k
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4.6k
Transcript
ϕΠζ౷ܭϞσϦϯά Chapter 10 @todesking
ϕΠδΞϯϞσϧൺֱ • ؍ଌ͞ΕͨσʔλΛઆ໌͢ΔͨΊͷɺෳͷϞσϧ͕ߟ͑ ΒΕΔ • ͲͷϞσϧ͕ΑΓͬͱΒ͍͔͠? • ࠓ·ͰֶΜͰ͖ͨϕΠζϞσϦϯάʹΑͬͯɺʮϞσϧΛ ൺֱ͢ΔϞσϧʯΛߏ͢Δ͜ͱ͕Ͱ͖Δ
10.1 ҰൠࣜͱϕΠζϑΝΫλʔ • ؍ଌ͞Εͨσʔλ(D)Λઆ໌͢Δ2ͭͷϞσϧΛߟ͑Δ • ֤ϞσϧɺࣄલP(θ)ɺP(D|θ)͓Αͼύϥϝʔλθ͔ΒͳΔ D θ1 θ1 ∼
P1 (θ1 ) D ∼ P1 (D|θ1 ) D θ2 θ2 ∼ P2 (θ2 ) D ∼ P2 (D|θ2 )
Ϟσϧͷநදݱ • Ϟσϧ͕ෳͷม͔Βߏ͞Ε͍ͯͯɺநԽ͢Ε θ, P(θ), P(D|θ) ͰදݱͰ͖Δ(ಠࣗݚڀ) D θ1 θ
= (φ1 , φ2 , φ3 ) D = (X, Y) P(θ) = P(φ1 , φ2 , φ3 ) P(D|θ) = P(X, Y|φ1 , φ2 , φ3 ) X φ1 φ3 Y φ2
ϞσϧൺֱͷͨΊͷϞσϧ • ϞσϧબมmΛಋೖͯ͠ɺ2ͭͷϞσϧΛ·ͱΊΔ • ϞσϧൺֱͷͨΊͷϞσϧͱͳΔ • fig 10.1Ͱɺ͕ؔผʑͷέʔε(தԝ)ɺڞ௨͍ͯ͠Δέʔε(ӈ)ɺͦ ͷҰൠԽ͍Δͷ͔?ͷέʔε(ࠨ)͕දݱ͞Ε͍ͯΔ •
Լਤதԝͷέʔεʹ૬ D θ1 θ1 ∼ P1 (θ1 ) θ2 θ2 ∼ P2 (θ2 ) m m ∼ P(m) P(D|θ1 , m = 1) = P1 (D|θ1 ) P(D|θ2 , m = 2) = P2 (D|θ2 )
ϞσϧൺֱͷͨΊͷϞσϧ • ͜ͷϞσϧͷύϥϝʔλಉ࣌ҎԼʹͳΔ • ϞσϧΛM, ύϥϝʔλ{θ_1, ..., θ_M} Λ Θ
ͱͨ͠ P(Θ, m|D) = P(D|Θ, m)P(Θ, m) ∑ m ∫ dθm P(D|Θ, m) = ∏ m ∫ dθm Pm (D|θm , m)Pm (θm )P(m) ∑ m ∏ m ∫ dθm Pm (D|θm , m)Pm (θm )P(m) P(D|Θ) ͕ ∏ m Pm (D|θm )Pm (θm |m)P(m)ʹͳΔͷ͕ॏཁΒ͍͠
P(m|D) • ͜ͷϞσϧΛ͏͜ͱͰɺσʔλD͕༩͑ΒΕͨͱ͖Ϟσ ϧm͕ΘΕΔ֬P(m|D)ΛٻΊΔ͜ͱ͕Ͱ͖Δ P(m|D) = P(D|m)P(m) ∑ m P(D|m)P(m)
P(D|m) = ∫ dθm Pm (D|θm )Pm (θm )
ࣄޙΦοζͱϕΠζϑΝΫλ • ϞσϧؒͰP(m|D)ͷൺΛऔΕɺͲͪΒͷϞσϧ͕ͬͱ Β͍͔͠Θ͔Δ=ࣄޙΦοζ P(m = 1|D) P(m = 2|D)
= P(D|m = 1) P(D|m = 2) P(m = 1) P(m = 2) • P(m|D)ͷൺΛϕΠζϑΝΫλ(BF)ͱ͍͏ • ࣄޙΦοζ=BF * ࣄલ֬ͷൺ
10.2 2ͭͷίΠϯͷྫ • ίΠϯΛNճ͛ͨΒද͕zճग़ͨɻ2ͭͷͷͲͪΒ͔Βདྷ ͨίΠϯ͔? • ͦΕͧΕͷΛϞσϧͱΈͳͯ͠ɺϞσϧൺֱ͢Δ • fig 10.1ʹ͓͚Δӈͷਤ=͕ؔಉ͡Ͱ͋Δέʔεʹ૬
z θ1 θ1 ∼ Beta(ω = 0.25,κ = 12) θ2 m m ∼ Categorical(0.5,0.5) z ∼ Binomial(θm , N) θ2 ∼ Beta(ω = 0.75,κ = 12) N
P(m|D)ͷൺΛٻΊΔ: ղੳղ • ࣄલ͕Beta(a, b)Ͱ༩͑ΒΕΔͱ͖ɺP(z,N)ҎԼͷࣜ ʹͳΔ(6ষͰઆ໌ࡁΈ) • আࢉ࣌ΞϯμʔϑϩʔࢭͷͨΊʹlogΛऔΔͱ͍͍ • RʹϕʔλͷlogΛٻΊΔlbeta͕ؔ͋Δ
P(z, N) = B(z, a, N − z + b) B(a, b) = exp(log B(z + a, N − z + b) − logB(a, b))
P(m|D)ͷൺΛٻΊΔ: ղੳղ • ·ͱΊΔͱɺP(D|m)ҎԼͱͳΔ P(D|m) = P(z, N|m) = B(z,
am , N − z + bm ) B(am , bm ) am = ωm (κ − 2) + 1 bm = (1 − ωm )(κ − 2) + 1 ω1 = 0.25 ω2 = 0.75
P(m|D)ͷൺΛٻΊΔ: ղੳղ • P(D|m=1) ≒ 0.000499 • P(D|m=2) ≒ 0.002339
• BF = P(D|m=1)/P(D|m=2) ≒ 0.213 ͱͳΔ • P(m = 1) = P(m = 2) = 0.5 ͷͱ͖ɺ P(m = 1|D) P(m = 2|D) = P(D|m = 1) P(D|m = 2) = 0.213 P(m = 2|D) = 1 − P(m = 1|D)ΑΓ P(m = 1|D) 1 − P(m = 1|D) = 0.213 P(m = 1|D) = 0.176 P(m = 2|D) = 0.824
P(m|D)ͷൺΛٻΊΔ: άϦουۙࣅ • m{0, 1}ͷΛऔΔࢄύϥϝʔλ • ਤ͕ॻ͖ʹ͍͘ͷͰɺmͷ͔ΘΓʹωΛಋೖ • ω0.25ͱ0.75ʹϐʔΫΛ࣋ͭɻ֤Ϟσϧͷ࠷ස ω_{1,2}ʹରԠɻ
• ӈ্: ωͷɻ2ͭͷࢁ͕ಉ͡ߴ͞Ͱ͋Δ=2ͭͷ֬ • ࠨԼ: θͷपลɻϞσϧʹରԠͨ͠2ͭͷࢁ͕͋Δ • ӈԼ: ω={0.75,0.25}ʹ͓͚Δθͷ άϦουۙࣅ:
ࣄલ
• ӈ্ͷP(ω|D)ʹ͓͍ͯɺߴ͞ͷൺ5:1Ͱ͋Δ: P(m|D)ͷൺʹରԠ • ղੳղͰmͷΈʹ͕ͨ͠ɺࠓճͷۙࣅͰθͷ͕ՄࢹԽ͞Εͨ άϦουۙࣅ: ࣄޙ
10.3 MCMCΛ༻͍ͨղ๏ • ͦΕͧΕͷmʹ͍ͭͯP(D|m)Λܭࢉ͢Δํ๏ • Ϟσϧൺֱ༻ͷϞσϧΛϞσϦϯά͠ɺmͷࣄޙ ΛٻΊΔํ๏
10.3.1 MCMC: Ϟσϧ͝ͱ • ͦΕͧΕͷmʹ͍ͭͯɺP(D|m)Λܭࢉ͢Δ • JAGSͰθ_mΛαϯϓϦϯάͯ͠ɺ݁Ռʹରͯ͠Ή͔ͣ͠ ͍͚͍͞ΜΛ͢ΔͱP(D|m)ʹͳΔ
Ϟσϧ͝ͱͷपลܭࢉ • P(D)P(θ)͔ΒαϯϓϦϯάͨ͠θ_nΛͬͯɺΣP(D|θ) / N ͰۙࣅՄೳ͕ͩɺ࣮༻తͰͳ͍ • P(θ)֦ࢄ͍ͯ͠Δ • ΄ͱΜͲͷαϯϓϧʹஔ͍ͯɺP(D|θ)ඇৗʹখ͍͞
• ࣄޙP(θ|D)͔ΒαϯϓϦϯάͨ͠θΛͬͯP(D)Λಋ ग़͍ͨ͠
Ϟσϧ͝ͱͷपลܭࢉ P(θ|D) = P(D|θ)P(θ) P(D) 1 P(D) = P(θ|D) P(D|θ)P(θ)
ҙͷ֬h(θ)Λಋೖͯ͠ = P(θ|D) P(D|θ)P(θ) ∫ dθ′h(θ′) = ∫ dθ′ P(θ|D) P(D|θ)P(θ) h(θ′) ҙͷθʹ͍ͭͯɺ P(θ|D) P(D|θ)P(θ) ͷಉ͡ͳͷͰ = ∫ dθ′ P(θ′|D) P(D|θ′)P(θ′) h(θ′) ≈ N ∑ θi ∼P(θ|D) h(θi ) P(D|θi )P(θi )
Ϟσϧ͝ͱͷपลܭࢉ • h(θ)ͱͯ͠ҙͷ͕֬͑Δ͕ɺܭࢉͷ߹ ্ɺͱࣅͨܗঢ়Ͱ͋Δ͜ͱ͕·͍͠ • ෳࡶͳϞσϧʹ͓͍ͯɺͦͷΑ͏ͳhΛٻΊΔͷ͍͠ • 10.3.1.1ʹ͓͍ͯɺαϯϓϦϯάͨ͠θΛݩʹhͷܗঢ়Λ ܾΊ͍ͯΔ N
∑ θi ∼P(θ|D) h(θi ) P(D|θi )P(θi )
N 10.3.2 MCMC: ֊Ϟσϧ • ࠓճͷέʔεͰɺ֤Ϟσϧͷࣄલ͓Αͼ͕ಉؔ͡ ͰදͤΔ • θΛαϯϓϦϯά͢ΔࡍʹɺmΛߟྀͯ͠ωͷΛม͑ΕΑ͍ y
θ m ω1 = 0.25 ω2 = 0.75 m ∼ Categorial(0.5,0.5) θ ∼ Beta(ω = ωm , κ = 12) yi ∼ Bern(θ) 2 ω
MCMCͷ݁Ռ • ্͕ࣄલɺԼ͕ࣄޙ • mͷࣄޙɺଞͷख๏Ͱͷ݁ ՌͱҰக͍ͯ͠Δ • m=1ʹ͓͚Δθͷࣄޙɺα ϯϓϧશମͷ18%͔͠ΘΕͯ ͍ͳ͍͜ͱʹҙ
• m=2ʹ͓͚Δθͷࣄޙɺ Γ82%͕ΘΕ͍ͯΔ • ࢧ࣋͞Εͳ͔ͬͨϞσϧʹؔ͢Δ αϯϓϧগͳ͘ͳΔ
2 10.3.2.1 ͬͱҰൠతͳํ๏ • ͜ͷࣄྫͰɺͨ·ͨ·ࣄલ͕ؔશϞσϧͰಉ͡ • ҰൠతʹɺҟͳΔؔΛ͍͍ͨ • ͷͰɺ͚ͯهड़͢Δͱ͜͏ͳΔ •
આ໌ͷ߹্ɺࣄલͷύϥϝʔλલͷྫͱҧ͍ͬͯΔ N y θ m ω1 = 0.10 ω2 = 0.90 m ∼ Categorial(0.5,0.5) θ1 ∼ Beta(ω = ω1 , κ = 20) θ2 ∼ Beta(ω = ω2 , κ = 20) yi ∼ Bern(θm ) ω
݁Ռ • ਤ10.5ࢀর • ҰԠαϯϓϦϯάͰ͖͍ͯΔ͕…… • ESS(༗ޮαϯϓϧαΠζ)<500 • mͷࣗݾ૬͕ؔҟৗʹߴ͍
ࣗݾ૬ؔͷߴ͞ • θ1(m=2)͓Αͼθ2(m=1)ࣄલͷΈʹै͏ͷʹରͯ͠ɺθ1(m=1) ͓Αͼθ2(m=2)ࣄલٴͼyʹӨڹΛड͚Δ • ͜ͷҧ͍͕mͷαϯϓϦϯάʹѱӨڹΛٴ΅͢ θ1(m=1) θ1(m=2) θ2(m=1) θ2(m=2)
mʹΑΔθͷมԽ • JAGSgibbs sampling͍ͯ͠ΔͷͰɺύϥϝʔλΛҰݸ ͣͭαϯϓϦϯά͍ͯ͘͠ θ(1) 1 ∼ P(θ1 |θ(0)
2 , m(0), D) θ(1) 2 ∼ P(θ2 |θ(1) 1 , m(0), D) m(1) ∼ P(m|θ(1) 1 , θ(1) 2 , D) θ(2) 1 ∼ P(θ1 |θ(1) 2 , m(1), D) θ(2) 2 ∼ P(θ2 |θ(2) 1 , m(1), D) m(2) ∼ P(m|θ(2) 1 , θ(2) 2 , D) ⋯
αϯϓϦϯάաఔ P(θ1 , θ2 , m|D) = { P1 (D|θ1
)P1 (θ1 )P2 (θ2 )P(m = 1) if m = 1 P2 (D|θ2 )P1 (θ1 )P2 (θ2 )P(m = 2) if m = 2 m(1) = 1 θ(1) 1 ∼ P(θ1 |θ(0) 2 , m = 1,D) = P(θ1 , θ(0) 2 , m = 1|D) P(θ(0) 2 , m = 1|D) P(θ(0) 2 , m = 1|D) = P2 (θ(0) 2 )P(m = 1) ∫ dθ1 P1 (D|θ1 )P1 (θ1 )ΑΓ = P1 (D|θ1 )P1 (θ1 ) ∫ dθ1 P1 (D|θ1 )P1 (θ1 )
αϯϓϦϯάաఔ θ(1) 2 ∼ P(θ2 |θ(1) 1 , m =
1,D) = P(θ(1) 1 , θ2 , m = 1|D) P(θ(1) 1 , m = 1|D) P(θ(0) 1 , m = 1|D) = P1 (D|θ(1) 1 )P1 (θ(1) 1 )P(m = 1) ∫ dθ2 P2 (θ2 )ΑΓ = P2 (θ2 ) P(θ1 , θ2 , m|D) = { P1 (D|θ1 )P1 (θ1 )P2 (θ2 )P(m = 1) if m = 1 P2 (D|θ2 )P1 (θ1 )P2 (θ2 )P(m = 2) if m = 2
αϯϓϦϯάաఔ m(2) ∼ P(m|θ(1) 1 , θ(1) 2 , D)
= P(θ(1) 1 , θ(1) 2 , m|D) P(θ(1) 1 , θ(1) 2 |D) P(θ1 , θ2 , m|D) = P(D|θ1 , θ2 , m) P(θ1 , θ2 , m) P(D|θ1 , θ2 , m) = { P1 (D|θ1 )P1 (θ1 )P2 (θ2 )P(m = 1) if m = 1 P2 (D|θ2 )P1 (θ1 )P2 (θ2 )P(m = 2) if m = 2 P(θ1 , θ2 , m) = P1 (θ1 )P2 (θ2 )P(m) = { P(D|θ1 ) if m = 1 P(D|θ2 ) if m = 2
αϯϓϦϯάաఔ • ࣍ͷm͕{1,2}ͷͲͪΒʹͳΔ͔ɺP(D|θ1)/P(D|θ2)ͷൺͰܾ·Δ • θ1ͷ΄͏P(D|θ1)P(θ1)͔Βੜ͞Ε͍ͯΔˠP(D|θ1)͕େʹͳΔ ͕֬ߴ͍ • θ2P(θ2)͔Βੜ͞Ε͍ͯΔˠP(D|θ2)খʹͳΔͩΖ͏ • ݁Ռͱͯ͠ɺm1ʹཹ·Δ͕֬ߴ͍
m(1) = 1 θ(1) 1 ∼ P(θ1 |m = 1,D) ∝ P1 (D|θ1 )P1 (θ1 ) θ(1) 2 ∼ P1 (θ2 ) m(2) ∼ P(m|θ(1) 1 , θ(1) 2 , D) = { P(D|θ1 ) if m = 1 P(D|θ2 ) if m = 2
ٙࣅࣄલʹΑΔ αϯϓϦϯάվળ • : θͷmͷʹΑΒͣҰఆͰ͋ͬͯ΄͍͠ • ղܾ: P(θ_i|m=i)ʹ͍ۙΛ༻ҙͯ͠ɺθ_i(i≠m)ʹ͍ͭͯ ͦͷ͔ΒαϯϓϦϯά͢Δ
ٙࣅࣄલͷར༻ • ٙࣅࣄલΛΘͳ͍ϞσϧΛࣄલʹ࣮ߦ͓͖ͯ͠ɺٙࣅࣄલ ͷύϥϝʔλΛಘΔ • બΕͨϞσϧͷθී௨ʹαϯϓϦϯά͢Δ͕ɺબΕͳ͔ͬͨํ ٙࣅࣄલ͔ΒαϯϓϦϯά͢Δ ωi,j , κi,j
= { true prior if i = j pseudo prior if i ≠ j m ∼ Categorial(0.5,0.5) θ1 ∼ Beta(ω = ω1,m , κ = κ1,m ) θ2 ∼ Beta(ω = ω2,m , κ = κ2,m ) yi ∼ Bern(θm ) 2 2 N y θ m ω
݁Ռ • θͷm͕มΘͬ ͍͍ͯͩͨಉ͡ܗঢ় • mͷࣗݾ૬͕ؔେ෯ʹ Լ͕ΓɺESS=10000
ࢧ࣋͞Εͳ͍Ϟσϧͷαϯϓ ϧ͕গͳ͍ • mͷࣄޙʹ͓͍ͯɺϞσϧ1͕બΕΔͷ8% • ͭ·ΓϞσϧ1ͷύϥϝʔλͰ͋Δθ1ͷαϯϓϧ͕શମ ͷ8% • αϯϓϧΛ૿ͨ͢ΊʹɺνΣʔϯͷ͞Λ૿͢ (ܭࢉ࣌ؒʹѱӨڹ)΄͔ʹɺϞσϧ͕ΑΓฏʹબΕΔ
Α͏P(m)Λௐ͢Δ(m=1ʹόΠΞεΛֻ͚Δ)ํ๏͕͋Δ • P(m)Λ͍ͬͯ͡γϛϡϨʔγϣϯͨ͠߹Ͱɺฏͳ ࣄલʹ͓͚ΔࣄޙΦοζΛٻΊΒΕΔ BF = P(m = 1|D) P(m = 2|D) P(m = 2) P(m = 1)
10.3.3 Ϟσϧ͝ͱʹҟͳΔ ؔͷར༻ • P(D|θ)Λnoise distributionͱ͍͏ͦ͏Ͱ͢ • Ϟσϧ͝ͱʹҟͳΔP(D|θ)Λ͍͍ͨͱ͖ɺ8.6.1Ͱհ͠ ͨςΫχοΫ͕͑Δ •
spy = if m = 1 then PDF(D|θ1) else PDF(D|θ2) / C • 1 ~ Bern(spy) • Ϟσϧͷಉ࣌֬ʹspyΛ͡Δ͜ͱʹͳΔ • C(େ͖Ίͷఆ)Ͱׂ͍ͬͯΔͷspy͕1Λ͑ͳ͍Α͏ʹ • ૬ରతͳ͕ॏཁͳͷͰɺspyͷ۩ମతͳؔͳ͍ • STANͩͱͬͱײతʹॻ͚ͨؾ͕͢Δ(increment_log_prob ؔͰϞσϧͷ֬ΛՃࢉͰ͖Δ)
10.4: Ϟσϧฏۉ • P(y)Λ༧ଌ͍ͨ͠ • Ϟσϧൺֱͷ݁ՌϞσϧb͕উ͍ͬͯͨͳΒɺͦͷϞσϧͰ༧ ଌ͢Δ͜ͱ͕Ͱ͖Δ P( ̂ y|D,
m = b) = ∫ dθb Pb ( ̂ y|θb , m = b)Pb (θb |D, m = b) • Ϟσϧ͝ͱʹ֬৴ׂ͕ΓͯΒΕ͍ͯΔͷͰɺͦͷॏΈ ΛͬͯશϞσϧͷฏۉΛऔΔ͜ͱ͕Ͱ͖Δ P( ̂ y|D) = ∑ m ∫ dθm Pm ( ̂ y|θm , m)Pm (θm |D, m)P(m|D)
10.5: Ϟσϧͷෳࡶ • ࣄલʹ͓͍ͯɺύϥϝʔλͷऔΓ͏Δൣғ͕͍Ϟσ ϧΛʮෳࡶʯͳϞσϧͱݴ͍ͬͯΔͬΆ͍ • ୯ʹύϥϝʔλ͕ଟ͍Ϟσϧͱ͍͏ҙຯͰͳ͍(ҎԼ ͷྫͰɺύϥϝʔλಉ͡) • ҰൠతʹɺෳࡶͳϞσϧͷ΄͏͕σʔλͷద߹༗ར
• ͍ύϥϝʔλൣғͷϞσϧͷ΄͏͕ɺσʔλʹద߹ ͢ΔύϥϝʔλͷΈ߹ΘͤΛؚΉՄೳੑ͕ߴ͍ͷͰ • ͔͠͠աద߹ආ͚͍ͨ
Ϟσϧൺֱͱෳࡶ͞ • ෳࡶͳϞσϧɺࣄલ͕શମʹബ͘ࢄΒ͍ͬͯΔ • ՄೳͳύϥϝʔλͷΈ߹Θ͕ͤଟ͍=Ұݸ͋ͨΓͷ֬ ͕͍ • ୯७ͳϞσϧɺࣄલ͕ް͍ • ϕΠζϞσϧൺֱʹ͓͍ͯɺࣄલͷް͕͞ࣄޙ֬
ʹӨڹΛ༩͑Δ
Ϟσϧൺֱͱෳࡶ͞ • ίΠϯ͛ͷϞσϧ: θ ~ Beta(a, b) Λߟ͑Δ • 1.
ϑΣΞͩΖ͏Ϟσϧ: (a,b) = (500, 500) • 2. ͯ͢ى͜Γ͏ΔϞσϧ: (a, b) = (1, 1) • 20ճத15ճද͕ग़ͨέʔεͰɺϞσϧ2͕উͭ • 20ճத11ճද͕ग़ͨΒϞσϧ1͕উͭ • ࣄલͷް͍෦Ͱσʔλʹద߹Ͱ͖͔͕ܾͨΊख
10.5.1 Ϟσϧൺֱͷҙ • ͋ΔϞσϧ(full modelͱݺͿ)ʹରͯ͠ɺύϥϝʔλͷൣғ ʹ੍ΛՃ͑ͨϞσϧΛߟ͑Δ͜ͱ͕Ͱ͖Δ • ύϥϝʔλaͷbͱಉ͡ɺͳͲ • full
modelͷ΄͏͕ෳࡶͳͷͰɺ੍ݶϞσϧ͕ಉ͘͡Β͍ Α͘σʔλΛදݱͰ͖ΔͳΒɺϕΠδΞϯϞσϧൺֱͰ ੍ݶϞσϧ͕બΕΔͩΖ͏ • 9ষͷٿબखϞσϧʹ͓͍ͯɺखͷೳྗͯ͢ಉ ͡Ͱ͋Δͱ͍͏੍ݶΛ͔͚ͨϞσϧ͕ߟ͑ΒΕΔ
Ϟσϧൺֱͷҙ • ߟ͑ΒΕΔ੍Λશ෦ࢼͦ͏ͱ͢ΔͷΊͨ΄͏͕͍ ͍ • 9ύϥϝʔλʹಉ੍Λֻ͚Δ߹ɺΈ߹Θͤ 21147௨Γ • ੍Λ͔͚Δͱ͍͏͜ͱɺಛఆͷύϥϝʔλͷΈ ߹Θͤʹ͍ͭͯࣄલΛ0ʹ͢Δͱ͍͏͜ͱ
• ͨͱ͑ϞσϧൺֱͰউͭͱͯ͠ɺ·͘͠ͳ͍͔ ͠Εͳ͍
10.6 ࣄલʹහײ • ϕΠζϑΝΫλʔ∫dθ P(D|θ)P(θ) Λ͍ͬͯΔͷͰɺࣄ લʹහײ • ྫ: ࢠଆͷϞσϧͷࣄલΛBeta(1,1)͔Β
Beta(0.01,0.01)ʹͨ͠ΒɺBF͕0.12͔Β5.72ʹ • Ϟσϧͷ95% HDIࣄલͷӨڹΛ΄΅ड͚ͳ͍ • ॆͳྔͷσʔλ͕͋ΔͳΒɺϕΠζਪఆϞσϧൺֱͱ ҧͬͯࣄલͷӨڹΛड͚ʹ͍͘
10.6.1 ֤Ϟσϧͷࣄલʹ ฏʹใΛ༩͑Δ͖ • ࣄલͷҧ͍͕BFʹӨڹΛ༩͑ΔɻͲ͏͖͔͢ • σʔλʹج͍ͮͯࣄલΛܾఆ͢Δ • ֤ϞσϧͰɺಉ͡σʔλʹج͍ܾͮͯΊΔ •
ྫ: 100ճத65ճද͕ग़ͨίΠϯ͛ • σʔλͷ10%(10ճத6ճද)ΛͬͯࣄલΛิਖ਼ • Beta(1, 1) → Beta(1+6, 1+4) • BF͕҆ఆ͢Δ