Share
Embed
Transcript
52 slides
-
"DUJPOBOE1FSDFQUJPOBT%JWFSHFODF.JOJNJ[BUJPO • 4VCNJUUFEPO4FQ W MBTUSFWJTFE0DU W • ஶऀਞ͕݁ߏ͍͢͝ʢ(PPHMF#SBJO 6$-
%FFQ.JOE 5SPOUPʣ • IUUQTBSYJWPSHBCT • *$-3VOEFSSFWJFXIUUQTPQFOSFWJFXOFUGPSVN JE+C"RTGC:T+Z ॻࢽใ 1MB/FU%SFBNFSʢम࢜Ϙε͕'SJTUPOʣ ࣗ༝ΤωϧΪʔݪཧʢ'&1ʣ -BZFS/PSN"EBNʜ %FFQ.JOEͰ͍Ζ͍Ζ -
ѻ͏༰͕͗ͯ͢͜ͷൃදͰ·ͱΊ͖Εͳ͍ͷͰ ࡉ͔͍దٓࢿྉΛࢀর͍ͯͩ͘͠͞ • $POUSPMBT*OGFSFODFIUUQTBSYJWPSHBCT • ླ͞Μ3-ΞʔΩʢࠓલʣɼླ͞Μ%-ྠಡձɼ ୩ޱ͘ΜαϚʔεΫʔϧ • 'SFF&OFSHZ1SJODJQMFʢ'&1ʣɾBDUJWFJOGFSFODF •
Θ͔Γ͍ࣗ͢༝ΤωϧΪʔݪཧʢүଜ࠸͞Μʣ • հ͞ΕΔͦΕͧΕͷݚڀͷৄࡉຊจͷSFGFSFODFࢀর ຊൃදʹ͍ͭͯ -
ೖྗͷ֬ม ɼͦΕҎ֎ͷʢજࡏʣม ύϥϝʔλ • ࠷దԽͷաఔͰมߋ͢Δ͜ͱ͕Ͱ͖Δͷશͯ • ྫʣදݱʹؔ͢Δे౷ܭྔɼϞσϧͷύϥϝʔλɼํࡦͷύϥϝʔλ ࣮ࡍͷ
ʢBDUVBMEJTUSJCVUJPOʣ • ੜաఔ Λදݱ • ࣮ࡍͷະͷ߹͋Δɹྫʣσʔλ • ύϥϝʔλ ͷӨڹΛड͚ͯมԽ͢Δ߹͋Δ λʔήοτͷ • γεςϜͷؔ͢Δ·͍͠ઃఆʢQSFGFSFODFʣΛදݱ • ʢͪΌΜͱॻ͔Εͯͳ͍͕ʣͬͪ͜ύϥϝʔλ ͷӨڹΛड͚Δ x z ϕ pϕ x, z ∼ pϕ (x, z) ϕ τ(x, z) ϕ ֬มͷදه -
ҙ • Ҏ߱ग़ͯ͘Δظ ͰظΛͱͬͨͷͱ͢Δ ͭ·Γɼ • ࣮ࡍʹܥ͔ΒಘΒΕΔαϯϓϧΛͬͯਪఆͰ͖Δ • ύϥϝʔλ
ʹґଘ pϕ E [f(x, z)] = ∫ f(x, z)pϕ (x, z)dxdz ϕ ֬มͷදه -
ύϥϝʔλ ΛมԽͤͯ͞ɼશͯͷมʹؔ͢Δ ࣮ࡍͷ ΛͰ͖Δ͚ͩλʔήοτ ʹ͚ۙͮΔ ͱͯ͠ఆࣜԽ • SFWFSTF,-JOGPSNBUJPOQSPKFDUJPOͱݺΕΔ •
ʢ༨ஊʣSFWFSTF,-WTGPSXBSE,-ͷେࣄ • Ϟσϧʢ͚ͩʣͰͳ͘ੜաఔΛදݱͯ͠Δ͜ͱʹҙ • Ұ෦ਅͷͰະɼҰ෦ύϥϝʔλ ʹΑΓมԽ͠͏Δ • ྫʣදݱֶशͷ߹ɼ σʔλͱ৴೦ͷಉ࣌ɼ જࡏมϞσϧ • ྫʣ੍ޚͷ߹ɼ ݱࡏͷํࡦͰͷيಓͷɼ يಓͷVUJMJUZ ϕ pϕ τ minϕ KL [pϕ (x, z)∥τ(x, z)] pϕ ϕ pϕ τ pϕ τ +PJOU,-.JOJNJ[BUJPO -
+PJOU,-ͷ࠷খԽɼೖྗ ͱજࡏม ͷ QSFGFSFODFʢ·͠͞ʣͱ૬ޓใྔΛ૿Ճͤ͞Δ͜ͱΛࣔ͢ • -BUFOUQSFGFSFODF • 7BSJBUJPOBMGSFFFOFSHZ • *OQVUQSFGFSFODF
͜ͷੑ࣭ʹΑͬͯɼطଘͷදݱֶशͱ୳ࡧͷతؔΛઆ໌Մೳ x z *OGPSNBUJPO#PVOET -
+PJOU,-Λղ • ୈ߲ɿજࡏมͷ৴೦ Λ·͍͠ ʹ͚ۙͮΔ੍ • ୈ߲ɿ૬ޓใྔ ͷมԼք •
• ૬ޓใྔͷԼքͷ࠷খԽ㱺૬ޓใྔͷ࠷େԽ • ॊೈͳ ͷΛ͏΄ͲλΠτͳԼք KL [pϕ (x, z)∥τ(x, z)] KPJOUEJWFSHFODF = EKL [pϕ (z ∣ x)∥τ(z)] SFBMJ[JOHMBUFOUQSFGFSFODFT − E [ln τ(x ∣ z) − ln pϕ (x)] JOGPSNBUJPOCPVOE pϕ (z|x) τ(z) I[x; z] I[x; z] ≥ I[x; z] − EKL [p(x ∣ z)∥τϕ (x ∣ z)] = E [ln τϕ (x ∣ z) − ln p(x)] τϕ (x|z) -BUFOU1SFGFSFODF *OGPSNBUJPO#PVOET -
• ୈ߲ ͷղऍ • ͷ࠷େԽʢෛͷ࠷খԽʣೖྗΛਖ਼͘͠༧ଌͰ͖ΔજࡏมΛ ୳ׂ͢ • ͷ࠷খԽଟ༷ͳೖྗΛ୳ׂ͢ E [ln
τ(x ∣ z) − ln pϕ (x)] ln τ(x|z) pϕ (x) -BUFOU1SFGFSFODF *OGPSNBUJPO#PVOET -
ΤʔδΣϯτ͕ೖྗ ΛมߋͰ͖ͳ͍߹ɼ MBUFOUQSFGFSFODFͷ ͷ߲ύϥϝʔλԽ͞Εͳ͍ʢఆʣ • ྫʣݻఆͷσʔληοτ͔Βͷֶश ͜ͷͱ͖ɼઌ΄Ͳͷతؔมਪʹ͓͚Δࣗ༝ΤωϧΪʔ ʢ&-#0ʣʹରԠ •
ͰೖྗΛ࠶ߏ͠ͳ͕Βɼ Λࣄલ ʹ͚ۙͮΔ x pϕ (x) min ϕ {EKL [pϕ (z ∣ x)∥τ(z)] − E [ln τ(x ∣ z)]} τ(x|z) pϕ (z|x) τ(z) 7BSJBUJPOBM'SFF&OFSHZ *OGPSNBUJPO#PVOET -
+PJOU,-ͷଞͷղ • ୈ߲ɿೖྗͷ͖݅ Λ·͍͠ ʹ͚ۙͮΔ • ୈ߲ɿ૬ޓใྔ ͷมԼք •
ࠓճજࡏۭؒͰදݱʢ Ͱ͚͖݅ͮͯͬ͞ͱಉ༷ͳٞͰٻ·Δʣ • ೖྗΛ؍ଌͨ͠ޙͷ৴೦ ͱ؍ଌ͢Δલͷ৴೦ ͷࠩʢใήΠϯʣΛදݱ • Լք ͕࣮ࡍͷ͖݅ ΛΑۙ͘ࣅ͍ͯ͠Δ΄ͲλΠτ 㱺มͷؔΛֶश͢Δ΄Ͳ૬ޓใྔΛ࠷େԽʢදݱྗ๛͔ͳ Λ͏ͱ༗རʣ ૬ޓใྔͷ࠷େԽɼೖྗͷྑ͍જࡏදݱͷֶशͱɼજࡏදݱʹͱͬͯ༗ӹͳೖྗͷ ୳ࡧͷ྆ํΛઆ໌ʂ KL [pϕ (x, z)∥τ(x, z)] KPJOUEJWFSHFODF = EKL [pϕ (x ∣ z)∥τ(x)] SFBMJ[JOHJOQVUQSFGFSFODFT − E [ln τ(z ∣ x) − ln pϕ (z)] JOGPSNBUJPOCPVOE pϕ (x|z) τ(x) I[x; z] z τ(z|x) pϕ (z) τ(z|x) p(z|x) τ(z|x) *OQVU1SFGFSFODF *OGPSNBUJPO#PVOET -
ΤʔδΣϯτͷ·͍͠ೖྗͷΛදݱ͢Δͷ • ͭ·ΓΤʔδΣϯτ ʹऩଋͤ͞Α͏ͱ͢Δ • %JWFSHFODFNJOJNJ[BUJPOʹΑͬͯΤʔδΣϯτࣗͷϞσϧΛͬ ͯ༧ଌͰ͖ΔΑ͏ͳೖྗΛݟ͚ͭΑ͏ͱ͢Δ • ࣗͷϞσϧͷͰ༧ଌͰ͖ͳ͍ೖྗΛආ͚Α͏ͱ͢Δ •
ใु ʹରͯ͠ ͱ͢ΕλεΫͷใुΛಋೖՄೳ • ใुͱͯ͠पลΛଧͪফ߲͢Λ༩͑ͯɼೖྗͷ·͠͞ͷ߲Λ औΓআ͘͜ͱՄೳ • ͜ͷลΓͰઆ໌ τ(x) τ(x) r(x) exp (r(x)) *OQVUQSFGFSFODF .PEFMBT1SFGFSFODF -
• λʔήοτΛϞσϧͱͯ͠ղऍ͢ΔͱɼEJWFSHFODFNJOJNJ[BUJPO ϔϧϜϗϧπͷQFSDFQUJPOBTJOGFSFODFͱҰக • ·͠͞ΛϞσϧͱදݱ͢Δͷࣗ༝ΤωϧΪʔݪཧʢ'&1ʣ BDUJWFJOGFSFODFͷൃ͔Βணʢ"QQFOEJY" • ֮ͱߦಈಉ͡KPJOU,-Λ࠷খԽ͍ͯ͠Δ͕ɼҟͳΔมʹӨڹ •
֮ೝࣝʹج͍ͮͯɼදݱʹؔ͢Δ৴೦ʹӨڹ • ߦಈදݱʹج͍ͮͯɼೖྗʹӨڹ "DUJPO1FSDFQUJPO$ZDMF .PEFMBT1SFGFSFODF -
%JWFSHFODFNJOJNJ[BUJPOͷදݱֶश୳ࡧʹؔ࿈͢Δ૬ޓใྔͷԼքදݱྗ๛͔ͳ λʔήοτΛ༻͍Δ΄ͲλΠτʢʣ • Ϟσϧ͕༩͑ΒΕͨݩͰͷೖྗͷपลͷNBUDIJOH • ͜ͷͱ͖ɼΤʔδΣϯτೖྗΛेʹ༧ଌͰ͖ͯɼ ֎ཚʹରԠͰ͖Δࣗવͳฏߧঢ়ଶʢFDPMPHJDBMOJDIFʣʹऩଋ ࣅͨΑ͏ͳ֓೦ͱͯ͠TVSQSJTFNJOJNJ[BUJPO͕͋Δ • Ϟσϧ͕༩͑ΒΕͨݩͰͷೖྗͷपลͷ࠷େԽ
• ͜ͷͱ͖ɼOJDIFTFFLJOH<'SJTUPO >ͱݺΕΔ • ֎ཚ͕ͳ͍ͱҰ୴୳ࡧͨ͜͠ͱͷ͋Δࣗ໌ͳղʹؕΔ • ʢদౢղऍɿͨͿΜ͜Εʮ҉͍෦ʯͱݴΘΕͯΔͷʣ %JWFSHFODFNJOJNJ[BUJPOͩͱɼೖྗͷपลΛ߹ΘͤΑ͏ͱ͢ΔͨΊɼ ༧ଌͰ͖ΔશͯͷೖྗΛΧόʔ͢ΔΑ͏ͳ͍OJDIFʹͳΔΑ͏ʹଅ͞ΕΔ • දݱྗ๛͔ͳੈքϞσϧΛ༻͍Δͱ༧ଌՄೳੑ͕ߴ·Γ͍OJDIFʹʢλεΫใुՃతʣ /JDIF4FFLJOH .PEFMBT1SFGFSFODF -
աڈͷೖྗ Λ؍ଌ͠ɼকདྷͷೖྗ Λ ؍ଌ͢ΔલͷKPJOU,-ͷ࠷దԽΛߟ͑Δ • ͷ૬ޓใྔͷԼքΛࣜมܗ x< x> E [ln
τ(z ∣ x) − ln pϕ (z)] JOGPSNBUJPOCPVOE = E [ln τ(z ∣ x) − ln pϕ (z ∣ x<) + ln pϕ (z ∣ x<) − ln pϕ (z)] ≥ E [ln τ(z ∣ x) − ln pϕ (z ∣ x<)] GVUVSFJOGPSNBUJPOCPVOE + E [ln τ (z ∣ x<) − ln pϕ (z)] QBTUJOGPSNBUJPOCPVOE ࣌ܥྻͷ֦ு -
૬ޓใྔͷԼքͷࣜมܗΛར༻ͯ͠ ࠷খԽ͍ͨ͠KPJOU,- ͷ্ք͕ٻ·Δ • +PJOU,-ɼաڈͷೖྗͷ༗༻ͳදݱͷֶशͱকདྷͷ༗༻ͳೖྗͷ ୳ࡧͷ྆ํΛಉ࣌ʹදݱͰ͖͍ͯΔ KL [pϕ (x,
z)∥τ(x, z)] KL [pϕ (x, z)∥τ(x, z)] ≤ EKL [pϕ (z ∣ x<) ∥τ(z)] SFBMJ[JOHQBTUMBUFOUQSFGFSFODFT − E [ln τ (x< ∣ z) − ln pϕ (x<)] SFQSFTFOUBUJPOMFBSOJOH + EKL [pϕ (x> ∣ x< , z) ∥τ (x> ∣ x<)] SFBMJ[JOHGVUVSFJOQVUQSFGFSFODFT − E [ln τ(z ∣ x) − ln pϕ (z ∣ x<)] FYQMPSBUJPO ࣌ܥྻͷ֦ு -
ʢิʣSFWJTJPO W ͰՃ͞Εͨઆ໌ ʹҰ؍ଌ͞Εͳ͍ͷͱɼ࣌ؒͷܦաͱͱʹ ؍ଌ͞ΕΔͷ͕͋Δ • Ұ؍ଌ͞Εͳ͍ɿજࡏঢ়ଶͷਪఆϞσϧύϥϝʔλʣ • ࣌ؒܦաͱͱʹ؍ଌɿ֬తͳߦಈεΩϧ •
͜ΕΒͷมΛબ͢Δ͜ͱɼຊҼՌతͳհೖʹͳΔͷͰ ɼະ؍ଌͷજࡏม ͱɼ؍ଌ͞Εͨજࡏม Ͱ͚݅ͮ ΒΕͨ Ͱׂ͖͕ͩ͢ɼ؆୯ͷͨΊʹলུ͍ͯ͠Δ z z z> EP(z< ) z> -
ʢิʣSFWJTJPO W ͰՃ͞Εͨઆ໌ ʹҰ؍ଌ͞Εͳ͍ͷͱɼ࣌ؒͷܦաͱͱʹ ؍ଌ͞ΕΔͷ͕͋Δ • Ұ؍ଌ͞Εͳ͍ɿજࡏঢ়ଶͷਪఆϞσϧύϥϝʔλʣ • ࣌ؒܦաͱͱʹ؍ଌɿ֬తͳߦಈεΩϧ •
͜ΕΒͷมΛબ͢Δ͜ͱɼຊҼՌతͳհೖʹͳΔͷͰ ɼະ؍ଌͷજࡏม ͱɼ؍ଌ͞Εͨજࡏม Ͱ͚݅ͮ ΒΕͨ Ͱׂ͖͕ͩ͢ɼ؆୯ͷͨΊʹলུ͍ͯ͠Δ z z z> EP(z< ) z> -
"DUVBMɿ 5BSHFUɿ ྫʣ#//Λ༻͍ͨڭࢣ͋Γֶश • ೖྗɿը૾ ɼΫϥε •
σʔληοτͷHMPCBMͳදݱͱͯ͠જࡏతͳύϥϝʔλ Λਪ pϕ (x, y, w) = pϕ (w) ⏟ CFMJFG ∏ i p (xi , yi) EBUB τ(x, y, w) ∝ τ(w) ⏟ QSJPS ∏ i τ (yi ∣ xi , w) MJLFMJIPPE x = {xi } y = {yi } w มਪʢ7BSJBUJPOBM*OGFSFODFʣ -
+PJOU,-ʹͦΕͧΕೖ͢Δͱ • త͕ؔࣗ༝ΤωϧΪʔʢ&-#0ʣʹͳΔ Λσϧλ ͱ͢Δͱ • ͭ·Γ࠷ਪఆʹͳΔʢλʔήοτΛ ͱͨ͠ͱ͖ͱՁʣ
KL [pϕ ∥τ] = KL [pϕ (w)∥τ(w)] DPNQMFYJUZ − E[ln τ(y ∣ x, w)] BDDVSBDZ + E[ln p(x, y)] DPOTUBOU pϕ (w) pϕ (w) → δϕ (w) ≐ {1JGw = ϕFMTF0} KL [pϕ (w)∥τ(w)] DPNQMFYJUZ − E[ln τ(y ∣ x, w)] BDDVSBDZ → ln τ(ϕ) − E[ln τ(y ∣ x, ϕ)] DPNQMFYJUZ ≐ E [−ln τϕ (y ∣ x)] QBSBNFUFSJ[FEUBSHFU τϕ (y|x) มਪʢ7BSJBUJPOBM*OGFSFODFʣ -
"DUVBMɿ 5BSHFUɿ ྫʣ7"& • ೖྗɿը૾ • ରԠ͢Δજࡏม
Λਪ pϕ (x, z) = ∏ i p (xi) ⏟ EBUB pϕ (zi ∣ xi) FODPEFS τϕ (x, z) = ∏ i τϕ (xi |zi) EFDPEFS τ (zi) ⏟ QSJPS x = {xi } z = {zi } ঈ٫ਪʢ"NPSUJ[FE*OGFSFODFʣ -
+PJOU,-ʹͦΕͧΕೖ͢Δͱ • త͕ؔࣗ༝ΤωϧΪʔʢ&-#0ʣʹͳΔ • ༧ଌͷ߲ʢୈ߲ʣ͕૬ޓใྔͷԼք • දݱ͕ೖྗʹؔͯ͠ҙຯΛ࣋ͭΑ͏ʹଅ͢ KL [pϕ
∥τϕ] = E [ln τϕ (x ∣ z) − ln p(x)] JOGPSNBUJPOCPVOEʢদౢෛ߸͕͍ΔͷͰʁʣ + EKL [pϕ (z ∣ x)∥τ(z)] DPNQMFYJUZ ঈ٫ਪʢ"NPSUJ[FE*OGFSFODFʣ -
"DUVBMɿ 5BSHFUɿ ྫʣ)..Ͱকདྷͷೖྗ ͕ܽଛ͍ͯ͠Δ߹ • ೖྗ •
ରԠ͢Δજࡏม Λਪ pϕ (x, z) = p (x> , x<) EBUB pϕ (z ∣ x<) CFMJFG τϕ (x, z) = τϕ (x< ∣ z) MJLFMJIPPE τϕ (x> ∣ z) QSFEJDUJPO τ(z) ⏟ QSJPS x> x = {x< , x> } z = {zi } কདྷͷೖྗʢ'VUVSF*OQVUTʣ -
+PJOU,-ʹͦΕͧΕೖ͢Δͱ • ͱͯ͠কདྷͷೖྗ ͕࠷దԽʹ ؔΘΒͳ͍Α͏ʹ͍ͯ͠ΔʢVODPOUSPMMFEGVUVSFʣ KL [pϕ ∥τϕ] =
KL [pϕ (x< , z) ∥τϕ (x< , z)] WBSJBUJPOBMJOGFSFODF + EKL [p (x> ∣ x<) ∥τϕ (x> ∣ z)] VODPOUSPMFEGVUVSF τϕ (x> ∣ x< , z) = τϕ (x> ∣ x<) x> ঈ٫ਪʢ"NPSUJ[FE*OGFSFODFʣ -
"DUVBMɿ 5BSHFUɿ ྫʣܾఆతͳ੍ޚΛ͢Δ߹ • ೖྗͷܥྻ ΤʔδΣϯτ͕ύϥϝʔλ ΛมԽͤͯ͞ ෦తʹม͑ΒΕΔྫʣܾఆతͳํࡦɼ੍ޚଇɼϓϥϯʜ
pϕ (x) = ∏ t pϕ (xt ∣ x1:t−1) DPOUSPMMFEEZOBNJDT τ(x) = ∏ t τ (xt ∣ x1:t−1) QSFGFSFODFT x = {xt } ϕ ʢܾఆతͳʣ੍ޚ -
+PJOU,-ʹͦΕͧΕೖ͢Δͱ • QSFGFSFODFͷରͱೖྗͷΤϯτϩϐʔͷ࠷େԽ • $G .BY&OU3- ߦಈͷΤϯτϩϐʔ࠷େԽ •
1SFGFSFODFͷઃఆ • ɿ,-DPOUSPM<,BQQFO > • ɿ,-SFHVMBSJ[FEDPOUSPM<5PEPSPW > • ɿFYQFDUFESFXBSE<4VUUPO > • ͜ΕDVSJPTJUZͷ߲͕ফ͑ΔΑ͏ͳઃఆʢ·ΕͳೖྗΛ໌ࣔతʹEJTDPVSBHFͯ͠୳ࡧΛ੍ݶʣ • ೖྗͷΤϯτϩϐʔͷਪఆɿٖΧϯτɼ4LFX'JUɼ3/%ɼ*$.ʜ KL [pϕ ∥τ] = − ∑ t E [ln τ (xt ∣ x1:t−1)] FYQFDUFEQSFGFSFODFT + H [pϕ (xt ∣ x1:t−1)] DVSJPTJUZ τ (xt ∣ x1:t−1) ∝ exp (r (xt)) τ (xt ∣ x1:t−1) ∝ exp (r (xt)) τ′ (xt ∣ x1:t−1) τ (xt ∣ x1:t−1) ∝ exp (r (xt)) pϕ (xt |x1:t−1 ) ʢܾఆతͳʣ੍ޚ -
"DUVBMɿ 5BSHFUɿ ྫʣ֬తͳ੍ޚΛ͢Δ߹ • NBY&OU3-ɾ3-BTJOGFSFODFͱ͍͏ • ೖྗͷܥྻ ɼߦಈͷܥྻ
• աڈͷೖྗߦಈ ͕؍ଌ͞Ε͍ͯΔઃఆ pϕ (x, a) = ∏ t p (xt ∣ x1:t−1 , a1:t−1) FOWJSPONFOU pϕ (at ∣ x1:t , a1:t−1) QPMJDZ τ(x, a) ∝ ∏ t exp (r (xt)) SFXBSE p (xt ∣ x1:t−1 , a1:t−1) FOWJSPONFOU τ (at) ⏟ BDUJPOQSJPS x = {xt } a = {at } ax< .BY&OUSPQZ3- .BY&OU3- -
+PJOU,-ʹͦΕͧΕೖ͢Δͱ • ߦಈۭؒͰͷ੍ͱظใुͷ߲ʹͳΔ • λʔήοτʹڥͷμΠφϛΫε͕ೖΔͷͰͷDVSJPTJUZͷ߲ଧͪ ফ͞ΕΔ • ߦಈͷࣄલ
• Ұ༷ɿ42-ɼ4"$ • աڈͷೖྗҎલͷλεΫͷࣝΛ౷߹ɿ%JTUSBM KL [pϕ ∥τ] = ∑ t EKL [pϕ (at ∣ x1:t , a1:t−1) ∥τ (at)] DPNQMFYJUZ − E [r (xt)] FYQFDUFESFXBSE τ(a) .BY&OUSPQZ3- .BY&OU3- -
"DUVBMɿ 5BSHFUɿ ྫʣ֬తͳ੍ޚʹ͓͚ΔHFOFSBMJ[FEFNQPXFSNFOU • աڈͷೖྗߦಈ ͕؍ଌ͞Ε͍ͯΔઃఆ • ೖྗ͔ΒߦಈΛ༧ଌ͢ΔλʔήοτͷʢSFWFSTFQSFEJDUPSʣ
pϕ (x, a) = ∏ t p (xt ∣ x1:t−1 , a1:t−1) FOWJSPONFOU pϕ (at ∣ x1:t , a1:t−1) QPMJDZ τ(x, a) ∝ ∏ t τϕ (at ∣ x1:T , a1:t−1) SFWFSTFQSFEJDUPS ax< &NQPXFSNFOU -
+PJOU,-ʹͦΕͧΕೖ͢Δͱ • (FOFSBMJTFEFNQPXFSNFOU૬ޓใྔ ͷԼք KL [pϕ ∥τϕ] = EKL[p(x
∣ a)∥τ(x)] DPOUSPM − E [ln τϕ (a ∣ x) − ln pϕ (a)] HFOFSBMJ[FEFNQPXFSNFOU E [ln τϕ (a ∣ x) − ln pϕ (a)] HFOFSBMJ[FEFNQPXFSNFOU ≥ ∑ t E[ln τϕ (at ∣ x, a1:t−1) EFDPEFS − ln pϕ (at ∣ a1:t−1) TPVSDF ] I[a; x] = E [ln pϕ (a|x) − ln pϕ (a)] &NQPXFSNFOU -
"DUVBMɿ 5BSHFUɿ ྫʣ࣌ؒతʹநԽ͞ΕͨTLJMMͰ͚݅ͮΒΕͨํࡦΛֶश • ೖྗͷܥྻ ɼߦಈͷܥྻ ɼεΩϧͷܥྻ
• εΩϧݻఆͷʢ͔աڈͷೖྗͷؔʣ͔Βબ • ߦಈաڈͷೖྗͱݱࡏͷεΩϧʹैͬͯબ pϕ (x, a, z) ≐ T/K ∏ k=1 pϕ (zk) BCTUSBDUQPMJDZ T ∏ t=1 pϕ (at ∣ x1:t , a1:t−1 , z⌊t/K⌋) QPMJDZ p (xt ∣ x1:t−1 , a1:t−1) FOWJSPONFOU τϕ (x, a, z) ∝ T/K ∏ k=1 τϕ (zk ∣ x) SFWFSTFQSFEJDUPS T ∏ t=1 τ (at) ⏟ BDUJPOQSJPS x = {xt } a = {at } z = {zt } εΩϧͷൃݟʢ4LJMM%JTDPWFSZʣ -
+PJOU,-ʹͦΕͧΕೖ͢Δͱ • 4LJMMEJTDPWFSZεΩϧ ͱೖྗ ͷ૬ޓใྔ ͷԼք • ΤʔδΣϯτଟ༷ͳೖྗܥྻΛ࣮ݱ͠ͳ͕ΒɼҟͳΔεΩϧͰܥ ྻ͕ॏͳΒͳ͍Α͏ʹεΩϧΛֶश͢Δ
• ྫʣ%*:"/<&ZTFOCBDI >ɼ%"%4<4IBSNB > KL [pϕ ∥τϕ] = EKL[p(x ∣ a)∥τ(x)] DPOUSPM + EKL [pϕ (a ∣ x, z)∥τ(a)] DPNQMFYJUZ − E [ln τϕ (z ∣ x) − ln pϕ (z)] TLJMMEJTDPWFSZ z x I[z; x] εΩϧͷൃݟʢ4LJMM%JTDPWFSZʣ -
"DUVBMɿ 5BSHFUɿ ྫʣ&YQFDUFEJOGPSNBUJPOHBJOΛ࠷େԽ͢ΔߦಈΛબ • ֎తͳใु͕ͳ͍߹ʹੈքΛޮతʹֶश͢ΔͨΊ • ೖྗɿ
• HMPCBMͳදݱΛ࣋ͭજࡏతͳύϥϝʔλɿ pϕ (x, w) = pϕ (w) ⏟ CFMJFG ∏ t pϕ (xt ∣ x1:t−1) DPOUSPMMFEEZOBNJDT τ(x, w) = τ(w) ⏟ QSJPS ∏ t τ (xt ∣ x1:t−1 , w) MJLFMJIPPE x = {xi } w *OGPSNBUJPO(BJO -
+PJOU,-ʹͦΕͧΕೖ্ͯ͠քΛऔΔ • ͱҟͳΓɼະདྷͷೖྗʹӨڹͰ͖Δ • աڈͷೖྗʹ͍ͭͯ༗ӹͳදݱΛֶश͠ɼະདྷͷදݱʹؔͯ͠༗ӹʹͳΔΑ͏ͳೖྗΛ୳ࡧ͢Δ • ϞσϧύϥϝʔλʹΑͬͯΤʔδΣϯτ͕ڥͷϧʔϧΛݟ͚ͭΔΑ͏ʹ͢Δٞ •
BDUJWFJOGFSFODF<'SJTUPO >ɼ7*.&<)PVUIPPGU >ɼ."9<4IZBN ^ɼ1MBO&YQMPSF<4FLFS > KL [pϕ ∥τϕ] ≤ EKL [pϕ (w ∣ x<) ∥τ(w)] TJNQMJDJUZ − E [ln τϕ (x< ∣ w) − ln pϕ (x<)] SFQSFTFOUBUJPOMFBSOJOH +EKL [pϕ (x> ∣ x< , w) ∥τϕ (x> ∣ x<)] DPOUSPM − E [ln τϕ (w ∣ x) − ln pϕ (w ∣ x<)] JOGPSNBUJPOHBJO E [ln τϕ (w ∣ x) − ln pϕ (w ∣ x<)] JOGPSNBUJPOHBJO ≥ ∑ t′ >t E [ln τϕ (w ∣ x1:t′ ) − ln pϕ (w ∣ x1:t′ −1)] JOUSJOTJDSFXBSE *OGPSNBUJPO(BJO -
ͭͷͷEJWFSHFODFͷ࠷খԽͱͯ͠ͷఆࣜԽ • දݱֶशΛ,-ͷ࠷খԽͱͯ͠ղऍɿ5IFS.-<"MFNJ > • ฿ֶशͰֶशͨ͠ํࡦͱΤΩεύʔτͷEJWFSHFODF࠷খԽ <(IBTFNJQPVS >ʢ$P3-ʣ • ຊจCBDLXBSE
SFWFSTF ,-ͷ࠷దԽͱͯ͠ ଟ͘ͷͷతؔΛ౷Ұ %JWFSHFODF.JOJNJ[BUJPO -
ຊจͷΈ'&1ͷӨڹΛड͚͍ͯΔ • '&1ΤʔδΣϯτͱڥͷμΠφϛΫεΛ4%&ͱͯ͠දݱ • ಛʹBDUJWFJOGFSFODFͷղऍΛར༻ • "DUJWFJOGFSFODFͰϞσϧʹؔ͢Δೖྗͷ֬Λ࠷େԽ͢Δ͕ɼ ຊจͰೖྗͷEJWFSHFODFͷNJOJNJ[BUJPOʢNBUDIJOHʣ • "DUJWFJOGFSFODFߦಈʹؔͯ͠ͷΈ୳ࡧͷ߲Λ࠷దԽ͍ͯ͠Δ
• ͜ΕຊจͷΈͰߦಈͷಛఆͷࣄલͷઃఆʹରԠ • (FOFOBSBMJ[FE'SFF&OFSHZ<1BSS >ͷత͕͍͕ؔۙɼΤϯτ ϩϐʔ߲͕ώϡʔϦεςΟοΫʹಋ͔Ε͍ͯΔ "DUJWF*OGFSFODF -
3-ͷೖྗͱߦಈͷ,-࠷খԽʹΑΔఆࣜԽΑ͘ΒΕ͍ͯΔ • ྫʣ$POUSPMBT*OGFSFODF<-FWJOF > • ຊจ͜ͷจ຺ʹଇͬͯજࡏදݱΛ࣋ͭΤʔδΣϯτʹ֦ு • աڈͷೖྗʹؔ͢Δมਪͱະདྷͷೖྗʹର͢Δ୳ࡧΛಋ͍ͨ %JWFSHFODFNJOJNJ[BUJPOೖྗͷΤϯτϩϐʔਖ਼ଇԽͱؔ࿈ •
4-"$<-FF >දݱֶशͱ੍ޚΛΈ߹Θͤͨݚڀ • ຊจҰൠతͳΈ͔ΒΤϯτϩϐʔਖ਼ଇԽ߲Λಋ͍ͨ $POUSPMBT*OGFSFODF $B* -
ຊจͰKPJOU,-ͷ࠷খԽͱ͍͏؍͔ΒΤʔδΣϯτͷ ߦಈͱ֮ʹؔ͢Δ౷ҰతͳతؔΛಋग़ͨ͠ • λʔήοτͷΤʔδΣϯτ͕දݱΛਪ͢Δ֬ϞσϧͰɼ ·͍͠γεςϜͷઃఆΛදݱ͢Δͷ • ͜ͷతؔͷͱͰɼͲΜͳજࡏදݱ୳ࡧͷ߲Λ͏ • +PJOU,-Λ༻͍ͯ͜Ε·Ͱͷݚڀͷ༷ʑͳతؔΛಋग़Ͱ͖Δ ౷Ұతͳ؍ΤʔδΣϯτͷઃܭࢦʹͳΓ͏Δ
• తͳΤʔδΣϯτΛ࡞͢Δ্Ͱɼදݱྗ๛͔ͳੈքϞσϧΛ λʔήοτͱͯ͠༻͍Δ͜ͱ͕༗ޮ͔͠Εͳ͍ ·ͱΊ