Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ガウス混合モデルにおける推論 (ベイズ推論による機械学習)

tanimutomo
March 05, 2019
23

ガウス混合モデルにおける推論 (ベイズ推論による機械学習)

須山さんのベイズ緑本(ベイズ推論による機械学習)の4-4節, ガウス混合モデルにおける推論の輪読資料.

tanimutomo

March 05, 2019
Tweet

Transcript

  1. Ψ΢εࠞ߹Ϟσϧʹ͓͚Δਪ࿦ w ࣄલ஌ࣝ w Ψ΢εࠞ߹Ϟσϧ w ΪϒεαϯϓϦϯά w ม෼ਪ࿦ w

    ่յܕΪϒεαϯϓϦϯά w ؆қ࣮ݧ w ʢϏοΫσʔλͱϕΠζֶशʣ 2
  2. ଟ࣍ݩΨ΢ε෼෍ w Ψ΢ε෼෍ͷଟ࣍ݩόʔδϣϯ w ͭͷ࣍ݩʹண໨͢ΔͱɼͨͩͷΨ΢ε෼෍ 9 N(x|µ, ⌃) = 1

    p (2⇡)D|⌃| exp{ 1 2 (x µ)T ⌃ 1(x µ)} <latexit sha1_base64="N6rCb+fKV8k16U9bFvwWt4R3JjQ=">AAACpnicfVFNbxMxEPUuHw0ppQGOXEZElRKpiXYDUrkgRcABLlWhTVMpToLX8aZW7d3F9qJGrn8af4Ib/wbvNlW/ECNZejPzRm/8JikE1yaK/gThg4ePHm80njQ3n2492249f3Gs81JRNqK5yNVJQjQTPGMjw41gJ4ViRCaCjZOzj1V//JMpzfPsyKwKNpVkmfGUU2J8ad76hSUxp5QIu+86NU5Se+7gAq4SLEu3e50d8qUkrgvvAaeKUBs7i/UPZWxngAvenX2qRmsSXDgH7LwAbHvX5IGDmzq9Wzrd2RFcScxsL/4vF7Cbt9pRP6oD7oN4DdpoHQfz1m+8yGkpWWaoIFpP4qgwU0uU4VQw18SlZgWhZ2TJJh5mRDI9tbXNDnZ8ZQFprvzLDNTVmxOWSK1XMvHMak99t1cV/9WblCZ9N7U8K0rDMnoplJYCTA7VzWDBFaNGrDwgVHG/K9BT4g01/rJNb0J898v3wfGgH7/pR1/ftocf1nY00Cv0GnVQjPbQEH1GB2iEaNAOvgTfgsOwE+6Ho3B8SQ2D9cxLdCvC738BGWvP9Q==</latexit>
  3. ଟ࣍ݩΨ΢ε෼෍ͷࣄޙ෼෍ w ฏۉͱਫ਼౓ߦྻ͕ͲͪΒ΋ະ஌ͷ৔߹ʹ͸ɼΨ΢εɾ΢Ο γϟʔτ෼෍͕ڞ໾ࣄલ෼෍ͱͳΔ w ฏۉʢΨ΢εଆʣͷࣄޙ෼෍ͷ෼ࢄ͸ɼ΢Ογϟʔτͷࣄ ޙ෼෍ʹґଘ͢ΔͨΊɼฏۉʢΨ΢εଆʣΛઌʹܭࢉ͢Δ 10 p(µ, ⇤)

    = N(µ|m, ( ⇤) 1)W(⇤|⌫, W) <latexit sha1_base64="DbJg0J/FlFtWX8YAqdxFPdJ7ieY=">AAACgnicbVFbSzMxEM2u93qr+uhLsAhVtO6qoA8Koi8+iCh8tUK3ltk0q8EkuyRZoaz7Q/xbvvlrNNsu9dJvIHBy5syZySRMONPG8z4cd2Jyanpmdq4yv7C4tFxdWb3TcaoIbZKYx+o+BE05k7RpmOH0PlEURMhpK3y+KPKtF6o0i+U/009oR8CjZBEjYCzVrb4l9UCAeQqjLBBpvoNHtytr0oN8C58OOQI8u85/qfHrSC5saT0IqYFxh4ds17c+I5fWD5dSUzjJ9Lt7K9/qVmtewxsEHgd+CWqojJtu9T3oxSQVVBrCQeu27yWmk4EyjHCaV4JU0wTIMzzStoUSBNWdbLDCHG9apoejWNkjDR6wPysyEFr3RWiVxYj6b64g/5drpyY67mRMJqmhkgwbRSnHJsbFf+AeU5QY3rcAiGJ2VkyeQAEx9tcqdgn+3yePg7v9hn/Q8G4Pa2fn5Tpm0TraQHXkoyN0hi7RDWoigj6dTafh7LmT7rbruwdDqeuUNWvoV7gnX+0mwuk=</latexit>
  4. Ψ΢εࠞ߹Ϟσϧ w Ψ΢εࠞ߹Ϟσϧʹ͓͚Δ؍ଌ෼෍ w σʔλͷੜ੒աఔͦͷ·· w جຊతʹ͸ɼϙΞιϯࠞ߹Ϟσϧͱಉ͡ɽҧ͏ͷ͸ɼଟ࣍ ݩΨ΢ε෼෍͚ͩɽ 19 p(xn

    |sn, µ, ⇤) = K Y k=1 N(xn |µk, ⇤ 1 k )sn,k <latexit sha1_base64="4VWMptUYGe+1sZwx/w+hkwfaC58=">AAACYnicbVFbS8MwFE7rbc7LNn3Uh+AQFHS0KujLQPRFUETBbcIuJU3TLTRNS5KKI/ZP+uaTL/4Qs4uizgMJ3/nOLeeLnzIqleO8Wfbc/MLiUmG5uLK6tl4qVzaaMskEJg2csEQ8+kgSRjlpKKoYeUwFQbHPSMuPLkfx1hMRkib8QQ1T0o1Rn9OQYqQM5ZWH6V4nRmrgh/o59zh8gV+uNO6B8TJz3ZiGAdqHddhJRRJ4Oqq7ee96kosR07f5bJvMi75LvainD918v6elp03bKM+9ctWpOWODs8CdgiqY2p1Xfu0ECc5iwhVmSMq266Sqq5FQFDOSFzuZJCnCEeqTtoEcxUR29ViiHO4aJoBhIszhCo7ZnxUaxVIOY99kjvaQf2Mj8r9YO1PhWVdTnmaKcDwZFGYMqgSO9IYBFQQrNjQAYUHNWyEeIIGwMr9SNCK4f1eeBc2jmntcc+5PqucXUzkKYAvsgD3gglNwDq7AHWgADN6tBWvdKlkfdtGu2JuTVNua1myCX2ZvfwIFBbY+</latexit>
  5. ଟ࣍ݩΨ΢ε෼෍ w ਫ਼౓ߦྻʢڞ෼ࢄߦྻͷٯߦྻʣΛύϥϝʔλͱ͢Δ
 ଟ࣍ݩΨ΢ε෼෍͸ҎԼͷࣜͰද͞ΕΔ w ର਺όʔδϣϯ w ٯߦྻ͕ͳ͘ͳΔͷ͕ϙΠϯτ 20 N(x|µ,

    ⇤) = 1 p (2⇡)D|⇤ 1| exp{ 1 2 (x µ)T ⇤(x µ)} <latexit sha1_base64="eswYZq7MIzzCmkOPt7VRhFRxy2M=">AAACqXicfVHbThsxEPUubYG0lEAfeRk1apWoJNoNSO0LUgQ89CGqQCIhapxEXscLFt4LthcRuf43voE3/qZO2JZb1ZEsnTlz5uKZKBdc6SC48/ylV6/fLK+sVt6+W3u/Xt3Y7KuskJT1aCYyOYiIYoKnrKe5FmyQS0aSSLDT6OJgHj+9YlLxLD3Rs5yNEnKW8phToh01qd7ghOhzSoT5YesLHMXm2sIv+OPgpLDbD17X1Z4S24A9wLEk1ITWYHUptam3cc4b40OX+1c2Ns3QFbMW2HUO2DQfktoWHjdsPmnYGJ9AWeN/KsB2Uq0FrWBh8BKEJaih0o4m1Vs8zWiRsFRTQZQahkGuR4ZIzalgtoILxXJCL8gZGzqYkoSpkVls2sInx0whzqR7qYYF+zjDkESpWRI55XxO9Tw2J/8VGxY6/jYyPM0LzVJ63yguBOgM5meDKZeMajFzgFDJ3axAz4lbpXbHrbglhM+//BL0261wpxUc79Y6++U6VtAW+ojqKERfUQd9R0eoh6j32et6Pa/vf/GP/YH/817qe2XOB/TEfPobxgPRAw==</latexit> lnN(x|µ, ⇤) = { 1 2 (x µ)T⇤(x µ) ln|⇤| + Dln2⇡} <latexit sha1_base64="Wn5waYNRFQtc4OROuSwy0TFzJjw=">AAACqHicfVHbahsxENVub4l7c9rHvAwxgaStza5bSF8KoclDoaG4YMcplmu0sjYRkbSLpC01sr4t/9C3/k20zpbmUjogOHNmDjNzlJWCG5skv6P43v0HDx+trbceP3n67Hl748WxKSpN2YgWotAnGTFMcMVGllvBTkrNiMwEG2fnB3V9/INpwws1tIuSTSU5VTznlNhAzdoXWEsnlMeS2DNKhPvid1Y4y91PD0v4k2BZ+Td/s6MwYk78LnxoYdcFnGtCXepd38N1ffeGfvf7EBrl/7qg2yy1bJqX8Bowt+7QQ1OBPi45YN+atTtJL1kF3AVpAzqoicGs/QvPC1pJpiwVxJhJmpR26oi2nArmW7gyrCT0nJyySYCKSGambmW0h+3AzCEvdHjKwoq9rnBEGrOQWeisDzK3azX5r9qksvn7qeOqrCxT9GpQXgmwBdS/BnOuGbViEQChmoddgZ6R4LkNf1ubkN4++S447vfSt73k67vO/sfGjjW0ibbQDkrRHtpHn9AAjRCNtqPP0TAaxa/iQTyOv121xlGjeYluRJxdAj120L4=</latexit>
  6. ଟ࣍ݩΨ΢ε෼෍ͷڞ໾ࣄલ෼෍ w ڞ໾ࣄલ෼෍ʢΨ΢εɾ΢Ογϟʔτ෼෍ʣ w ٻΊ͍ͨಉ࣌ࣄޙ෼෍ w Ϋϥελม਺ͱͦͷύϥϝʔλɼ֤Ϋϥελͷ෼෍ͷύϥ ϝʔλͷಉ࣌ࣄޙ෼෍ 22 p(µk,

    ⇤k) = N(µk |m, ( ⇤k) 1)W(⇤k |⌫, W) <latexit sha1_base64="aOn36GYoxZm7YUylHACxQNQSirg=">AAACjHicbVHRatswFJW9rU2zrc3Wx72IhUECWWq3gWWUQtmg9GGMDpY4EHvhWpEbEUk2kjwIrr+mf7S3/c3kJKRdmguCo3PvObq6N84408bz/jrus+cv9vZrB/WXr14fHjXevB3qNFeEDkjKUzWKQVPOJB0YZjgdZYqCiDkN4vnXKh/8pkqzVP40i4xGAm4lSxgBY6lJ4z5rhQLMLE6KUOTlZN7Bm/s3azMFy7XxxYolwIvv5ZYC320kouzgVhhTA7tcfhUf/bL94BQ8ctpUVW4yf+giKNuTRtPresvAT4G/Bk20jptJ4084TUkuqDSEg9Zj38tMVIAyjHBa1sNc0wzIHG7p2EIJguqoWA6zxB8sM8VJquyRBi/Zx4oChNYLEdvKqkW9navIXblxbpJ+VDCZ5YZKsnooyTk2Ka42g6dMUWL4wgIgitleMZmBAmLs/up2CP72l5+C4WnXP+t6P3rNyy/rcdTQO/QetZCPPqFLdI1u0AAR58A5cfrOZ/fQ7bnn7sWq1HXWmmP0X7hX/wCX5cZA</latexit> p(S, µ, ⇤, ⇡|X) <latexit sha1_base64="KVwrZAHjsj+ltuAN7DvjaEBBX0I=">AAACNXicbVBNS8MwGE7n15xfVY9egkOYIKNVQY9DLx52mOg+YB0jTdMtLG1Dkgqj9k958X940oMHRbz6F0y3Irr5QsiT53ne5M3jckalsqwXo7CwuLS8Ulwtra1vbG6Z2zstGcUCkyaOWCQ6LpKE0ZA0FVWMdLggKHAZabujy0xv3xEhaRTeqjEnvQANQupTjJSm+madV5wAqaHrJzfpEXTciHlyHOjNCWJ9zjWnrq/00IyDU3j/Y+mkh32zbFWtScF5YOegDPJq9M0nx4twHJBQYYak7NoWV70ECUUxI2nJiSXhCI/QgHQ1DFFAZC+Z/DqFB5rxoB8JvUIFJ+zvjgQFMhtUO7MR5ayWkf9p3Vj5572EhjxWJMTTh/yYQRXBLELoUUGwYmMNEBZUzwrxEAmElQ66pEOwZ788D1rHVfukal2flmsXeRxFsAf2QQXY4AzUwBVogCbA4AE8gzfwbjwar8aH8Tm1Foy8Zxf8KePrGxbhrDk=</latexit>
  7. Ψ΢εɾ΢Ογϟʔτ෼෍ w Ψ΢ε෼෍ͱ΢Ογϟʔτ෼෍ͷੵͰύϥϝʔλґଘ͋Γ w ΢Ογϟʔτ෼෍ w ର਺ 23 p(µ, ⇤)

    = N(µ|m, ( ⇤) 1)W(⇤|⌫, W) <latexit sha1_base64="3+O0nfVh5tsAITwYlkIgz5WGir8=">AAAChnicbVFbS8MwFE7rbc7b1EdfgkNwoKP1gr4IQ198EFFwTljnOE3TGUzSkqTCqP0p/inf/Dem2xDdPBDy8Z1zvnMLU8608bwvx52bX1hcqixXV1bX1jdqm1uPOskUoW2S8EQ9haApZ5K2DTOcPqWKggg57YSvV6W/80aVZol8MMOU9gQMJIsZAWOpfu0j3Q/ChEd6KOwXiOwABwLMSxjnwY2ViaBo4IsxR4Dnt8VUPH7/SRDFAbZeamBW4zk/9K3Sj07H6kzFlEryV/1O0ejX6l7TGxmeBf4E1NHE7vq1zyBKSCaoNISD1l3fS00vB2UY4bSoBpmmKZBXGNCuhRIE1b18tMYC71kmwnGi7JMGj9jfGTkIXc5tI8sW9bSvJP/zdTMTn/dyJtPMUEnGheKMY5Pg8iY4YooSw4cWAFHM9orJCyggxl6uapfgT488Cx6Pmv5x07s/qbcuJ+uooB20i/aRj85QC12jO9RGxJlzGs6Rc+xW3KZ76p6NQ11nkrON/pjb+ga5wMOs</latexit> W(⇤|⌫, W) = CW (⌫, W)|⇤|⌫ D 1 2 exp{ 1 2 Tr(W 1⇤)} <latexit sha1_base64="gqcf1/Wy5dw+bxg6dG7+mVv324o=">AAACuHicbVFdT9swFHUyNqD76sYjL1dUSCCNKmFMmyYhobGHPewBJEqR6tI5jlMsHCeynYnK5DdO2tv+zW7SPkDplSwfnXPuh6+TUknrouhfED5be/5ifWOz8/LV6zdvu+/eX9qiMlwMeKEKc5UwK5TUYuCkU+KqNILliRLD5Pa00Ye/hbGy0BduVopxzqZaZpIzh9Sk+4fmzN1wpvywhj2aFCq1sxwv+hOLpAzugerqA7S2JEPXfucYTieP05YcTdKKSteeZoZxj3Y4gO944tof1jVQk3txVyLwSM5NrdQqFwZbPCh/7Q/ielWDfaD1pNuL+lEb8BTEC9AjizibdP/StOBVLrTjilk7iqPSjT0zTnIl6g6trCgZv2VTMUKoWS7s2LeLr2EXmRSywuDRDlr2YYZnuW1mRGczvl3WGnKVNqpc9mXspS4rJzSfN8oqBa6A5hchlUZwp2YIGDcSZwV+w3BvDv+6g0uIl5/8FFwe9uOP/ej8qHfybbGODbJNdsgeiclnckJ+kDMyIDz4FIyCNBDh1/BXOA3l3BoGi5wt8ihC8x/QUtW2</latexit> lnW(⇤|⌫, W) = ⌫ D 1 2 ln|⇤| 1 2 Tr(W 1⇤) + lnCW (⌫, W) <latexit sha1_base64="WUXdLuEAYKkoC+Y6f7bXtvMLmQU=">AAACvnicbVFdaxNBFJ1dv2r8aNRHXy4GoUUTdqugIEKwPvjgQ4WmKWRjuDs7246Zj2VmVgzj/knBB/+Ns+mKbZoLwxzuPefcO3fySnDrkuRPFN+4eev2nZ27vXv3Hzzc7T96fGJ1bSibUC20Oc3RMsEVmzjuBDutDEOZCzbNl4dtffqdGcu1Onaris0lnilecooupBb935mRXqgmk+jOKQo/bWAvy7Uo7EqGK/scvAqEn5Cp+iWsaXkZWPu995CVBqkPBRjCx3DSxh800DkGxTabYaf6zz02oeUl569+mDbbxPvw4p/54eLqwBuzLfqDZJSsA66DtAMD0sXRov8rKzStJVOOCrR2liaVm3s0jlPBml5WW1YhXeIZmwWoUDI79+v1N/A8ZAootQlHOVhnLys8Stu+JDDbEe1mrU1uq81qV76de66q2jFFLxqVtQCnof1LKLhh1IlVAEgND7MCPcewXRd+vBeWkG4++To4ORilr0bJl9eD8YduHTvkKXlG9khK3pAx+USOyITQ6F2E0bdoGY/jMpaxvqDGUad5Qq5E/OMvwaXYng==</latexit>
  8. Α͘ग़ͯ͘Δର਺ࣜ w ଟ࣍ݩΨ΢ε෼෍ w ΢Ογϟʔτ෼෍ 24 lnW(⇤|⌫, W) = ⌫

    D 1 2 ln|⇤| 1 2 Tr(W 1⇤) + lnCW (⌫, W) <latexit sha1_base64="WUXdLuEAYKkoC+Y6f7bXtvMLmQU=">AAACvnicbVFdaxNBFJ1dv2r8aNRHXy4GoUUTdqugIEKwPvjgQ4WmKWRjuDs7246Zj2VmVgzj/knBB/+Ns+mKbZoLwxzuPefcO3fySnDrkuRPFN+4eev2nZ27vXv3Hzzc7T96fGJ1bSibUC20Oc3RMsEVmzjuBDutDEOZCzbNl4dtffqdGcu1Onaris0lnilecooupBb935mRXqgmk+jOKQo/bWAvy7Uo7EqGK/scvAqEn5Cp+iWsaXkZWPu995CVBqkPBRjCx3DSxh800DkGxTabYaf6zz02oeUl569+mDbbxPvw4p/54eLqwBuzLfqDZJSsA66DtAMD0sXRov8rKzStJVOOCrR2liaVm3s0jlPBml5WW1YhXeIZmwWoUDI79+v1N/A8ZAootQlHOVhnLys8Stu+JDDbEe1mrU1uq81qV76de66q2jFFLxqVtQCnof1LKLhh1IlVAEgND7MCPcewXRd+vBeWkG4++To4ORilr0bJl9eD8YduHTvkKXlG9khK3pAx+USOyITQ6F2E0bdoGY/jMpaxvqDGUad5Qq5E/OMvwaXYng==</latexit> lnN(x|µ, ⇤) = { 1 2 (x µ)T⇤(x µ) ln|⇤| + Dln2⇡} <latexit sha1_base64="p4xtHdep4ri4CTik/E7TDgwJQ7w=">AAACu3icfVFNbxMxEPUuUEpK20CPXEZElVpBot2ARC+VqsKBA0JFatpKcVp5vd7E1PaubC8icvwnufFv8KZ7aJOKkSw/v3nz4ZmsEtzYJPkbxU+ePtt4vvmis/Vye2e3++r1hSlrTdmIlqLUVxkxTHDFRpZbwa4qzYjMBLvMbj83/stfTBteqnM7r9hEkqniBafEBuqm+wdr6YTyWBI7o0S47/5gibPC/fawAJyVIjdzGS4s6/cP3t9CnZwcwnEHuz7gQhPqUu+GHu7n6K/kOLw+hzb0/zrot80t1osu4B1gbt0XD60IhrjigH3npttLBsnSYB2kLeih1s6aIeQlrSVTlgpizDhNKjtxRFtOBfMdXBtWEXpLpmwcoCKSmYlbzt7DfmByKEodjrKwZO9HOCJN03lQNl81q76GfMw3rm1xNHFcVbVlit4VKmoBtoRmkZBzzagV8wAI1Tz0CnRGwgpsWHczhHT1y+vgYjhIPwySHx97J6ftODbRG/QWHaAUfUIn6Cs6QyNEo6PoOppGs/g4pvHPWNxJ46iN2UMPLK7/AZfb2UM=</latexit>
  9. جຊతͳํ਑ w αϯϓϦϯάͱۙࣅͷͲͪΒͷख๏ʹ͓͍ͯ΋ɼ
 જࡏม਺ͱύϥϝʔλ͸෼͚ͯߦ͏ w ྫ ΪϒεαϯϓϦϯάͷ৔߹ 25 S ⇠

    p(S|X, , ⇡) <latexit sha1_base64="vIlmRB4iCj6Om2YPliWrWshNaO4=">AAACN3icbVBNS8NAEN3Ur1q/oh69LBahgpREBT0WvXiSivYDmlA2m027dDcJuxuhxP4rL/4Nb3rxoIhX/4GbNoJtHVj2zZsZZt7zYkalsqwXo7CwuLS8Ulwtra1vbG6Z2ztNGSUCkwaOWCTaHpKE0ZA0FFWMtGNBEPcYaXmDy6zeuidC0ii8U8OYuBz1QhpQjJSmuua1w5Hqe0F6O4KOpBzGlT/MA/xN2qMj6HgR8+WQ689heoWPprmYHnbNslW1xgHngZ2DMsij3jWfHT/CCSehwgxJ2bGtWLkpEopiRkYlJ5EkRniAeqSjYYg4kW461j2CB5rxYRAJ/UIFx+zfiRRxmd2mOzMZcraWkf/VOokKzt2UhnGiSIgni4KEQRXBzEToU0GwYkMNEBZU3wpxHwmElba6pE2wZyXPg+Zx1T6pWjen5dpFbkcR7IF9UAE2OAM1cAXqoAEweASv4B18GE/Gm/FpfE1aC0Y+swumwvj+AdSJrRs=</latexit> µ, ⇤, ⇡ ⇠ p(µ, ⇤, ⇡|X, S) <latexit sha1_base64="rNMMi1irwxkx080dBMGuZj8UnK8=">AAACb3icnVHLSgMxFM2Mr1pftS5cVCRYhBZKmVFBl0U3LlxUtA/olJLJZNrQZGZIMkIZZ+sHuvMf3PgHZtoitnXlhZCTc++5uTlxI0alsqwPw1xb39jcym3nd3b39g8Kh8W2DGOBSQuHLBRdF0nCaEBaiipGupEgiLuMdNzxXZbvvBAhaRg8q0lE+hwNA+pTjJSmBoU3xw2ZJydcbw6Pa/D3+UH38dAiF1HoSMphVPmH8hU6HKmR6yfdtPaDn9LqoFC26tY04Cqw56AM5tEcFN4dL8QxJ4HCDEnZs61I9RMkFMWMpHknliRCeIyGpKdhgDiR/WTqVwrPNeNBPxR6BQpO2d+KBHGZDa0rsxHlci4j/8r1YuXf9BMaRLEiAZ5d5McMqhBm5kOPCoIVm2iAsKB6VohHSCCs9BfltQn28pNXQfuibl/WrcercuN2bkcOlMAZqAAbXIMGuAdN0AIYfBpFo2ScGF/msXlqwlmpacw1R2AhzOo3S0a9lw==</latexit>
  10. ํ਑ w જࡏม਺ͱύϥϝʔλΛ෼͚ͯαϯϓϦϯά 27 S ⇠ p(S|X, , ⇡) <latexit

    sha1_base64="vIlmRB4iCj6Om2YPliWrWshNaO4=">AAACN3icbVBNS8NAEN3Ur1q/oh69LBahgpREBT0WvXiSivYDmlA2m027dDcJuxuhxP4rL/4Nb3rxoIhX/4GbNoJtHVj2zZsZZt7zYkalsqwXo7CwuLS8Ulwtra1vbG6Z2ztNGSUCkwaOWCTaHpKE0ZA0FFWMtGNBEPcYaXmDy6zeuidC0ii8U8OYuBz1QhpQjJSmuua1w5Hqe0F6O4KOpBzGlT/MA/xN2qMj6HgR8+WQ689heoWPprmYHnbNslW1xgHngZ2DMsij3jWfHT/CCSehwgxJ2bGtWLkpEopiRkYlJ5EkRniAeqSjYYg4kW461j2CB5rxYRAJ/UIFx+zfiRRxmd2mOzMZcraWkf/VOokKzt2UhnGiSIgni4KEQRXBzEToU0GwYkMNEBZU3wpxHwmElba6pE2wZyXPg+Zx1T6pWjen5dpFbkcR7IF9UAE2OAM1cAXqoAEweASv4B18GE/Gm/FpfE1aC0Y+swumwvj+AdSJrRs=</latexit> µ, ⇤, ⇡ ⇠ p(µ, ⇤, ⇡|X, S) <latexit sha1_base64="rNMMi1irwxkx080dBMGuZj8UnK8=">AAACb3icnVHLSgMxFM2Mr1pftS5cVCRYhBZKmVFBl0U3LlxUtA/olJLJZNrQZGZIMkIZZ+sHuvMf3PgHZtoitnXlhZCTc++5uTlxI0alsqwPw1xb39jcym3nd3b39g8Kh8W2DGOBSQuHLBRdF0nCaEBaiipGupEgiLuMdNzxXZbvvBAhaRg8q0lE+hwNA+pTjJSmBoU3xw2ZJydcbw6Pa/D3+UH38dAiF1HoSMphVPmH8hU6HKmR6yfdtPaDn9LqoFC26tY04Cqw56AM5tEcFN4dL8QxJ4HCDEnZs61I9RMkFMWMpHknliRCeIyGpKdhgDiR/WTqVwrPNeNBPxR6BQpO2d+KBHGZDa0rsxHlci4j/8r1YuXf9BMaRLEiAZ5d5McMqhBm5kOPCoIVm2iAsKB6VohHSCCs9BfltQn28pNXQfuibl/WrcercuN2bkcOlMAZqAAbXIMGuAdN0AIYfBpFo2ScGF/msXlqwlmpacw1R2AhzOo3S0a9lw==</latexit> w જࡏม਺ΛαϯϓϦϯά w Ж ϽͱК͕ಠཱʹͳΔ w ЖͱϽΛαϯϓϦϯά w КΛαϯϓϦϯά
  11. Ϋϥελม਺4ͷΈαϯϓϦϯά w ύϥϝʔλ Ж Ͻ К ͸͢Ͱʹαϯϓϧ͞Ε͍ͯΔͱԾ ఆʢఆ਺ʣͱԾఆͯ͠ɼ4ʹؔ͢Δ͜͏ͷΈʹண໨ 28 S

    ⇠ p(S|X, µ, ⇤, ⇡) / p(X, S, µ, ⇤, S, ⇡) / p(X|S, µ, ⇤)p(S|⇡) = N Y n=1 p(xn |sn, µ, ⇤)p(sn |⇡) <latexit sha1_base64="kV9CtaF7EdC7oBXS1szMIyG1eaw=">AAADkniclVJbb9MwFHYTYKNc1gFvvFhUoE1CVQJDIKTB2F54mNAQdKtUl8hxnM2ab7IdRBXyf/g9vPFv5mQBpesmjSNZ+c53Lt+xc1LNmXVR9KcXhDdu3lpZvd2/c/fe/bXB+oNDqwpD6JgorswkxZZyJunYMcfpRBuKRcrpUXq6V8ePvlNjmZJf3VzTmcDHkuWMYOepZL33CwnsTtK8/FJBZJmAeqPD/IR/nUn1HKJU8czOhf8gUSz6+14zw4ucZpv9ZxBpo7RTncZNr38i1+x7Rb7XgAhdIdOZ/3o6m0vXv0xquxHLklJux9W38lPVqfpRJbIja737v8K2bbEonQyG0ShqDC6DuAVD0NpBMviNMkUKQaUjHFs7jSPtZiU2jhFOqz4qLNWYnOJjOvVQYkHtrGxWqoJPPZPBXBl/pIMN260osbD1bD6zntpejNXkZbFp4fI3s5JJXTgqyblQXnDo/1y9nzBjhhLH5x5gYpifFZITbDBxfov7/hHii1deBocvRvHLUfR5a7iz2z7HKngMnoANEIPXYAd8BAdgDEiwFrwK3gXvw0fh2/BDuHeeGvTamodgwcL9MzRzJsA=</latexit>
  12. ύϥϝʔλͷαϯϓϦϯά w જࡏม਺4͸͢Ͱʹαϯϓϧ͞Ε͍ͯΔͱԾఆʢఆ਺ʣͱ͠ ͯɼύϥϝʔλ Ж Ͻ К ͷಉ࣌ࣄޙ෼෍Λܭࢉ w ЖͱϽ͸ଟ࣍ݩΨ΢εͷ৔߹͸ಠཱʹͳΒͳ͍ͷͰɼ


    ЖͱϽͷࣄޙ෼෍ͱɼКͷࣄޙ෼෍ΛผʑʹٻΊͯɼαϯ ϓϦϯά͢Δ 32 p(µ, ⇤, ⇡|X, S) / p(X, S, µ, ⇤, ⇡) / p(X|S, µ, ⇤)p(S|⇡)p(µ, ⇤)p(⇡) <latexit sha1_base64="G58/eK0Edhpmo+Az9MiOpldYL2w=">AAADM3icjVLLSsNAFJ3Ed31VXboZLEoLUhIVdCm6UXChaGuhKWUymejgJDPMTIQS+09u/BEXgrhQxK3/4KQt0odCL4ScnHvPuXduxheMKu04r5Y9MTk1PTM7l5tfWFxazq+sVhVPJCYVzBmXNR8pwmhMKppqRmpCEhT5jFz7d8dZ/vqeSEV5fKVbgjQidBPTkGKkDdVcsU5F0fM5C1QrMi8vSrZh//eZsQrQICcofIBehPStH6a19vYvvmyXclvQE5ILzaEx/rNm0Gy8hiXoef9Y980ynnepT37ZkQ+1Gmcjw1VG18wXnLLTCTgK3B4ogF6cN/PPXsBxEpFYY4aUqruO0I0USU0xI+2clygiEL5DN6RuYIwiohpp55+34aZhAhhyaZ5Yww7br0hRpLLZTGV2VjWcy8i/cvVEhweNlMYi0STG3UZhwqBZe3aBYEAlwZq1DEBYUjMrxLdIIqzNNcuZJbjDRx4F1Z2yu1t2LvYKh0e9dcyCdbABisAF++AQnIBzUAHYerRerHfrw36y3+xP+6tbals9zRoYCPv7BzdXCVY=</latexit> 4ͷ؍ଌʹΑΓಠཱʹͳͬͨ
  13. Ж Ͻ Кͷࣄޙ෼෍ w ֤ύϥϝʔλʹؔ܎ͷ͋Δ߲͚ͩʹ஫໨ w ЖͱϽͷࣄޙ෼෍ w Кͷࣄޙ෼෍ 33

    p(µ, ⇤|X, S) / p(X|S, µ, ⇤)p(µ, ⇤) <latexit sha1_base64="z80pCzN5bgYxvRBSswodjSXPdJA=">AAAClHicjVFLSwMxEM6ur1pfrYIXL8EiWChlV4V68FAtggcRRfuAbinZbFZDs5uQZIWy7i/y33jz35hti7TqwYGQLzPfTGa+8QWjSjvOp2UvLa+srhXWixubW9s7pfJuR/FEYtLGnHHZ85EijMakralmpCckQZHPSNcftfJ495VIRXn8pMeCDCL0HNOQYqSNa1h6F8eez1mgxpG5vCipwfn3rakUIPgGvQjpFz9Me1ntGz9m1aInJBeaQ1PmmzFHf8wW6/1dvwr/00V1WKo4dWdi8DdwZ6ACZnY/LH14AcdJRGKNGVKq7zpCD1IkNcWMZEUvUUQgPELPpG9gjCKiBulE1AweGU8AQy7NiTWceOczUhSpvD/DzIdVP2O5869YP9Hh+SClsUg0ifH0ozBh0KiYbwgGVBKs2dgAhCU1vUL8giTC2uyxaERwf478G3RO6u5p3Xk4qzSvZnIUwAE4BMfABQ3QBDfgHrQBtspWw2pal/a+fWG37Osp1bZmOXtgwey7L6BoylY=</latexit> p(µ, ⇤, ⇡|X, S) / p(X, S, µ, ⇤, ⇡) / p(X|S, µ, ⇤)p(S|⇡)p(µ, ⇤)p(⇡) <latexit sha1_base64="G58/eK0Edhpmo+Az9MiOpldYL2w=">AAADM3icjVLLSsNAFJ3Ed31VXboZLEoLUhIVdCm6UXChaGuhKWUymejgJDPMTIQS+09u/BEXgrhQxK3/4KQt0odCL4ScnHvPuXduxheMKu04r5Y9MTk1PTM7l5tfWFxazq+sVhVPJCYVzBmXNR8pwmhMKppqRmpCEhT5jFz7d8dZ/vqeSEV5fKVbgjQidBPTkGKkDdVcsU5F0fM5C1QrMi8vSrZh//eZsQrQICcofIBehPStH6a19vYvvmyXclvQE5ILzaEx/rNm0Gy8hiXoef9Y980ynnepT37ZkQ+1Gmcjw1VG18wXnLLTCTgK3B4ogF6cN/PPXsBxEpFYY4aUqruO0I0USU0xI+2clygiEL5DN6RuYIwiohpp55+34aZhAhhyaZ5Yww7br0hRpLLZTGV2VjWcy8i/cvVEhweNlMYi0STG3UZhwqBZe3aBYEAlwZq1DEBYUjMrxLdIIqzNNcuZJbjDRx4F1Z2yu1t2LvYKh0e9dcyCdbABisAF++AQnIBzUAHYerRerHfrw36y3+xP+6tbals9zRoYCPv7BzdXCVY=</latexit> p(⇡|X, S) / p(S|⇡)p(⇡) <latexit sha1_base64="j5W9LmEl/qzvLBW6h4wvNMsLplQ=">AAACTHicbVDLSgMxFM3UV62vUZdugkVoQcqMCrosunFZ0T6gM5RMmmlDM5OQZIQy9gPduHDnV7hxoYhgpi3Ftl4IOZxzT3LvCQSjSjvOm5VbWV1b38hvFra2d3b37P2DhuKJxKSOOeOyFSBFGI1JXVPNSEtIgqKAkWYwuMn05iORivL4QQ8F8SPUi2lIMdKG6thYlLyAs64aRubyBIVP0IuQ7gdh2hqdzvD9qFzwhORCc2gsMzZrn/OX4eKL5Y5ddCrOuOAycKegCKZV69ivXpfjJCKxxgwp1XYdof0USU0xI6OClygiEB6gHmkbGKOIKD8dhzGCJ4bpwpBLc2INx+xfR4oilc1mOrMt1KKWkf9p7USHV35KY5FoEuPJR2HCoEkkSxZ2qSRYs6EBCEtqZoW4jyTC2uRfMCG4iysvg8ZZxT2vOHcXxer1NI48OALHoARccAmq4BbUQB1g8AzewSf4sl6sD+vb+pm05qyp5xDMVW79Fxk3tIU=</latexit>
  14. ЖͱϽͷࣄޙ෼෍ w 4͕ఆ਺Ͱ͋Δ͜ͱʹ஫ҙ͢Ε͹ɼ୯ͳΔଟ࣍ݩΨ΢ε෼ ෍ͷࣄޙ෼෍ͱಉ౳ͱΈͳͤΔ 34 p(µ, ⇤|X, S) / p(X|S,

    µ, ⇤)p(µ, ⇤) <latexit sha1_base64="z80pCzN5bgYxvRBSswodjSXPdJA=">AAAClHicjVFLSwMxEM6ur1pfrYIXL8EiWChlV4V68FAtggcRRfuAbinZbFZDs5uQZIWy7i/y33jz35hti7TqwYGQLzPfTGa+8QWjSjvOp2UvLa+srhXWixubW9s7pfJuR/FEYtLGnHHZ85EijMakralmpCckQZHPSNcftfJ495VIRXn8pMeCDCL0HNOQYqSNa1h6F8eez1mgxpG5vCipwfn3rakUIPgGvQjpFz9Me1ntGz9m1aInJBeaQ1PmmzFHf8wW6/1dvwr/00V1WKo4dWdi8DdwZ6ACZnY/LH14AcdJRGKNGVKq7zpCD1IkNcWMZEUvUUQgPELPpG9gjCKiBulE1AweGU8AQy7NiTWceOczUhSpvD/DzIdVP2O5869YP9Hh+SClsUg0ifH0ozBh0KiYbwgGVBKs2dgAhCU1vUL8giTC2uyxaERwf478G3RO6u5p3Xk4qzSvZnIUwAE4BMfABQ3QBDfgHrQBtspWw2pal/a+fWG37Osp1bZmOXtgwey7L6BoylY=</latexit> ଟ࣍ݩΨ΢ε෼෍ ʢ༧ଌ෼෍ʣ Ψ΢εɾ΢Ογϟʔτ෼෍ ʢࣄલ෼෍ʣ
  15. ЖͱϽͷࣄޙ෼෍ͷܭࢉ w ର਺Λͱͬͯܭࢉ͠Α͏ʂ 35 lnN(x|µ, ⇤) = { 1 2

    (x µ)T⇤(x µ) ln|⇤| + Dln2⇡} <latexit sha1_base64="Wn5waYNRFQtc4OROuSwy0TFzJjw=">AAACqHicfVHbahsxENVub4l7c9rHvAwxgaStza5bSF8KoclDoaG4YMcplmu0sjYRkbSLpC01sr4t/9C3/k20zpbmUjogOHNmDjNzlJWCG5skv6P43v0HDx+trbceP3n67Hl748WxKSpN2YgWotAnGTFMcMVGllvBTkrNiMwEG2fnB3V9/INpwws1tIuSTSU5VTznlNhAzdoXWEsnlMeS2DNKhPvid1Y4y91PD0v4k2BZ+Td/s6MwYk78LnxoYdcFnGtCXepd38N1ffeGfvf7EBrl/7qg2yy1bJqX8Bowt+7QQ1OBPi45YN+atTtJL1kF3AVpAzqoicGs/QvPC1pJpiwVxJhJmpR26oi2nArmW7gyrCT0nJyySYCKSGambmW0h+3AzCEvdHjKwoq9rnBEGrOQWeisDzK3azX5r9qksvn7qeOqrCxT9GpQXgmwBdS/BnOuGbViEQChmoddgZ6R4LkNf1ubkN4++S447vfSt73k67vO/sfGjjW0ibbQDkrRHtpHn9AAjRCNtqPP0TAaxa/iQTyOv121xlGjeYluRJxdAj120L4=</latexit>
  16. Α͘ग़ͯ͘Δର਺ࣜ w ଟ࣍ݩΨ΢ε෼෍ w ΢Ογϟʔτ෼෍ 37 lnW(⇤|⌫, W) = ⌫

    D 1 2 ln|⇤| 1 2 Tr(W 1⇤) + lnCW (⌫, W) <latexit sha1_base64="WUXdLuEAYKkoC+Y6f7bXtvMLmQU=">AAACvnicbVFdaxNBFJ1dv2r8aNRHXy4GoUUTdqugIEKwPvjgQ4WmKWRjuDs7246Zj2VmVgzj/knBB/+Ns+mKbZoLwxzuPefcO3fySnDrkuRPFN+4eev2nZ27vXv3Hzzc7T96fGJ1bSibUC20Oc3RMsEVmzjuBDutDEOZCzbNl4dtffqdGcu1Onaris0lnilecooupBb935mRXqgmk+jOKQo/bWAvy7Uo7EqGK/scvAqEn5Cp+iWsaXkZWPu995CVBqkPBRjCx3DSxh800DkGxTabYaf6zz02oeUl569+mDbbxPvw4p/54eLqwBuzLfqDZJSsA66DtAMD0sXRov8rKzStJVOOCrR2liaVm3s0jlPBml5WW1YhXeIZmwWoUDI79+v1N/A8ZAootQlHOVhnLys8Stu+JDDbEe1mrU1uq81qV76de66q2jFFLxqVtQCnof1LKLhh1IlVAEgND7MCPcewXRd+vBeWkG4++To4ORilr0bJl9eD8YduHTvkKXlG9khK3pAx+USOyITQ6F2E0bdoGY/jMpaxvqDGUad5Qq5E/OMvwaXYng==</latexit> lnN(x|µ, ⇤) = { 1 2 (x µ)T⇤(x µ) ln|⇤| + Dln2⇡} <latexit sha1_base64="p4xtHdep4ri4CTik/E7TDgwJQ7w=">AAACu3icfVFNbxMxEPUuUEpK20CPXEZElVpBot2ARC+VqsKBA0JFatpKcVp5vd7E1PaubC8icvwnufFv8KZ7aJOKkSw/v3nz4ZmsEtzYJPkbxU+ePtt4vvmis/Vye2e3++r1hSlrTdmIlqLUVxkxTHDFRpZbwa4qzYjMBLvMbj83/stfTBteqnM7r9hEkqniBafEBuqm+wdr6YTyWBI7o0S47/5gibPC/fawAJyVIjdzGS4s6/cP3t9CnZwcwnEHuz7gQhPqUu+GHu7n6K/kOLw+hzb0/zrot80t1osu4B1gbt0XD60IhrjigH3npttLBsnSYB2kLeih1s6aIeQlrSVTlgpizDhNKjtxRFtOBfMdXBtWEXpLpmwcoCKSmYlbzt7DfmByKEodjrKwZO9HOCJN03lQNl81q76GfMw3rm1xNHFcVbVlit4VKmoBtoRmkZBzzagV8wAI1Tz0CnRGwgpsWHczhHT1y+vgYjhIPwySHx97J6ftODbRG/QWHaAUfUIn6Cs6QyNEo6PoOppGs/g4pvHPWNxJ46iN2UMPLK7/AZfb2UM=</latexit>
  17. Ͻͷࣄޙ෼෍ w ٻΊͨЖͷࣄޙ෼෍Λར༻ͯ͠ɼϽͷࣄޙ෼෍ΛٻΊΔ w ϕΠζͷఆཧΑΓ w ৚݅෇͖֬཰ͷఆٛΑΓ w ࿈ཱํఔࣜతʹͱ͘ͱ 41

    Ψ΢εɾ΢Ογϟʔτ ͷಉ࣌ࣄલ෼෍ ଟ࣍ݩΨ΢εͷ ؍ଌ෼෍ ٻΊ͍ͨϽ ͷࣄޙ෼෍ Жͷࣄޙ෼෍ ʢ͖ͬ͞ٻΊͨʣ
  18. w ର਺ͷܭࢉ݁Ռ w ࣄલ෼෍ͷର਺ Ͻͷࣄޙ෼෍ͷܭࢉ 44 lnW(⇤|⌫, W) = ⌫

    D 1 2 ln|⇤| 1 2 Tr(W 1⇤) + lnCW (⌫, W) <latexit sha1_base64="WUXdLuEAYKkoC+Y6f7bXtvMLmQU=">AAACvnicbVFdaxNBFJ1dv2r8aNRHXy4GoUUTdqugIEKwPvjgQ4WmKWRjuDs7246Zj2VmVgzj/knBB/+Ns+mKbZoLwxzuPefcO3fySnDrkuRPFN+4eev2nZ27vXv3Hzzc7T96fGJ1bSibUC20Oc3RMsEVmzjuBDutDEOZCzbNl4dtffqdGcu1Onaris0lnilecooupBb935mRXqgmk+jOKQo/bWAvy7Uo7EqGK/scvAqEn5Cp+iWsaXkZWPu995CVBqkPBRjCx3DSxh800DkGxTabYaf6zz02oeUl569+mDbbxPvw4p/54eLqwBuzLfqDZJSsA66DtAMD0sXRov8rKzStJVOOCrR2liaVm3s0jlPBml5WW1YhXeIZmwWoUDI79+v1N/A8ZAootQlHOVhnLys8Stu+JDDbEe1mrU1uq81qV76de66q2jFFLxqVtQCnof1LKLhh1IlVAEgND7MCPcewXRd+vBeWkG4++To4ORilr0bJl9eD8YduHTvkKXlG9khK3pAx+USOyITQ6F2E0bdoGY/jMpaxvqDGUad5Qq5E/OMvwaXYng==</latexit>
  19. Ж Ͻ Кͷࣄޙ෼෍ w ֤ύϥϝʔλʹؔ܎ͷ͋Δ߲͚ͩʹ஫໨ w ЖͱϽͷࣄޙ෼෍ w Кͷࣄޙ෼෍ 46

    p(µ, ⇤|X, S) / p(X|S, µ, ⇤)p(µ, ⇤) <latexit sha1_base64="z80pCzN5bgYxvRBSswodjSXPdJA=">AAAClHicjVFLSwMxEM6ur1pfrYIXL8EiWChlV4V68FAtggcRRfuAbinZbFZDs5uQZIWy7i/y33jz35hti7TqwYGQLzPfTGa+8QWjSjvOp2UvLa+srhXWixubW9s7pfJuR/FEYtLGnHHZ85EijMakralmpCckQZHPSNcftfJ495VIRXn8pMeCDCL0HNOQYqSNa1h6F8eez1mgxpG5vCipwfn3rakUIPgGvQjpFz9Me1ntGz9m1aInJBeaQ1PmmzFHf8wW6/1dvwr/00V1WKo4dWdi8DdwZ6ACZnY/LH14AcdJRGKNGVKq7zpCD1IkNcWMZEUvUUQgPELPpG9gjCKiBulE1AweGU8AQy7NiTWceOczUhSpvD/DzIdVP2O5869YP9Hh+SClsUg0ifH0ozBh0KiYbwgGVBKs2dgAhCU1vUL8giTC2uyxaERwf478G3RO6u5p3Xk4qzSvZnIUwAE4BMfABQ3QBDfgHrQBtspWw2pal/a+fWG37Osp1bZmOXtgwey7L6BoylY=</latexit> p(µ, ⇤, ⇡|X, S) / p(X, S, µ, ⇤, ⇡) / p(X|S, µ, ⇤)p(S|⇡)p(µ, ⇤)p(⇡) <latexit sha1_base64="G58/eK0Edhpmo+Az9MiOpldYL2w=">AAADM3icjVLLSsNAFJ3Ed31VXboZLEoLUhIVdCm6UXChaGuhKWUymejgJDPMTIQS+09u/BEXgrhQxK3/4KQt0odCL4ScnHvPuXduxheMKu04r5Y9MTk1PTM7l5tfWFxazq+sVhVPJCYVzBmXNR8pwmhMKppqRmpCEhT5jFz7d8dZ/vqeSEV5fKVbgjQidBPTkGKkDdVcsU5F0fM5C1QrMi8vSrZh//eZsQrQICcofIBehPStH6a19vYvvmyXclvQE5ILzaEx/rNm0Gy8hiXoef9Y980ynnepT37ZkQ+1Gmcjw1VG18wXnLLTCTgK3B4ogF6cN/PPXsBxEpFYY4aUqruO0I0USU0xI+2clygiEL5DN6RuYIwiohpp55+34aZhAhhyaZ5Yww7br0hRpLLZTGV2VjWcy8i/cvVEhweNlMYi0STG3UZhwqBZe3aBYEAlwZq1DEBYUjMrxLdIIqzNNcuZJbjDRx4F1Z2yu1t2LvYKh0e9dcyCdbABisAF++AQnIBzUAHYerRerHfrw36y3+xP+6tbals9zRoYCPv7BzdXCVY=</latexit> p(⇡|X, S) / p(S|⇡)p(⇡) <latexit sha1_base64="j5W9LmEl/qzvLBW6h4wvNMsLplQ=">AAACTHicbVDLSgMxFM3UV62vUZdugkVoQcqMCrosunFZ0T6gM5RMmmlDM5OQZIQy9gPduHDnV7hxoYhgpi3Ftl4IOZxzT3LvCQSjSjvOm5VbWV1b38hvFra2d3b37P2DhuKJxKSOOeOyFSBFGI1JXVPNSEtIgqKAkWYwuMn05iORivL4QQ8F8SPUi2lIMdKG6thYlLyAs64aRubyBIVP0IuQ7gdh2hqdzvD9qFzwhORCc2gsMzZrn/OX4eKL5Y5ddCrOuOAycKegCKZV69ivXpfjJCKxxgwp1XYdof0USU0xI6OClygiEB6gHmkbGKOIKD8dhzGCJ4bpwpBLc2INx+xfR4oilc1mOrMt1KKWkf9p7USHV35KY5FoEuPJR2HCoEkkSxZ2qSRYs6EBCEtqZoW4jyTC2uRfMCG4iysvg8ZZxT2vOHcXxer1NI48OALHoARccAmq4BbUQB1g8AzewSf4sl6sD+vb+pm05qyp5xDMVW79Fxk3tIU=</latexit>
  20. Кͷࣄޙ෼෍ w ࠞ߹ൺ཰Кͷࣄޙ෼෍͸ɼ؍ଌ෼෍ͱ͸ಠཱ w ϙΞιϯࠞ߹Ϟσϧͷ࣌ͱಉ͡Ͱ͋ΔͨΊɼ݁Ռ͚ͩ 47 p(⇡|X, S) / p(S|⇡)p(⇡)

    <latexit sha1_base64="j5W9LmEl/qzvLBW6h4wvNMsLplQ=">AAACTHicbVDLSgMxFM3UV62vUZdugkVoQcqMCrosunFZ0T6gM5RMmmlDM5OQZIQy9gPduHDnV7hxoYhgpi3Ftl4IOZxzT3LvCQSjSjvOm5VbWV1b38hvFra2d3b37P2DhuKJxKSOOeOyFSBFGI1JXVPNSEtIgqKAkWYwuMn05iORivL4QQ8F8SPUi2lIMdKG6thYlLyAs64aRubyBIVP0IuQ7gdh2hqdzvD9qFzwhORCc2gsMzZrn/OX4eKL5Y5ddCrOuOAycKegCKZV69ivXpfjJCKxxgwp1XYdof0USU0xI6OClygiEB6gHmkbGKOIKD8dhzGCJ4bpwpBLc2INx+xfR4oilc1mOrMt1KKWkf9p7USHV35KY5FoEuPJR2HCoEkkSxZ2qSRYs6EBCEtqZoW4jyTC2uRfMCG4iysvg8ZZxT2vOHcXxer1NI48OALHoARccAmq4BbUQB1g8AzewSf4sl6sD+vb+pm05qyp5xDMVW79Fxk3tIU=</latexit>
  21. -FU`TΪϒεαϯϓϦϯά w ٻΊͨࣄޙ෼෍͸ w ύϥϝʔλ͕αϯϓϧ͞Ε͍ͯΔͱԾఆͨ͠
 જࡏม਺ͷࣄޙ෼෍ w જࡏม਺͕αϯϓϧ͞Ε͍ͯΔͱԾఆͨ͠
 ύϥϝʔλͷࣄޙ෼෍ w

    ͲͪΒ͔Λαϯϓϧͯ͋͛͠ͳ͍ͱɼ෼෍Λܾఆ͢Δ͜ͱ͕Ͱ͖ ͳ͍ w ॳظ஋Λઃఆͯ͠ɼަޓʹαϯϓϦϯά͢Δ͜ͱͰ
 ྆ํͷ෼෍ͷਫ਼౓ΛߴΊ͍ͯ͘ 48
  22. 9aYO 4aTOʹجͮ͘ࣄޙ෼෍ w Լهͷࣄޙ෼෍ͷ9Λ9aOʹɼ4Λ4aOʹஔ͖׵͑Ε͹͍͍ w ಘΒΕΔࣄޙ෼෍ʢΪϒε4ͱಉ͡ʣ 63 p(µ, ⇤|X, S)

    / p(X|S, µ, ⇤)p(µ, ⇤) <latexit sha1_base64="z80pCzN5bgYxvRBSswodjSXPdJA=">AAAClHicjVFLSwMxEM6ur1pfrYIXL8EiWChlV4V68FAtggcRRfuAbinZbFZDs5uQZIWy7i/y33jz35hti7TqwYGQLzPfTGa+8QWjSjvOp2UvLa+srhXWixubW9s7pfJuR/FEYtLGnHHZ85EijMakralmpCckQZHPSNcftfJ495VIRXn8pMeCDCL0HNOQYqSNa1h6F8eez1mgxpG5vCipwfn3rakUIPgGvQjpFz9Me1ntGz9m1aInJBeaQ1PmmzFHf8wW6/1dvwr/00V1WKo4dWdi8DdwZ6ACZnY/LH14AcdJRGKNGVKq7zpCD1IkNcWMZEUvUUQgPELPpG9gjCKiBulE1AweGU8AQy7NiTWceOczUhSpvD/DzIdVP2O5869YP9Hh+SClsUg0ifH0ozBh0KiYbwgGVBKs2dgAhCU1vUL8giTC2uyxaERwf478G3RO6u5p3Xk4qzSvZnIUwAE4BMfABQ3QBDfgHrQBtspWw2pal/a+fWG37Osp1bZmOXtgwey7L6BoylY=</latexit>
  23. ຊ౰ʹσʔλ͔Β஌Γ͍ͨ͜ͱ w σʔλ਺/͕େ͖͍৔߹ͷ༧ଌʹ͸΄ͱΜͲҙຯ͕ͳ͍ w ྫʣେن໛ੈ࿦ௐࠪ w ࠃຽͷ܏޲Λ௫Ήͷ͸༰қʢେମͷ͜ͱ͸ௐ΂ͳͯ͘΋Θ͔Δʣ w ຊ౰ʹσʔλ͔Β஌Γ͍ͨ͜ͱ w

    ঁੑͷࢦࣔͷ܏޲ w ೥ྸຖͷ܏޲ w ౳ʑɼ৚͕݅ࡉ͔͍ͱ͜Ζʹڵຯ͕͋Γɼ͔ͭͦ͜ʹσʔλ෼ੳͷ Ձ஋͕͋Δ w ݁ՌతʹɼσʔλΛ෼ੳͯ͠஌ݟΛಘ͍ͨ৔߹ͷ΄ͱΜͲͰɼσʔ λ਺͸े෼Ͱͳ͍ 75
  24. ࣍ݩ਺ͱաֶश w ػցֶशʹ͓͚ΔॏཁͳΞϓϩʔν͸ʮར༻Մೳͳ৘ใΛ ౷߹͢Δ͜ͱʯͰ͋Δ w ྫʣ&$αΠτͷਪનͷ৔߹ w Ϣʔβʔͷ೥ྸɼ৬ۀɼطࠗɼझຯɼπΠʔτ౳ʑɼଟ͘ͷ৘ ใΛར༻ͯ͠ਪન͍ͨ͠ͱ͍͏Ϟνϕʔγϣϯ͕͋Δ w

    ͜ΕΒͷଟ༷ͳ৘ใΛ֬཰෼෍ͷ૊Έ߹ΘͤͰɼϞσϦϯά ͢Δ͜ͱͰɼҰͭͷϞσϧʹ౷߹͢Δ͜ͱ͕Ͱ͖Δ w ߏங͞ΕͨϞσϧ͸ύϥϝʔλଟ͘࠷໬ਪఆͰ͸աֶशͯ͠ ͠·͏͜ͱ͕ଟ͍ͨΊɼσʔλͷ࣍ݩ਺͕େ͖͍৔߹ʹ͸ɼ ಛʹϕΠζֶश͕ޮՌΛൃش͢Δ 76