Share
Embed
不確実性と上手く付き合う意思決定の手法
予測モデルの不確実性を減らすActive Learning,
モデルの不確実性を予測結果に反映するThompson Sampling,
オンライン最適化など
Takashi Nishibayashi
April 04, 2019
Transcript
39 slides
-
͓લͩΕΑ Name: Takashi Nishibayashi twitter.com/@hagino3000 Job: Software Engineer VOYAGE GROUPͰωοτࠂ৴αʔϏε࡞ͬͯ
·͢ɻओʹ৴ϩδοΫ͔Βσʔλੳج൫·Ͱɻ ࠷ۙͷڵຯΦϯϥΠϯҙࢥܾఆͱϝΧχζϜσβ Πϯɻ -
࠷ۙͷ׆ಈ ਓೳֶձࢽ Vol. 32 No. 4 (2017/07) ͷʮࠂͱ AI ಛूʯʹʮΞυωοτϫʔΫʹ͓͚Δࠂ৴ܭ
ըͷ࠷దԽʯ͕ܝࡌ͞Ε·ͨ͠ɻ ΦϥΠϦʔ͔ΒʮࣄͰ͡ΊΔػցֶशʯ͕ग़· ͨ͠ɻ @chezou, @tokorotenͱڞஶ ࢴ൛ɾిࢠॻ੶྆ํ͋Γ·͢ -
ࠓͷ w ༧ଌγεςϜͱҙࢥܾఆ w Ϗδωεʹ͓͚Δ࠷దԽ w ϥϕϧແ͠σʔλͷ୳ࠪ w ༧ଌϞσϧͷෆ͔֬͞Λߦಈʹө͢Δ w
ΦϯϥΠϯ࠷దԽ ػցֶशͰಘͨ༧ଌΛͲͷΑ͏ʹͯ͠͏͔ɺ༧ଌͷ࣍ͷҙࢥܾ ఆͷϑΣʔζʹ͠·͢ɻ࣮ࡍͷΞϓϦέʔγϣϯհͭͭ͠ ΛਐΊ·͢ɻ -
༧ଌͱҙࢥܾఆͷྫ ༧ଌλεΫ ҙࢥܾఆ ԿͷͨΊʹ धཁ༧ଌ ੜ࢈ܭը ҆શࡏݿ֬อɾࡏݿίετݮ ނোՕॴͷ༧ଌ ϝϯςφϯεܭը ϝϯςφϯεඅ༻ݮ
Ձͷ༧ଌ ചΓങ͍ͷܾఆ औҾ͕ੜΉརӹͷ࠷େԽ ࠂޮՌͷਪఆ ࠂΛද͖͔ࣔ͢Ͳ͏͔ ༧ࢉͰͷࠂޮՌ࠷େԽ Ͱ͖ΕࣗಈͰܾΊ͍ͨɺͰͲ͏͢Ε Ή͠ΖΞϓϦέʔγϣϯΤϯδχΞͷࣄࣗಈԽ͕ϝΠϯ -
༧ଌΛར༻ͨ͠࠷దԽ 9 : ; ݸͨΓͷརӹ ԁ ʙ ݸ͋ͨΓͷॴ༻࣌ؒ
ʙ ݄ؒधཁ࠷্ݶ ࣮ࡍʹ࡞ͬͨΓചͬͯΈΔ·ͰΘ͔Βͳ͍෦ ༧ଌΛར༻͍ͯ͠Δ࣌ͰɺԿΒ͔ͷෆ࣮֬ੑΛแ͍ͯ͠Δ ͦΕͳΓʹ༧ଌͰ͖Δ෦ ͜Μͳঢ়ଶ͔Βελʔτ͢ΔʹͲ͏ͨ͠Β͍͍͔ -
༨ஊ࠷దͱԿ͔ w ඇࣗ໌Ͱ͋Δࣄ͕ଟ͍ͱײ͡Δ w ࠗ׆ϚονϯάΞϓϦ w Ϛονϯά͕͗͢Δͱࢢ͕ബ͘ͳΔδϨϯϚ w ೖΕՁ֨ w
ʮೖΕՁ֨Λ্͍͛ͨʯʮརӹ૬Ͱ ʯ w ೖΕʹϚʔδϯ Λͤͯച͍ͬͯͨˠೖΕ্͕͕Δͱૈར૿ w ͚ϧʔϧΛม͑Δॴ͔Βͬͨ w ۀͦͷͷΛม͑ΒΕΔ༨͕ͲΕ͚ͩ͋Δ͔ -
5IF4FBSDIGPS-FBE1JQFT JO'MJOU .JDIJHBO<> w Ԗڅਫ -FBE1JQFT ͷަΛ͢ΔͨΊʹػցֶश༧ଌϞσϧΛར༻ͨ͠ࣄྫ w ,%%ʹ࠾͞Εͨจʹख๏͕ࡌ͍ͬͯΔ w
എܠ w ԖڅਫԖ༹͕ग़͠ͳ͍Α͏ʹද໘͕ίʔςΟϯά͞Ε͍ͯΔ w 'MJOUࢢʹ͓͍ͯਫݯΛม͑ͨ࣌ʹਫ࣭͕มΘͬͯίʔςΟϯά͕ണ͛ͨ w ਫಓਫͷԖͷ༹ग़ʹΑΔ݈߁ඃ͕ൃੜ w ߦͷهෆਖ਼֬ -
5IF4FBSDIGPS-FBE1JQFT JO'MJOU .JDIJHBO ଓ͖ w w ͲͷՈʹԖڅਫ͕ΘΕ͍ͯͯɺͦΕͲ͜ʹ͋Δͷ͔ w ݶΒΕͨ༧ࢉΛͲͷΑ͏ʹͯ͠ԖڅਫͷަʹׂΓͯΕ͍͍ͷ͔
w ঢ়گɾ੍ w ਫಓΛ۷Γىͯ֬͠ೝ͢Δίετ͕ߴ͍ ϥϕϧ͚ίετ w ܇࿅σʔλݶΒΕ͓ͯΓɺภ͍ͬͯΔ -
5IF4FBSDIGPS-FBE1JQFT JO'MJOU .JDIJHBO ଓ͖ w ௐࠪϙΠϯτܾఆϧʔϧ w ใΛऔಘͯ͠༧ଌੑೳΛ্͛Δͷ͕త w ೳಈֶश
"DUJWF-FBSOJOH w ύΠϓަϙΠϯτܾఆϧʔϧ w ޡ۷ίετΛ࠷খԽ͍ͨ͠ w ࠷֬ͷߴ͍ϙΠϯτΛબͿɺᩦཉ๏ (SFFEZ"MHPSJUIN -
ೳಈֶश "DUJWF-FBSOJOH w എܠ w ڭࢣ͋Γֶश܇࿅σʔλ͕ଟ͍ఔਫ਼্͕͕Δ w ͨͩ͠ϥϕϧ͚ Ξϊςʔγϣϯ ʹίετ͕͔͔Δ
w Ξϓϩʔν w ༧ଌثͷਫ਼্ʹد༩͢ΔσʔλΛબͿ w ํࡦͷྫ࠷ෆ͔֬ͳσʔλΛબ͢Δ w 'MJOUͰ*NQPSUBODF8FJHIUFE"DUJWF-FBOJOHΛ࠾༻ -
ᩦཉ๏ (SFFEZ"MHPSJUIN w ࢼߦຖʹͦͷ࣌Ͱ࠷ظใु͕େ͖ͳߦಈΛऔΔํࡦ w FHμΠΫετϥ๏ w ۙࣅղ͕ಘΒΕΔ w ʹΑͬͯϫʔετέʔεͷۙࣅʹཧอূ͕͋Δ
w FHφοϓαοΫ w େମ্ख͍࣮͕͘͘͠༰қͳͷͰΑ͘ΘΕΔ -
͞ΒͳΔࠔ w ࢪࡦͷධՁύΠϓަ݅͋ͨΓͷίετݮྔ w ˠ w .ͷઅ w
Ռग़ͨͷͷࢢຽ͕ൃ w ਓؒͷ໋Λٹ͏ͣͩͬͨ"*͕࣏ͱແʹΑͬͯແࢹ͞Εͯ͠·ͬͨ IUUQTOPUFNVEBUBTDJFODFOOEFCEEBGF w ΞϧΰϦζϜΛݟΕΘ͔Δ௨Γɺेͳ༧ࢉ͕͋ΕશॅΛ۷Γฦ͠ ͯݕࠪ͢ΔࣄʹͳΔɻௐࠪ͢Δॱ൪͕ૣ͍͔͍͔ͷҧ͍ɻ w ࠷దͱҰମԿͳͷ͔ -
ྦྷੵใुΛ࠷େԽ͍ͨ͠ ࢼߦճ ͋ͨΓճ Q ㅟ εϩοτϚγϯ" εϩοτϚγϯ#
֬QͰͨΓ͕ग़ΔϕϧψʔΠࢼߦΛߟ͑Δɺ͜ͷޙͲ͏͖͔͢ ෳ͋ΔબࢶͦΕͧΕ͔Β֬త JJE ʹใु͕ಘΒΕΔઃఆͰγʔέϯγϟϧʹ ߦಈΛܾΊͯྦྷੵใु࠷େԽΛࢦ͢Λʮ֬తόϯσΟοτʯɺ͜ͷ࣌ ͷબࢶΛʮΞʔϜʯͱݺͿɻ -
֬తόϯσΟοτͷํࡦ w ֬Ұக๏ w ΞʔϜa ͷظ͕࠷େͰ͋Δ֬ͰaΛબ͢Δ w ͲͷΑ͏ʹ w
ϥϯυຖʹ w ΞʔϜͦΕͧΕͷظͷࣄޙ͔ΒЖaΛੜ ㅟ w Жa ͕࠷େͷΞʔϜΛબ͢Δ ㅟ w ݁Ռͷ؍ଌΛͯ͠બͨ͠ΞʔϜͷهΛߋ৽ w 㱺5IPNQTPO4BNQMJOH -
Results: Ordinary least squares ================================================================== Model: OLS Adj. R-squared: 0.946
Dependent Variable: y AIC: 3196.9303 Date: 2019-04-04 00:32 BIC: 3230.7426 No. Observations: 506 Log-Likelihood: -1590.5 Df Model: 8 F-statistic: 1110. Df Residuals: 498 Prob (F-statistic): 8.68e-312 R-squared: 0.947 Scale: 31.960 -------------------------------------------------------------------- Coef. Std.Err. t P>|t| [0.025 0.975] -------------------------------------------------------------------- CRIM -0.1858 0.0380 -4.8884 0.0000 -0.2605 -0.1111 ZN 0.0833 0.0146 5.7100 0.0000 0.0546 0.1119 CHAS 3.8725 1.0130 3.8227 0.0001 1.8821 5.8629 NOX -18.5928 3.0070 -6.1833 0.0000 -24.5007 -12.6849 RM 6.8287 0.2539 26.8931 0.0000 6.3298 7.3276 DIS -1.3713 0.1736 -7.8985 0.0000 -1.7124 -1.0302 RAD 0.2022 0.0711 2.8420 0.0047 0.0624 0.3420 TAX -0.0180 0.0038 -4.7172 0.0000 -0.0255 -0.0105 ------------------------------------------------------------------ ྫ#PTUPOෆಈ࢈Ձ֨σʔλͷઢܗճؼ #PTUPOIPVTFQSJDFTEBUBTFUΛલॲཧແ͠Ͱ0-4ͨ݁͠Ռ -
ਪఆʹ༧ଌͷෆ͔֬͞Λө͢Δ w wͷࣄޙ͔Βੜͨ͠wΛͬͯਪఆΛٻΊΔ ㅟ w ใु͕ઢܗϞσϧ͔Βੜ͞ΕΔઃఆͷόϯσΟοτͷղ๏<> w 5IPNQTPO4BNQMJOHGPS$POUFYUVBM#BOEJUTXJUI-JOFBS1BZP⒎T<> w ϕΠδΞϯϒʔτετϥοϓͰࣄޙΛੜ͢ΔҊ<>
w ิ$POUFYUVBM#BOEJU w ϥϯυຖʹίϯςΩετใ͕༩͑ΒΕΔઃఆ w ࠂ৴ΞʔϜ͚ͩͰใु͕JJEʹੜ͞ΕΔͱݴ͑ͳ͍ͷͰίϯςΩ ετΛ͏ -
5IPNQTPO4BNQMJOH w ࣄޙ͔֬ΒͷαϯϓϧΛར༻͢Δ w ଟόϯσΟοτͷ༷ͳ׆༻ͱ୳ࡧ͕ඞཁͳ࣌ʹڧ͍ w ใुͷ৴པ্ݶʹجͮ͘બΛߦͳ͏ख๏ 6$# ΑΓੑೳ͕ྑ͍ w
όϯσΟοτʹద༻͢Δͱڧ͍ࣄΒΕ͍͕ͯͨɺੑೳͷཧղੳ͕ ͞Εͨͷ -
*ODSFNFOUBMJUZ#JEEJOH"UUSJCVUJPO<> w /FUqJYͷਓͷ35#ೖࡳઓུ w 35#ࠂදࣔݖརͷϦΞϧλΠϜΦʔΫγϣϯ w ࠂͷҼՌޮՌ͕࠷େʹͳΔೖࡳΛ͍ͨ͠ w ༧ଌೖࡳϦΫΤετຖ ԯճEBZ
w ༧ଌͷෆ͔֬͞Λදݱ͢ΔͷʹύϥϝʔλΛࣄޙ͔Βੜ w ༰ΓΓͷ8PSLJOH1BQFSͰݟॴ͕ଟ͍ w ࠂͷϥϯμϜԽൺֱࢼݧ (IPTU"ET ɺޮՌͷݮਰϞσϧ -
ΦϯϥΠϯͰΓ͍ͨ w ੍ΛͲΕ͚ͩҧ͢Δ͔ɺͬͯΈͳ͍ͱΘ͔Βͳ͍ w ੍Λҧͯͨͩͪ͠ʹఀࢭ͢ΔͷࠔΔ ؇੍͍ w 0OMJOF$POWFY0QUJNJ[BUJPOXJUI4UPDIBTUJD$POTUSBJOUT<> w
G Y H Y ͦΕͧΕඍͰ͖Εྑ͍ w ࣮ݧσʔληϯλʔͷফඅిྗΛ࠷খԽ͢ΔόονδϣϒͷׂΓ͋ͯ -
ࢀߟจݙ <>"CFSOFUIZ +BDPC FUBM"DUJWF3FNFEJBUJPO5IF4FBSDIGPS-FBE 1JQFTJO'MJOU .JDIJHBO1SPDFFEJOHTPGUIFUI"$.4*(,%% *OUFSOBUJPOBM$POGFSFODFPO,OPXMFEHF%JTDPWFSZ%BUB.JOJOH"$. <>"HSBXBM
4IJQSB BOE/BWJO(PZBM'VSUIFSPQUJNBMSFHSFUCPVOETGPS UIPNQTPOTBNQMJOH"SUJpDJBMJOUFMMJHFODFBOETUBUJTUJDT <>ຊଟ३ BOEதଜಞόϯσΟοτͷཧͱΞϧΰϦζϜߨஊࣾ <>"HSBXBM 4IJQSB BOE/BWJO(PZBM5IPNQTPOTBNQMJOHGPSDPOUFYUVBM CBOEJUTXJUIMJOFBSQBZP⒎T*OUFSOBUJPOBM$POGFSFODFPO.BDIJOF -FBSOJOH -
ࢀߟจݙ <>-FXJT 3BOEBMM" BOE+F⒎SFZ8POH*ODSFNFOUBMJUZ#JEEJOH "UUSJCVUJPO <>$.Ϗγϣοϓʢஶʣݩాߒɼ܀ాଟتɼṤޱ೭ɼদຊ༟࣏ɼଜాঢ ʢ༁ʣύλʔϯೝࣝͱػցֶशʢ্ʣɿϕΠζཧʹΑΔ౷ܭత༧ଌ <>ଜాঢใཧͷجૅใͱֶशͷ؍తཧղͷͨΊʹαΠΤϯεࣾ
<>)B[BO &MBE*OUSPEVDUJPOUPPOMJOFDPOWFYPQUJNJ[BUJPO'PVOEBUJPOT BOE5SFOETJO0QUJNJ[BUJPO <>:V )BP .JDIBFM/FFMZ BOE9JBPIBO8FJ0OMJOFDPOWFYPQUJNJ[BUJPO XJUITUPDIBTUJDDPOTUSBJOUT"EWBODFTJO/FVSBM*OGPSNBUJPO1SPDFTTJOH 4ZTUFNT