A/Bテスト機構がもたらす 大胆な開発体制及び ゆるやかなアプリ体験の変化 / Architecture and benefits of AB-test allocation system.

presentation @yahoo, Bonfire API#1.

Transcript

1. "#ςετػߏ͕΋ͨΒ͢
 େ୾ͳ։ൃମ੍ٴͼ
 ΏΔ΍͔ͳΞϓϦମݧͷมԽ
   #POpSF
   "1*
   
   גࣜձࣾ(VOPTZ
   
   
   ৽نࣄۀ։ൃࣨΤϯδχΞ
 4FJKJ
   5BLBIBTIJ
   !@@UJNBLJO@@
2. Seiji Takahashi 
 ͪ·͖Μ @__timakin__ • Career • DeNA • Platform Development • Serverside Engineering (Perl)
 • Translimit • Game Development: Craft Warrirors • Game Client Side (Cocos-2dx, C++)
 • Gunosy • Application Dev: LUCRA • Serverside Engineering (Go) • iOS Client Side (Swift) • Engieering • Language: Go (Contributed), Swift • Platform: GAE, AWS
4. ΞδΣϯμ w "#ςετͱ͸
   w ͲΜͳ"#Λ͢Δ͔
   w "#ج൫
   w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ
5. ΞδΣϯμ w "#ςετͱ͸
   w ͲΜͳ"#Λ͢Δ͔
   w "#ج൫
   w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ
6. "#ςετͱ͸ʁ ࢪࡦͷଥ౰ੑɺԾઆΛݕূ͢ΔͨΊʹɺ
 ϢʔβʔΛαϯϓϦϯάͯ͠ɺ
 6*ͳ͍͠σʔλͷมߋͳͲͷ
 ӨڹΛςετ͢Δ΍ͭ
7. "#ςετͷ஫ҙ఺ ݁Ռʹରͯ͠ɺ૬ޓ࡞༻Λ࣋ͬͯ͠·͏Α͏ ͳςετ͸ಉ࣌ฒߦͰ૸Βͤͯ͸μϝ FY
   νϡʔτϦΞϧͷϑϩʔΛ௥Ճ͢ΔςετΛ͢Δͱ͖ʜ
   ؾʹͳΔΧςΰϦͷબ୒ͱɺ
 ϑΥϩʔ͍ͨ͠ഔମͷબ୒ͳͲΛಉ࣌ʹߦΘͤΔͱɺ
   લͷೖྗʹҾ͖ͣΒΕͯޙͷબ୒܏޲͕มΘͬͯ͠·͏ɻ
   
8. "#ςετͷ஫ҙ఺ ࢪࡦҎ֎ͷཁҼʹΑͬͯ,1*͕
 ্Լ͍ͯ͠ͳ͍͔ ""ςετ Ϣʔβʔ฼਺͕গͳ͘ɺ਺ࣈ͕όϥ͖ͭқ͍࣌͸ɺ
   ςετҎ֎ͷཁҼʹΑͬͯ݁Ռ্͕Լ͢ΔՄೳੑ͕͋Δɻ
   ࣮ࡍʹػೳ͕ಋೖ͞ΕΔલʹɺର৅ϢʔβʔͷߦಈܭଌΛ
 ͓͍ͯͯ͠ɺςετҎ֎ͷཁҼͷӨڹ͕΄΅ͳ͍͜ͱΛ֬ೝ͢Δɻ
   
9. ΞδΣϯμ w "#ςετͱ͸
   w ͲΜͳ"#Λ͢Δ͔
   w "#ج൫
   w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ
10. ࣮ࡍͷ"#ςετྫ w 1VTI഑৴ճ਺ௐ੔ςετ
    w σΠϦʔͷ1VTI഑৴ճ਺͸ͲΕ͘Β͍͕Ұ൪ܧଓ཰ʹޮ͍ ͯ͘Δͷ͔
    w dճͷϨϯδͰଧͪ෼͚
11. ࣮ࡍͷ"#ςετྫ w ΧςΰϦ಺هࣄදࣔग़͠Θ͚
    w ৽نϢʔβʔ޲͚Φεεϝهࣄ
    w هࣄͷߋ৽೔࣌ͷ઱౓
    w ಛఆΧςΰϦͷهࣄΛଟΊʹΦεεϝʹදࣔ
12. ࣮ࡍͷ"#ςετྫ w ݕࡧ݁Ռιʔτػೳ
    w ٻΊΔ৘ใΛΑΓಘ΍͘͢͢ΔιʔτػೳΛ࣮૷͢Δ͜ͱͰɺ ݕࡧ69ͷ޲্ɺͻ͍ͯ͸ܧଓ཰΍ଞߦಈΛଅਐ͢Δ͔
    w Φεεϝݹ͍৽͍͠ݕࡧϫʔυͱͷϚον౓߹͍ͳͲͰ ݕࡧ݁ՌΛιʔτՄೳʹ͢ΔόʔΛදࣔ
    w ֤બ୒ࢶͷબ୒཰ɺճ਺
13. ΞδΣϯμ w "#ςετͱ͸
    w ͲΜͳ"#Λ͢Δ͔
    w "#ج൫
    w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ
14. "#ج൫ "#
    "1* NBJO
    "1* 6TFS
    %# "#
    %# ෼ੳج൫ ࣮ࢪج൫
15. "#ׂΓ౰ͯ શମϢʔβʔ "MMPDBUJPO &YQFSJNFOU 7BSJBOU "MMPDBUJPO &YQFSJNFOU 7BSJBOU
16. "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU "MMPDBUJPO શମϢʔβʔͷதͰͷׂ౰཰ɻ
 "#ςετΛॏෳͳ࣮͘ࢪ͢Δͨ Ίͷάϧʔϐϯά৘ใɻ
    "MMPDBUJPO*%͕ಉҰͳΒɺ
 ͦΕʹॴଐ͢Δ"#ςετ͸
 ಉ࣌ʹ࣮ࢪ͢Δ͜ͱ͕Ͱ͖ͳ͍ɻ

17. "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU &YQFSJNFOU "#ςετͦͷ΋ͷɻ
 ྫ͑͹1VTI഑৴ճ਺"#Λ࣮ࢪ ͢ΔͳΒɺͦΕʹඥͮ͘Ұݸͷ &YQFSJNFOU͕࡞ΒΕΔɻ
    ଞͷ&YQFSJNFOUͱ
 ޡೝ͞Εͳ͍Α͏ʹɺ
 ϥϯμϜͳLFZ͕ৼΒΕΔɻ
    
18. "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU 7BSJBOU "#ςετέʔεɻ
    ྫ͑͹1VTI഑৴ճ਺"#Λ࣮ࢪ ͢ΔͳΒɺʮ̍ճʯʮ̎ճʯͳͲ ͷݸผέʔεΛද͢ɻ
    &YQFSJNFOU͕ϢχʔΫͰ͑͞ ͋Ε͹ɺ໊લ͕ଞͷ7BSJBOUͱඃͬ ͯ΋໰୊ͳ͍ͷͰɺIVNBO SFBEBCMFͳLFZΛৼΔɻ

19. w "MMPDBUF
    w Ϣʔβʔ*%ΛݩʹIBTIΛੜ੒͠ɺಉ͡άϧʔϓͷத͔ΒͲ ͷ"#ςετɺςετέʔεΛ࣮ࢪ͢Δ͔ܾΊΔɻ "#ׂΓ౰ͯ
21. ΞδΣϯμ w "#ςετͱ͸
    w ͲΜͳ"#Λ͢Δ͔
    w "#ج൫
    w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ
22. w ػೳಋೖΛେ୾ʹ͢Δ
    w ϢʔβʔӨڹ͕ඇৗʹେ͖͍ػೳΛϦϦʔε͢Δࡍɺ
 "#ج൫Λར༻͢Δ͜ͱͰɺ͘͝Ұ෦ͷݶఆ͞Εͨ
 Ϣʔβʔʹల։Ͱ͖Δ
    w ݁ՌɺϢʔβʔ΁ͷωΨςΟϒӨڹ͕খ͍͞ঢ়ଶͰ
 େ͖͍ػೳΛϦϦʔεͰ͖ɺϦϦʔε΁ͷ৺ཧোน͕Լ͕Δɻ "#͸։ൃମ੍ΛͲ͏ม͑Δ͔
23. w ຊ౰ʹޮ͘ࢪࡦΛߟ͑ΔΑ͏ʹͳΔ
    w ҰݟPSҰฉ͢Δͱө͑Δػೳ΋ɺϦϦʔεͯ͠ޮՌଌఆͨ͠ Βɺ݁Ռతʹ,1*ʹωΨςΟϒʹޮ͍ͯ͠·͏͜ͱ΋ɻ
    w ௚઀໨ʹݟ͑ͳ͍ɺϓϩμΫτΛ࢖͏Ϣʔβʔͷϖϧιφ͕ ঃʑʹ໌֬ʹͳ͍ͬͯ͘ͱಉ࣌ʹɺࢪࡦͱͯ͠౰ͨΓқ͍΋ ͷ͕Կ͔Θ͔ΔΑ͏ʹͳͬͯ͘Δɻ "#͸։ൃମ੍ΛͲ͏ม͑Δ͔
24. w ʮյΕͳ͍ΞϓϦʯ͕࢖͑Δ
    w "#ج൫Λར༻ͨ͠HSBDFGVMͳϦϦʔεϑϩʔʹΑͬͯɺ
 ΞϓϦ͕ಥ೗Ϋϥογϡ͢ΔΑ͏ͳػೳ͸ଈ࣌"#ׂΓ౰ͯ Λఀࢭ͢Δ͜ͱͰඇެ։ʹͰ͖Δɻ
    w ݁ՌɺϢʔβʔͱͯ͠͸໨ͷલͷΞϓϦ͕ΫϦςΟΧϧͳ
 ໰୊ʹΑͬͯ࢖͑ͳ͘ͳΔɺͱ͍ͬͨࣄଶ͕গͳ͘ͳΓɺ
 ҆৺ͯ͠ར༻Ͱ͖Δɻ "#͸ΞϓϦମݧΛͲ͏ม͑Δ͔
25. w ʢશମ࠷దతʹʣೲಘ౓ͷߴ͍ػೳ͕࢖͑Δ
    w ͦ΋ͦ΋,1*ʹޮ͔ͳ͍ɺงғؾΛΑ͘͢Δͱ͍͏ر๬త؍ ଌʹج͍ͮͯػೳΛϦϦʔε͢Δ͜ͱ͕ͳ͍ɻ
    w ݁ՌɺϢʔβʔͷߦಈ͕ຊ౰ʹվળ͞ΕͨػೳɺΞϓϦΛ௕ ͘࢖͏্Ͱେࣄʹͳͬͯ͘Δػೳ͚ͩΛར༻Ͱ͖Δɻ "#͸ΞϓϦମݧΛͲ͏ม͑Δ͔
26. ·ͱΊ w แؚɾഉଞͷؔ܎Λ໌֬ʹͨ͠ঢ়ଶͰ"#ςετΛ
 ߦ͏͜ͱ͸ɺ҆શͳϦϦʔεϑϩʔΛங্͘Ͱॏཁɻ
    w ͦ΋ͦ΋Ϣʔβʔମݧ͕վળ͠ͳ͍ػೳΛϦϦʔε͠ͳͯ͘ ࡁΉɻ։ൃऀͱϢʔβʔ૒ํ͕ϋοϐʔʹͳΕΔɻ
27. ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ