Share
Embed
AWS とKARTE で作る User State Driven System / user-state-driven-system-with-aws-and-karte
AWS Summit Online 2021 でお話した
AWS とKARTE で作る User State Driven System について
https://aws.amazon.com/jp/events/summits/online/japan/
tik-son
May 12, 2021
Transcript
34 slides
-
1 AWS ͱKARTE Ͱ࡞Δ User State Driven Syste m Naohiko
Takemura / PLAID, Inc / Head of Engineering ɹɹʛɹɹ© PLAID Inc. AWS Summit Online 2021 ɹ -
2 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. ଜ
ঘ גࣜձࣾϓϨΠυ Head of Engineering Backend / Infra 201411݄ೖࣾ BlackMusic िΪλϦετ Թઘ ΠεΩʔ BizDev with CloudProvider github : tik-son 1 0 twitter : tikson ࣗݾհ -
3 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. גࣜձࣾϓϨΠυʹ͍ͭͯ
גࣜձࣾϓϨΠυ ౦ژதԝ۠ۜ࠲6-10-1 GINZA SIX 10 F ઃཱɿ201110݄ ैۀһɿ190໊ ※20209݄30 ࣌ 3 -
4 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Event
Driven System ʁ Event Driven System -
5 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Event
Driven Syste m • ΠϕϯτۦಈܕΞʔΩςΫνϟʢEDAʣɺΠϕϯτͷੜɺݕग़ɺফඅɺ͓ΑͼΠϕϯτͷରԠΛଅਐ͢Δ ιϑτΣΞΞʔΩςΫνϟύϥμΠϜͰ͢ɻ • Πϕϯτʮঢ়ଶͷେ෯ͳมԽ ( a signi fi cant change in state)ʯͱͯ͠ఆٛͰ͖·͢ɻͨͱ͑ɺফඅऀ͕ं Λߪೖ͢Δͱɺंͷঢ়ଶ͕ʮൢചதʯ͔ΒʮൢചࡁΈʯʹมΘΓ·͢ɻ ࣗಈंσΟʔϥʔͷγεςϜΞʔΩς Ϋνϟɺ͜ͷঢ়ଶͷมԽΛɺΞʔΩςΫνϟͷଞͷΞϓϦέʔγϣϯʹͦͷൃੜΛΒͤΔ͜ͱ͕Ͱ͖ΔΠ ϕϯτͱͯ͠ѻ͏߹͕͋Γ·͢ɻ https://en.wikipedia.org/wiki/Event-driven_architecture with Google Translat e Event Driven System -
6 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. •
γϯϓϧͳEvent Driven System Ͱ͋ΕɺAWSͷαʔϏεͷΈ߹ΘͤͰ؆୯ʹ࣮ݱͰ͖Δ https://aws.amazon.com/jp/lambda/ Event Driven System -
7 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. User
State Driven System ʁ User State Driven System -
8 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. User
State Driven Syste m • ਓͷঢ়ଶ( User State ) ͷมԽΛτϦΨʔʹۦಈ • ༷ʑͳγεςϜ͕ଘࡏ͢Δ͕ɺ࠷ऴతͳϦΞΫγϣϯઌͱͯ͠ਓͰ͋Δ͜ͱ͕ଟ͍ • ਓʹରͯ͠ɺదʹϦΞΫγϣϯ͕Ͱ͖ΕɺϢʔβମݧ্͕͠ɺγεςϜͷతΛୡ͘͢͠ͳΔͣ • ਓʹରͯ͠ɺదͳϦΞΫγϣϯΛ͢ΔͨΊʹʁ • ϢʔβΛΔ • User StateͷมԽΛϦΞϧλΠϜʹଊ͑ΒΕΔ͜ͱ(ϦΞϧλΠϜʹଊ͑ΒΕΕͦΕΑΓ͘ରԠग़དྷΔ ) • ଟ໘తʹϢʔβΛଊ͑ΒΕΔ͜ͱ • Ϣʔβʹ߹ΘͤΔ • จ຺ʹ߹ΘͤͨదͳखஈͰ߹ΘͤΒΕΔ͜ͱ ͜ΕΒΛຬͨ͢γεςϜΛࣗલͰ࡞Δʁ User State Driven System -
9 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. ֬ೝ͢Δ
جຊαʔϏε͝ར༻ํ๏Λ͝հ͠·͢ɻ ͓ಘͳಛయཱͭใ͕ຬࡌͰ͢ɻ ॳΊͯͷํ ְתּׅ然钠ׅ 6*رؠ؎ش٦ֽוזַזַ♳麦׃זְծ➙ ״إٔؗ،حف׃ְהְֲ倯䗳铣דׅկ UIرؠ؎ش٦ָ濼גֶֻץֹ 7אךرؠ؎ٕٝ٦ٕ DESIGN RULES » CHECK ׆ה⢪ִ،؎ذيֽ䲧ִת׃կ ֿך堣⠓ֶ鋅鷕׃זֻկ 窫㼎ծ 妜׃ְ ౙͷओɺ Ξλʔ COLLECTION OUTER 嗚稊勴⟝㼰׃㢌刿ֽׅדծ֮זך椚 䟝ך暟⟝ח⳿⠓ִ〳腉䚍ָ넝ֻזתׅկ 勴⟝㢌ִג嗚稊׃גגְֻׁկ ׀䋞劄ך暟⟝כ 鋅אַתׇד׃ַ ꟗׄ ҰਓҰਓʹ߹Θͤͨ ސ٬ମݧΛఏڙ WebαΠτͷ๚ऀͷߦಈΛ ސ٬͝ͱʹϦΞϧλΠϜʹղੳ KARTEʹ͍ͭͯ CX(ސ٬ମݧ)ϓϥοτϑΥʔϜ -
10 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. CX(ސ٬ମݧ)ϓϥοτϑΥʔϜ
KARTEʹ͍ͭͯ ϢʔβΛΔ • User StateͷมԽΛϦΞϧλΠϜʹଊ͑ΒΕΔ͜ͱ • ଟ໘తʹϢʔβΛଊ͑ΒΕΔ͜ͱ Ϣʔβʹ߹ΘͤΔ • จ຺ʹԠͯ͡αΠτ্/αΠτ֎ͷ༷ʑͳखஈͰ߹ΘͤΒΕΔ͜ͱ -
11 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. CX(ސ٬ମݧ)ϓϥοτϑΥʔϜ
KARTEʹ͍ͭͯ ϢʔβΛΔ • User StateͷมԽΛϦΞϧλΠϜʹଊ͑ΒΕΔ͜ͱ • ଟ໘తʹϢʔβΛଊ͑ΒΕΔ͜ͱ Ϣʔβʹ߹ΘͤΔ • จ຺ʹԠͯ͡αΠτ্/αΠτ֎ͷ༷ʑͳखஈͰ߹ΘͤΒΕΔ͜ͱ -
12 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. CX(ސ٬ମݧ)ϓϥοτϑΥʔϜ
KARTEʹ͍ͭͯ + External System ϢʔβΛΔ • User StateͷมԽΛϦΞϧλΠϜʹଊ͑ΒΕΔ͜ͱ • ଟ໘తʹϢʔβΛଊ͑ΒΕΔ͜ͱ Ϣʔβʹ߹ΘͤΔ • จ຺ʹԠͯ͡αΠτ্/αΠτ֎ͷ༷ʑͳखஈͰ߹ΘͤΒΕΔ͜ͱ -
13 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. CX(ސ٬ମݧ)ϓϥοτϑΥʔϜ
KARTEʹ͍ͭͯ External System ϢʔβΛΔ • User StateͷมԽΛϦΞϧλΠϜʹଊ͑ΒΕΔ͜ͱ • ଟ໘తʹϢʔβΛଊ͑ΒΕΔ͜ͱ Ϣʔβʹ߹ΘͤΔ • จ຺ʹԠͯ͡αΠτ্/αΠτ֎ͷ༷ʑͳखஈͰ߹ΘͤΒΕΔ͜ͱ Amazon S3 Amazon EventBridge + -
14 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Realtime
Analysis/Action Engine … Latest User State KARTE ར༻ऀ༷ ͷΤϯυϢʔβ ࣄલʹઃఆ͞ΕͨτϦΨʔͱ Latest User Stateʹج͍ͮͯɺ ActionΛ࣮ߦ 0.x sec etc… Action ૹ৴͞ΕΔEvent͝ͱʹUser Stat e ΛϦΞϧλΠϜʹղੳ Event (Userͷߦಈσʔλ) Realtim e Analysis/Action Engine Action ActionτϦΨʔͷͨΊͷ SegmentͳͲΛઃఆ KARTE ར༻ऀ༷ -
15 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. KARTEಋೖاۀ༷
Ұ෦ൈਮ ※20213݄30࣌ʢABC/50Իॱʣ EC / ૯߹௨ൢ ۚ༥ / อݥ IT / αʔϏε ϝʔΧʔ ਓࡐ ඒ༰ / ϔϧεέΞ ෆಈ࢈ / ॅใ ڭҭ / ֶश ཱྀߦ / ަ௨ ίϯςϯπ -
16 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. External
Interface … Latest User State KARTE ར༻ऀ༷ ͷΤϯυϢʔβ ࣄલʹઃఆ͞ΕͨτϦΨʔͱ Latest User Stateʹج͍ͮͯɺ ActionΛ࣮ߦ etc… Action ૹ৴͞ΕΔEvent͝ͱʹUser Stat e ΛϦΞϧλΠϜʹղੳ Event (Userͷߦಈσʔλ) Realtim e Analysis/Action Engine External Interfac e Realtim e - External Actio n - Api Batc h - Datahub 0.x sec -
17 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. External
Interface … Latest User State KARTE ར༻ऀ༷ ͷΤϯυϢʔβ ࣄલʹઃఆ͞ΕͨτϦΨʔͱ Latest User Stateʹج͍ͮͯɺ ActionΛ࣮ߦ etc… Action ૹ৴͞ΕΔEvent͝ͱʹUser Stat e ΛϦΞϧλΠϜʹղੳ Event (Userͷߦಈσʔλ) Realtim e Analysis/Action Engine External Interfac e Realtim e - External Actio n - Api Batc h - Datahub 0.x sec KARTE ར༻ऀ༷ ͷAWSڥ Amazon EventBridge Amazon S3 -
18 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Realtime
External Interface (External Action) • Realtime External Interface (External Action) • Realtime External Interface (Api ) • Batch Interface (Datahub) Amazon EventBridge Amazon EventBridge Amazon S3 With With With -
19 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. External
Action ͱʁ Event … Latest User State KARTE ར༻ऀ༷ ͷΤϯυϢʔβ ࣄલʹઃఆ͞ΕͨτϦΨʔͱ Latest User Stateʹج͍ͮͯɺ ActionΛ࣮ߦ 0.x sec ૹ৴͞ΕΔEvent͝ͱʹUser Stat e ΛϦΞϧλΠϜʹղੳ ExternalAction … Latest User State KARTE ར༻ऀ༷ ͷAWSڥ Realtim e Analysis/Action Engine Amazon EventBridge … etc… Action -
20 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Amazon
EventBridge ͱʁ https://ap-northeast-1.console.aws.amazon.com/events/home?region=ap-northeast-1 -
21 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Ϣʔβͷঢ়ଶʹԠͨ͡ిαϙʔτ
Event … Latest User State KARTE ར༻ऀ༷ ͷΤϯυϢʔβ ࣄલʹઃఆ͞ΕͨτϦΨʔͱ Latest User Stateʹج͍ͮͯɺ ActionΛ࣮ߦ 0.x sec Action ૹ৴͞ΕΔEvent͝ͱʹUser Stat e ΛϦΞϧλΠϜʹղੳ ExternalAction … Latest User State KARTE ར༻ऀ༷ ͷAWSڥ Realtim e Analysis/Action Engine Amazon EventBridge … AWS Lambda Amazon Connect ᶄిΛ͔͚͍ͨstateͰ͋Δ͜ͱΛτϦΨʔʹ Amazon EventBridge ʹ User StateΛૹ৴ ᶃKARTEͰදࣔͨ͠αΠτ্ͷϙοϓΞοϓ Ͱ `ిΛ͍߹ΘͤΔ` Λબ͢Δ͜ͱͰɺ ίʔϧόοΫʹඞཁͳEvent͕ൃੜ ᶅUser State͔Β ඞཁͳใΛऔಘ/Ճ͠ɺ Amazon ConnectͷapiΛcall ᶆLambda͔Β͖ͬͯͨใΛɺ Amazon ConnectͷContactFlo w Ͱར༻͠ɺFlowʹै͍ిΛ͔͚Δ -
22 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. ݟग़͠ςΩετ
͜ΕʹΑΓɺ·͓ͣ٬༷ͷ͕ͪ࣌ؒݮ͞Ε·͠ ͨɻٙͷղফͷਫ਼্͕ΔͷͰɺ͓٬༷ʹͱͬͯͷ Θ͠͞Λ੍͢Δ͜ͱ͕Ͱ͖·͢ɻ knowbeͷαʔϏεͷੑ্࣭ɺITϦςϥγʔͷߴ͍͓٬༷ ͔ΓͰͳ͘ɺిରԠͷχʔζڧ͋͘Γ·͢ɻͦ ͜ʹஸೡʹ͖߹͑ΔΑ͏ʹͳͬͨͱߟ͍͑ͯ·͢ɻ Ϣʔβͷঢ়ଶʹԠͨ͡ిαϙʔτ https://cxclip.karte.io/interview/recruit/ -
23 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Realtime
External Interface (Api) • Realtime External Interface (External Action) • Realtime External Interface (Api ) • Batch Interface (Datahub) Amazon EventBridge Amazon EventBridge Amazon S3 With With With -
24 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. KARTE
Apiͱʁ ,"35& ΣϒαΠτ/ΞϓϦ্ͰܭଌͰ͖ͳ͍ ҙͷΠϕϯτͷૹ৴ Track API Talk API KARTE TALKͰͷ ΤϯυϢʔβͱͷϝοηʔδͷΓऔΓ ୲ΦϖϨʔλʔͷૢ࡞ͳͲ Datahub API KARTE DatahubͰͷ δϣϒͷ࣮ߦใऔಘͳͲ KARTEͷػೳΛ֎෦γεςϜ͔ΒApi࣮ߦͰ͖Δػೳ 2021/02ʹGA൛ͷఏڙ։࢝ -
25 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Api
hook with Amazon EventBridge ,"35& Talk hook KARTE TALKͰͷ ΤϯυϢʔβͱͷϝοηʔδɺ ୲ΦϖϨʔλʔͷૢ࡞ใͳͲ Datahu b hook KARTE DatahubͰͷ δϣϒͷ࣮ߦ։࢝/ऴྃใͳͲ Amazon EventBridge ಛఆͷॲཧΛτϦΨʔʹɺAmazon EventBridgeʹApiͰऔಘͰ͖ΔσʔλΛ͛Δػೳ -
KARTE ར༻ऀ༷ͷAWSڥ Chat messag e from user KARTE ར༻ऀ༷ ͷΤϯυϢʔβ
ᶆAmazon ComprehendͰ ײੳͱΩʔϫʔυΛநग़ ᶅ ϝοηʔδͷதΛͬͯ Amazon ComprehendͷapiΛcall ᶇKARTE TALK apiΛlamdaΛͬͯcall͠ɺײੳσʔλΛݩʹͨ͠ϝοηʔδΛૹ৴ ᶃ KARTE TALKͰΤϯυϢʔβ͕ϝοηʔδΛૹ৴ ᶄΤϯυϢʔβͷϝοηʔδૹ৴ΛτϦΨʔʹ Amazon EventBridge ʹϝοηʔδΛhook 26 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. ײੳνϟοτϘοτ Chat messag e from operator … … Amazon EventBridge AWS Lambda Amazon Comprehend -
27 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. ࿈ܞΠϯλʔϑΣʔε
ʹAmazon EventBridge ΛબΜͩཧ༝ • ϊʔίʔυ͔ͭӡ༻ίετෆཁͰ؆୯ʹϢʔβͷAWSڥͱܨ͛ΒΕΔ • AWSͷαʔόϨεจ຺ͷத৺తͳଘࡏɻLambdaͳͲʹγʔϜϨεͰ؆୯ʹܨ͛ΒΕΔ • KARTEͱAmazonEventBridgeͷ࿈ܞ෦ͷ։ൃ͕ඇৗʹ؆୯ (࣮࣭Ұिؒ) + Amazon EventBridge -
28 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. Batch
External Interface (Datahub) • Realtime External Interface (External Action) • Realtime External Interface (Api ) • Batch Interface (Datahub) Amazon EventBridge Amazon EventBridge Amazon S3 With With With -
29 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. KARTE
Datahub ͱʁ ࣾ֎ʹଘࡏ͢ΔଟछେྔͳσʔλΛKARTEʹ౷ ߹͠ɺΑΓߴͳηάϝϯςʔγϣϯΞΫγϣϯ ͷ࣮ߦʹՃ͑ͯɺϏδωε্ͷਝͳҙࢥܾఆΛࢧ ԉ͢Δʮσʔλ౷߹ɾར׆༻ϓϥοτϑΥʔϜʯ -
30 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. KARTE
Datahub ͷߏཁૉ KARTE֎ʹଘࡏ͢ΔଟछେྔͳσʔλΛ౷߹ɾཧɾੳ͢ΔʮσʔλςʔϒϧʯΛத৺ʹɺ σʔλͷੳ݁Ռʹج͖ͮɺKARTEͰܭଌ͞ΕͨϢʔβʔσʔλʹ৽ͨͳଐੑใΛ༩͢Δʮඥ͚ςʔϒϧʯͱ ٬αʔϏεͷίϯςϯπͱͯ͠׆༻͢ΔʮΞΫγϣϯςʔϒϧʯͰߏ͞ΕΔ -
31 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. ΦϑϥΠϯσʔλ౷߹Ϩίϝϯσʔγϣϯ
KARTE ར༻ऀ༷ ͷΤϯυϢʔβ ᶃOnlineUser activity DataͷExport jobΛ DatahubͰ࣮ߦ͠S3ʹExport ᶆ Amazon Personalize Ͱ Recommendation DataΛ όονͰਪ Latest User State … ᶉ ࣄલʹઃఆ͞ΕͨτϦΨʔ + Latest User State + ඥ͚ςʔϒϧ + ΞΫγϣϯςʔϒϧ Λར༻͠ɺActionΛ࣮ߦ ᶈ Ϣʔβ͕αΠτͰߦಈ Event ʴ ᶊ ϢʔβͷߦಈσʔλʹԠͨ͡ΞΠςϜΛϨίϝϯυ KARTE ར༻ऀ༷ͷAWSڥ ᶅ Amazon AthenaͰ OnlineͱOf fl ineͷDataΛjoin ʴ ᶇ KARTE Datahub apiΛcall͠ ɹҎԼͷImport jobΛ࣮ߦ ɹ- recommendation data -> ඥ͚ςʔϒϧ ɹ- item data -> ΞΫγϣϯςʔϒϧ Onlin e User activity Data Of fl in e User activity Data Online and of fl in e User activity Data Recommendatio n Data Item Data ᶅ ᶆ ᶇ ᶇ Amazon EventBridge ᶄ jobྃΛhook Step Functions Amazon Athena Amazon Personalize Amazon S3 AWS Lambda AWS Lambda AWS Lambda -
32 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. ࿈ܞΠϯλʔϑΣʔεʹAmazon
S3 ΛબΜͩཧ༝ • ϊʔίʔυ͔ͭӡ༻ίετෆཁͰ؆୯ʹϢʔβͷAWSڥͱܨ͛ΒΕΔ • AWSͷσʔλॲཧͷத৺తͳଘࡏͰɺ͞·͟·ͳσʔλܥͷServiceͱ࿈ܞͰ͖Δ • ѹతͳ֎෦ΤίγεςϜ • ރΕٕͨज़(15पɺ100ஹΦϒδΣΫτʂ ) • ϓϩμΫτͯ͠ͷັྗ • S3 Select, Strong Consistency etc ... + Amazon S3 -
34 AWS Summit Online 2021 ɹ ɹɹʛɹɹ© PLAID Inc. ·ͱΊ
… Latest User State KARTE ར༻ऀ༷ ͷΤϯυϢʔβ ࣄલʹઃఆ͞ΕͨτϦΨʔͱ Latest User Stateʹج͍ͮͯɺ ActionΛ࣮ߦ etc… Action ૹ৴͞ΕΔEvent͝ͱʹUser Stat e ΛϦΞϧλΠϜʹղੳ Event (Userͷߦಈσʔλ) Realtim e Analysis/Action Engine External Interfac e Realtim e - External Actio n - Api Batc h - Datahub Amazon EventBridge Amazon S3 0.x sec + = ∞ ϢʔβΛΔ • User StateͷมԽΛϦΞϧλΠϜʹଊ͑ΒΕΔ͜ͱ • ଟ໘తʹϢʔβΛଊ͑ΒΕΔ͜ͱ Ϣʔβʹ߹ΘͤΔ • จ຺ʹԠͯ͡αΠτ্/αΠτ֎ͷ༷ʑͳखஈͰ߹ΘͤΒΕΔ͜ͱ