Amazon SQSコンシューマー疎結合への旅 - 出張！ #DevelopersIO IT技術ブログの中の人が語る勉強会 #3

Amazon EventBridge Pipes : A Decoupled Odyssey

出張！ #DevelopersIO IT技術ブログの中の人が語る勉強会 #3
https://classmethod.connpass.com/event/316028/
＠2024/04/18

Transcript

1. ग़ுʂ #DevelopersIO ITٕज़ϒϩάͷதͷਓ͕ޠΔษڧձ #3 ˏ2024/04/18 Amazon EventBridge Pipes : A Decoupled Odyssey GitHub/DevelopersIO : @quiver 1
2. 2 λΠτϧ͚ͩΛେ͖͘ݟͤ·͢
3. 3 SQSίϯγϡʔϚʔૄ݁߹΁ͷཱྀ https://dev.classmethod.jp/articles/ consistent-consumer- pipelining-with-eventbridge-pipes/
4. 4 ϓϩσϡʔαʔɾίϯγϡʔϚܕͷΠϕϯτ࿈ܞ
5. 5 re:Invent 2022Ͱൃද https://aws.amazon.com/blogs/aws/ new-create-point-to-point-integrations-between-event- producers-and-consumers-with-amazon-eventbridge- pipes/
6. 6 DevelopersIOͰ΋ೝ஌౓͕௿͍ • EventBridge Pipes ϒϩά͸Θ͔ͣ12ຊ • ͦͷ͏ͪ6ຊΛࣥච
7. 7 SQSίϯγϡʔϚʔૄ݁߹΁ͷཱྀ https://dev.classmethod.jp/articles/ consistent-consumer- pipelining-with-eventbridge-pipes/
8. 8 ϝοηʔδΩϡʔͱ͸? ϝοηʔδΩϡʔ͸ɺαʔόʔϨε͓ΑͼϚΠΫϩαʔ ϏεΞʔΩςΫνϟͰ࢖ΘΕΔඇಉظαʔϏεରαʔϏ εͷ௨৴ܗଶ ※จষͱਤͷҾ༻ݩ https://aws.amazon.com/jp/message-queue/
9. 9 Amazon SQS͸15೥Ҏ্ͷྺ࢙ • Amazon Simple Queue Service(SQS)͸AWS͕ఏڙ͢Δ ϝοηʔδΩϡʔ • 2004೥ޙ൒͔Βϕʔλӡ༻ • 2006೥͔ΒຊՔಇ • 15೥Ҏ্ͷྺ࢙ ※ https://aws.amazon.com/jp/blogs/news/amazon-sqs-15-years-and-still-queueing/
10. 10 SQSίϯγϡʔϚʔͷૄ݁߹΁ͷཱྀ 1. ϞϊϦε࣌୅ 2. Lambdaͷ஀ੜ 3. EventBridge Pipesͷ஀ੜ ※ਤͱจষͷҾ༻ݩ https://aws.amazon.com/jp/message-queue/
11. 11 ϞϊϦε࣌୅
12. 12 ϞϊϦε࣌୅ • ΞϓϦ͕͢΂ͯͷSQSૢ࡞Λ࣮૷ ◦ SQSΛϙʔϦϯά ◦ ϝοηʔδΛड৴ ◦ ϝοηʔδΛॲཧ ◦ ϝοηʔδΛSQS͔Β࡟আ • ࣮ߦج൫ ◦ EC2+AutoScaling౳Ͱ ϝοηʔδ਺ʹԠͯ͡εέʔϧ
13. 13 ϞϊϦε࣌୅
14. 14 Lambdaͷ஀ੜ
15. 15 Lambda࣌୅ • re:Invent 2014Ͱൃද ◦ SQSૢ࡞ΛΠϕϯτιʔεʹΦϑϩʔυ ◦ Lambda͸ϝοηʔδ࣮૷ͷΈ • ࣮ߦج൫ ◦ ϝοηʔδ਺ʹԠͯ͡ Lambda͕͍͍ײ͡ʹεέʔϧ
16. 16 Lambda࣌୅ • Πϕϯτιʔε͸LambdaͰࢦఆ͢ΔτϦΨʔ
17. 17 Lambda࣌୅ • ड͚औͬͨSQSϝοηʔδΛॲཧ͢Δ͚ͩ • ΞϓϦέʔγϣϯ͸SQSΛҙࣝ͠ͳ͍ • Lambda࣮ߦϩʔϧͰΠϕϯτιʔεͷߦ͏SQSΞΫγϣϯΛ ڐՄ ◦ sqs:ReceiveMessage ◦ sqs:DeleteMessage ◦ sqs:GetQueueAttributes
18. 18 EventBridge Pipesͷ஀ੜ
19. 19 EventBridge Pipesͷొ৔ • re:Invent 2022Ͱൃද • SQSૢ࡞ΛLambda͔ΒPipesʹҠಈ • ίϯγϡʔϚʔॲཧΛ3෼ׂ ◦ ιʔε(SQS) ◦ ϙʔϦϯά(Pipes) ◦ λʔήοτ(Lambda) • ιʔε΍λʔήοτ͸ ϓϥΨϒϧ
20. 20 EventBridge Pipesͷొ৔ • ॲཧํ๏͸LambdaΠϕϯτιʔεͱಉ౳ • Lambda࣮ߦϩʔϧʹSQSΞΫγϣϯ͸ෆཁ
21. 21 EventBridge Pipesͷొ৔ • PipesʹٻΊΒΕΔΞΫγϣϯ • ιʔεૢ࡞༻ ◦ sqs:ReceiveMessage ◦ sqs:DeleteMessage ◦ sqs:GetQueueAttributes • λʔήοτૢ࡞༻ ◦ lambda:InvokeFunction
22. 22 EventBridge Pipesͷ͓͔͛Ͱ ୭͕ԿΛ΍Δͷ͔໌֬ͳૄ݁߹ʹ!
23. 23 Amazon EventBridge Pipes : A Decoupled Odyssey