Lambda＆FargateとPlanetScaleで作るServerless Rails環境

AWSのLambdaとFargate、そしてPlanetScaleを組み合わせてサーバの管理をほとんどしなくても良い感じでスケールしてくれるインフラ環境を作れたのでそれの紹介をしています

Transcript

1. Serverless Rails ~ γϯϓϧͰεέʔϧ͢ΔΠϯϑϥ ~ 2024/07/13 JAWS-UG Okayama 2024 גࣜձࣾιχοΫΨʔσϯ ԕ౻ େհ / @ruzia LambdaˍFargateͱ PlanetScaleͰ࡞Δ
2. ࣗݾ঺հ ‣ ԕ౻ େհ / @ruzia ‣ גࣜձࣾ SonicGarden ‣ ϓϩάϥϚʔ / ࣥߦ໾һ ‣ Πϯϑϥͱػցֶशܥ͕޷͖ ‣ ࠷ۙGoogle Cloudʹුؾ͗Έ ‣ Vision Proָ͍͠
3. એ఻
5. https://sonicgarden.connpass.com/event/324540/
7. https://tsukuaso.connpass.com/
8. ຊ୊
9. ͜ΜͳΠϯϑϥ؀ڥཉ͘͠ͳ͍Ͱ͔͢ʁ ‣RailsͳͲͷϑϨʔϜϫʔΫΛͦͷ··࢖͑Δ ‣σʔλετΞʹ͸RDB͕࢖͑Δ ‣਺ඦΠϯελϯεͱ͔ࣗಈͰεέʔϧͯ͘͠ΕΔ ‣ඇಉظ / ఆظͷJob΋࣮ߦͰ͖Δ ‣One-o ff λεΫ΋࣮ߦͰ͖Δ
10. Q ͦΜͳΠϯϑϥ ͋ΔΜͰ͔͢ʁ
11. A AWSͱPlanetScaleΛ ૊Έ߹ΘͤΕ͹ ɹ࡞ΕΔʂ
12. ࠓ೔͸ͦΜͳ Πϯϑϥͷ࿩Λ͠·͢
13. ࿩͢͜ͱ ‣LambdaͱFargateΛ׆༻ͨ͠؀ڥ ‣Webαʔό ‣ඇಉظɾఆظJob ‣One-o f λεΫ ‣PlanetScaleʹΑΔεέʔϥϒϧͳRDB
15. LambdaͱFargateΛ ׆༻ͨ͠؀ڥ
16. ͦΕͧΕͷ ڧΈΛ׆͔͢
17. LambdaͷڧΈ ‣େن໛ʹεέʔϧ͢Δॠൃྗ ‣ܹ͍͠εύΠΫ΁ͷॊೈੑ Fargateʹ͸ͳ͍
18. FargateͷڧΈ ‣௕࣌ؒͷλεΫ࣮ߦ ‣ECS ExecͰίϯςφʹೖΕΔ Lambdaʹ͸ͳ͍
19. ͦΕͧΕͷڧΈΛ׆͔͢ ‣Lambda ‣εύΠΫͷܹ͍͠WebϦΫΤετ ‣15෼ະຬͰऴྃ͢ΔܰΊͷJob ‣Fargate ‣15෼Ҏ্࣌ؒͷ͔͔ΔॏΊͷJob ‣ϩάΠϯͯ͠৭ʑͨ͘͠ͳΔOne-o f λεΫ
20. ྆ऀΛྑ͍ײ͡Ͱ ѻ͏ࡍͷେࣄͳ ϙΠϯτ
21. େࣄͳϙΠϯτ ޻෉͢Ε͹ ಉ͡DockerΠϝʔδΛ ྆ํͰ࢖͑ͪΌ͏ ࣮͸
22. ϕʔεͷDockerΠϝʔδ͸ Lambda Runtime APIͰ Lambdaͱ΍ΓͱΓ Ͱ͖ΔΑ͏ʹ͢Δ
23. # Install the Runtime Interface Client RUN gem install --no-document aws_lambda_ric ENTRYPOINT ["/usr/local/bundle/bin/aws_lambda_ric"] CMD ["config/environment.Lamby.cmd"]
24. FargateͰ͸ඞཁʹԠͯ͡ CommandͱEntryPointΛ ΦʔόʔϥΠυ͢Δ
25. tasks: oneoff: name: ${self:service}-${self:provider.stage}-oneoff image: rails_image entryPoint: - '/bin/sh' - '-c' - "sleep infinity” command:
26. Web΋Job΋One-o f ΋ શͯΛ୯ҰͷDocker ΠϝʔδͰ࣮ߦͰ͖Δ
27. Webαʔό
28. Webαʔό ‣API Gatewayܦ༝Ͱݺͼग़͞ΕΔ ‣Runtime Interface Clientʹ
 ४ڌ͍ͯ͠Δඞཁ͕͋Δ
29. Railsͷ৔߹͸ Lambyͱ͍͏OSS͕ ໘౗Λݟͯ͘ΕΔ
31. ඇಉظJob
32. ඇಉظJob ‣WebαʔόͰಉظॲཧ͠ͳͯ͘΋
 ྑ͍෺͕౤͛ΒΕͯ͘Δ ‣SQSʹͨΊͯLambdaͰॱ࣍
 ࣮ߦ͍ͯ͘͠
33. Railsͷ৔߹͸ Lambdakiqͱ͍͏ OSSͰରԠՄೳ
35. ఆظJob
36. ఆظJob ‣ఆظతʹಈ͔͍ͨ͠όονॲཧ ‣EventBridge΍CloudWatch Events͔Β ࣮ߦ͢Δ ‣୹࣌ؒͷ΋ͷ͸Lambda΁ ‣௕࣌ؒͷ΋ͷ͸Fargate΁
37. functions: job: image: <<: *rails_image environment: ${self:custom.environment} memorySize: 1024 timeout: 890 events: - schedule: name: HourlyJob-${self:service}-${self:provider.stage} rate: cron(0 * * * ? *) input: lamby: runner: './bin/rails task:hourly_job'
38. fargate: tasks: HourlyJob: name: HourlyJob-${self:service}-${self:provider.stage} image: rails_image entryPoint: - '/bin/sh' - '-c' - "./bin/rails task:hourly_job" command: schedule: 'cron(0 * * * ? *)'
39. One-o f λεΫ
40. One-o f λεΫ ‣खಈͰ࣮ߦ͍ͨ͠όονॲཧͱ͔ ‣ԿΒ͔ͷཧ༝Ͱ rails c ͍ͨ͠৔߹ͱ͔ ‣ίϯςφ಺෦͔ΒௐࠪΛ͍ͨ͠৔߹ͱ͔ ‣etc...
41. One-o f λεΫ͸ར༻࣌ʹ Fargateͷઐ༻λεΫΛ ىಈͯ͠ECS Exec͢Δ
42. One-o f λεΫ͕ ऴΘͬͨΒFargateͷ λεΫ΋ऴྃͤ͞Δ
43. fargate: tasks: oneoff: name: ${self:service}-${self:provider.stage}-oneoff image: rails_image command: entryPoint: - '/bin/sh' - '-c' - "sleep infinity"
44. #!/usr/bin/env bash set -e APP_NAME="sample" STAGE=${1:-staging} CLUSTER="${APP_NAME}-${STAGE}" ... LATEST_TASK_DEFINITION_ARN=$( aws ecs list-task-definitions --family-prefix $CLUSTER-oneoff ... ) echo "== Run console on Fargate..." echo "== Starting $LATEST_TASK_DEFINITION_ARN" TASK_ARN=$( aws ecs run-task --cluster $CLUSTER --task-definition $LATEST_TASK_DEFINITION_ARN ... ) echo "== TaskArn: ${TASK_ARN}" aws ecs wait tasks-running --cluster $CLUSTER --tasks $TASK_ARN echo "== Waiting for managed agent launch..." while true; do AGENT_STATUS=$( aws ecs describe-tasks --cluster $CLUSTER --tasks $TASK_ARN ... ) if [[ "$AGENT_STATUS" != "RUNNING" ]]; then sleep 1 else # ΤʔδΣϯτͷىಈ͔Β͞Βʹ 2 ඵ͘Β͍଴ͨͳ͍ͱ ssm ͕ܨ͕Βͳ͍ sleep 2 break fi done aws ecs execute-command --cluster $CLUSTER --task $TASK_ARN --container ${CLUSTER}-oneoff ... echo "== Stopping $LATEST_TASK_DEFINITION_ARN" aws ecs stop-task --cluster $CLUSTER --task $TASK_ARN > /dev/null 2>&1 ࠷৽ͷλεΫఆٛARNΛऔಘ λεΫΛ࣮ߦ λεΫͷىಈ଴ͪ Managed Agentͷىಈ଴ͪ ECS ExecͰϩάΠϯ λεΫΛऴྃ
45. ࿩͢͜ͱ ‣LambdaͱFargateΛ׆༻࣮ͨ͠ߦ؀ڥ ‣Webαʔό ‣ඇಉظɾఆظJob ‣One-o f λεΫ ‣PlanetScaleʹΑΔεέʔϥϒϧͳRDB
46. PlanetScale
48. The world’s most advanced, fully- managed MySQL database platform.
49. 10,000ίωΫγϣϯ΋ ܨ͛ΔԽ͚෺Έ͍ͨͳ MySQL
50. ଟগͷบ͸͋Δ͚Ͳ WebΞϓϦ͔ΒݟΔͱ ΄΅ී௨ͷMySQL
51. PlanetScaleͳΒ Lambda͕ٸʹ εέʔϧͯ͠΋ා͘ͳ͍
52. ྉۚ΋ͦ͜·Ͱ ͓ߴ͘ͳ͍
54. PlanetScaleͷར఺ ‣΄΅ී௨ͷMySQL ‣ίωΫγϣϯ਺ͱ͍͏଍ᐫ͕ແ͍ ‣RDSͱൺֱͯ͠΋ͦΜͳߴ͘ͳ͍
55. PlanetScaleͷ஫ҙ఺ ‣1τϥϯβΫγϣϯͷ੍࣌ؒݶ͕͋Δ ‣1ΫΤϦͰѻ͑Δ৘ใྔͷ੍ݶ͕͋Δ ‣ΧϥϜ΍ςʔϒϧͷϦωʔϜ͕ෆՄ
56. Lambda΍Fargateͱ ૊Έ߹ΘͤΔͱ࠷ڧͷ σʔλετΞʹͳΔ
57. ·ͱΊ
58. ࿩ͨ͜͠ͱ ‣LambdaͱFargateΛ׆༻࣮ͨ͠ߦ؀ڥ ‣Webαʔό ‣ඇಉظɾఆظJob ‣One-o f λεΫ ‣PlanetScaleʹΑΔεέʔϥϒϧͳRDB
59. εέʔϧʹର͢Δ ෆ҆Λͳͯ͘͠ ΞϓϦͷ։ൃʹ ूதͰ͖ΔΑ͏ʹ
60. ͝ਗ਼ௌ͋Γ͕ͱ͏ ͍͟͝·ͨ͠ʂ