Going Serveless on AWS with Golang and SAM

Intro to AWS Fully Managed (aka "Serverless") Services for Developers focusing on Lambda. Development Lifecycle (Code, Locally Run/Debug, Deploy) of Golang Lambda Handlers/Functions with SAM. Basic Performance and Cost analysis.

Transcript

1. GOING SERVERLESS ΟΝ AWS WITH GOLANG & SAM 7th Athens Gophers Meetup George Tourkas (@georgetourkas)
2. SERVERLESS AWS SERVERLESS == FULLY MANAGED SERVICES
3. SERVERLESS AWS FULLY MANAGED SERVICES ▸ Proprietary to the Cloud Provider ▸ No Hardware/OS(-like) Management ▸ Built-in HA ▸ (Semi-)Auto Scalability ▸ Limited/Zero Idle Capacity ▸ Seamless Integration with other Services ▸ CLI and API
4. SERVERLESS AWS S3 (Simple Storage Service) ▸ Object Storage Service ▸ Static Content HTTP Server ▸ Lifecycle Rules ▸ Event Notifications ▸ Strong Consistency on Creations ▸ Eventual on Updates/Deletions
5. SERVERLESS AWS DynamoDB ▸ Key-Value and Document DB Service ▸ Option for On Demand or Provisioned Read/ Write Capacity ▸ Within/Across-Tables ACID ▸ Option for Strong or Eventual Consistent on Reads ▸ Table Activity Stream
6. SERVERLESS AWS API Gateway ▸ HTTP API Service ▸ Caching on Headers, Query Params ▸ Stages (Prod, Acc etc.) ▸ Websocket Support ▸ Request Throttling ▸ WAF, HTTPS only
7. SERVERLESS AWS API Gateway ▸ SDK Generation ▸ API Keys/Usage Plans Management ▸ Export to Swagger and OpenAPI 3 ▸ Documentation Construction Helper
8. SERVERLESS AWS SNS (Simple Notification Service) ▸ Pub/Sub Service ▸ Attribute-based Filter (Routing) ▸ Reliable Delivery ▸ Endpoints: ▸ HTTP/HTTPS ▸ Email ▸ SMS ▸ Push Notifications (iOS, Android etc.)
9. SERVERLESS AWS Lambda ▸ Function(=Code Execution) Service ▸ Custom Memory Allocation (128-3008MB in 64 MB incr.) ▸ Proportional Alloc of vCPU, Net & Disk I/O ▸ 1000 Concurrent Execs / 3000 in Burst Per Account ▸ Max Timeout 15 minutes
10. SERVERLESS AWS Lambda ▸ Invoked by: ▸ API Gateway Requests (sync) ▸ S3 Event Notifications (async) ▸ SNS Messages (async) ▸ DynamoDB Stream (poll-based) ▸ other Lambdas (sync or async) ▸ …
11. SERVERLESS AWS LAMBDA LIFECYLE Source: Anatomy of AWS Lambda Damian Sosnowski
12. SERVERLESS AWS LAMBDA LIFECYLE / REUSE PROCESSES Source: Anatomy of AWS Lambda Damian Sosnowski
13. SERVERLESS AWS LAMBDA LIFECYLE / SPAWN NEW PROCESSES Source: Anatomy of AWS Lambda Damian Sosnowski
14. SERVERLESS AWS LAMBDA LIFECYLE / IMPLICATIONS ▸ No/Limited Usability of In-Process State ▸ In-Process Caching ▸ Connection-Oriented Dependencies
15. SERVERLESS AWS IAM (Identity & Access Management) ▸ Centralised Management of Authentication & Authorisation Service ▸ “Policy” = Allowed/Denied set of Actions on set of Service Resources
 
 Effect: Allow, Action:S3/GetObject, Resource: my-bucket ▸ Associated with Users, Lambdas etc.
16. SERVERLESS AWS IAM
17. SERVERLESS AWS SAM (Serverless Application Model) ▸ Serverless App Development Framework ▸ Locally Run & Debug ▸ IDE Integration ▸ Single (=Code + Infra) Deployment Configuration
18. CODE & INFRA
19. CODE & INFRA CREATE PHOTO THUMBNAILS API
20. CODE & INFRA AWS GO SDK 1. Create a “Session” 2. Create a Service Client (S3, DynamoDB etc.) 3. ServiceClient.DoSth(*DoSthInput): (*DoSthOutput, err)
 or
 DoSthWithContext
27. CODE & INFRA TIn, TOut must be JSON (un)marshallable GOLANG LAMBDA
28. CODE & INFRA GOLANG LAMBDA SERVICE TIn TOut API GW events.APIGateway ProxyRequest events.APIGateway ProxyResponse SNS events.SNSEvent N/A S3 events.S3Event N/A DYNAMODB events.DynamoDB Event N/A
29. CODE & INFRA LAMBDA DEPENDENCIES
30. CODE & INFRA LAMBDA DEPENDENCIES
31. CODE & INFRA LAMBDA DEPENDENCIES
32. CODE & INFRA GOLANG LAMBDA LIFECYLE Source: Anatomy of AWS Lambda Damian Sosnowski
33. CODE & INFRA GOLANG LAMBDA LIFECYLE Source: Anatomy of AWS Lambda Damian Sosnowski init()
34. CODE & INFRA GOLANG LAMBDA LIFECYLE Source: Anatomy of AWS Lambda Damian Sosnowski init() main()
35. CODE & INFRA LAMBDA LIFECYLE / REUSE PROCESSES Source: Anatomy of AWS Lambda Damian Sosnowski
36. CODE & INFRA LAMBDA LIFECYLE / REUSE PROCESSES Source: Anatomy of AWS Lambda Damian Sosnowski init()
37. CODE & INFRA LAMBDA LIFECYLE / REUSE PROCESSES Source: Anatomy of AWS Lambda Damian Sosnowski init() main()
38. CODE & INFRA LAMBDA LIFECYLE / REUSE PROCESSES Source: Anatomy of AWS Lambda Damian Sosnowski init() main() main()
39. CODE & INFRA LAMBDA LIFECYLE / REUSE PROCESSES Source: Anatomy of AWS Lambda Damian Sosnowski init() main() main() main()
40. CODE & INFRA LAMBDA LIFECYLE / REUSE PROCESSES Source: Anatomy of AWS Lambda Damian Sosnowski init() main() main() main() main()
41. CODE & INFRA HANDLER NAMESPACE
42. CODE & INFRA HANDLER NAMESPACE
43. CODE & INFRA HANDLER NAMESPACE
44. CODE & INFRA ONE OR MANY HANDLERS ? ▸ Many Handlers: ▸ Smaller/Faster Initialisation ▸ Granular Monitor ▸ Reserve Concurrency
45. CODE & INFRA ONE OR MANY HANDLERS ? ▸ One Handler: ▸ Migrating from Standalone ▸ Complex Routing ▸ Middleware on http.HandlerFunc
46. CODE & INFRA AWS LAMBDA GO API PROXY ▸ Adapters for: ▸ net/http ▸ gorilla mux ▸ iris ▸ negroni ▸ gin https://github.com/awslabs/aws-lambda-go-api-proxy 
 by AWS Labs
48. BUILD & RUN LOCALLY
49. BUILD & RUN LOCALLY BUILD
50. BUILD & RUN LOCALLY BUILD
51. BUILD & RUN LOCALLY BUILD
52. BUILD & RUN LOCALLY template.yaml BUILD
53. BUILD & RUN LOCALLY template.yaml BUILD
54. BUILD & RUN LOCALLY RUN LOCALLY / API GATEWAY EVENT
55. BUILD & RUN LOCALLY RUN LOCALLY / API GATEWAY EVENT
56. BUILD & RUN LOCALLY RUN LOCALLY / API GATEWAY EVENT
57. BUILD & RUN LOCALLY RUN LOCALLY / API GATEWAY EVENT
58. template.yaml BUILD & RUN LOCALLY RUN LOCALLY / API GATEWAY EVENT
59. template.yaml BUILD & RUN LOCALLY RUN LOCALLY / API GATEWAY EVENT
60. template.yaml BUILD & RUN LOCALLY RUN LOCALLY / API GATEWAY EVENT
61. BUILD & RUN LOCALLY app/create/Input create.json RUN LOCALLY / SNS EVENT
62. BUILD & RUN LOCALLY app/create/Input create.json RUN LOCALLY / SNS EVENT
63. BUILD & RUN LOCALLY app/create/Input create.json RUN LOCALLY / SNS EVENT
64. BUILD & RUN LOCALLY app/create/Input create.json lambdas/create RUN LOCALLY / SNS EVENT
65. BUILD & RUN LOCALLY app/create/Input create.json lambdas/create RUN LOCALLY / SNS EVENT
66. BUILD & RUN LOCALLY event.json RUN LOCALLY / SNS EVENT
67. BUILD & RUN LOCALLY event.json RUN LOCALLY / SNS EVENT
68. BUILD & RUN LOCALLY RUN LOCALLY / SNS EVENT
69. BUILD & RUN LOCALLY RUN LOCALLY / SNS EVENT
70. BUILD & RUN LOCALLY RUN LOCALLY / SNS EVENT template.yaml
71. BUILD & RUN LOCALLY RUN LOCALLY / SNS EVENT template.yaml
72. DEBUG LOCALLY
73. DEBUG LOCALLY ONE-OFF 1/2: DELVE BUILD in linux/amd64
74. DEBUG LOCALLY ONE-OFF 1/2: DELVE BUILD in linux/amd64
75. DEBUG LOCALLY ONE-OFF 2/2: SETUP IDE
76. DEBUG LOCALLY ONE-OFF 2/2: SETUP IDE
77. DEBUG LOCALLY ONE-OFF 2/2: SETUP IDE
78. DEBUG LOCALLY TYPICAL DEBUG PROCESS 1. compile 2. start the debugger 3. “connect” IDE to the debugger process 4. make the (HTTP) call
 
 .. to hit a breakpoint
79. DEBUG LOCALLY TYPICAL DEBUG PROCESS 1. compile 2. start the debugger 3. “connect” IDE to the debugger process 4. make the (HTTP) call
 
 .. to hit a breakpoint
80. DEBUG LOCALLY SAM DEBUG PROCESS 1. compile 2. start the debugger 3. make the (HTTP) call 4. “connect” IDE to the debugger process
 
 .. to hit a breakpoint
81. DEBUG LOCALLY SAM DEBUG PROCESS 1. compile 2. start the debugger 3. make the (HTTP) call 4. “connect” IDE to the debugger process
 
 .. to hit a breakpoint
82. DEBUG LOCALLY STEP 1: COMPILE
83. DEBUG LOCALLY STEP 1: COMPILE
84. DEBUG LOCALLY STEP 2: START THE DEBUGGER API GATEWAY EVENT SNS EVENT
85. DEBUG LOCALLY STEP 2: START THE DEBUGGER API GATEWAY EVENT SNS EVENT
86. DEBUG LOCALLY STEP 2: START THE DEBUGGER API GATEWAY EVENT SNS EVENT
87. DEPLOY
88. DEPLOY DEPLOYMENT STEPS PACKAGING DEPLOYING
89. DEPLOY DEPLOYMENT STEPS PACKAGING DEPLOYING
90. DEPLOY DEPLOYMENT STEPS PACKAGING DEPLOYING
91. DEPLOY DEPLOYMENT STEPS PACKAGING DEPLOYING
92. DEPLOY DEPLOYMENT STEPS PACKAGING DEPLOYING
93. DEPLOY DEPLOYMENT STEPS PACKAGING DEPLOYING
94. DEPLOY REMOTE LOGS ▸ tail ▸ filter ▸ absolute/relative time period
95. DEPLOY GRADUAL DEPLOYMENT ▸ Canary, Linear X Percent Every Y Minutes ▸ Metric-based Alarms for Rollback
96. CODE & INFRA SOURCE https://github.com/gtourkas/thumbnailr
97. PERFORMANCE
98. PERFORMANCE INITIAL ATTEMPTS
99. PERFORMANCE INITIAL ATTEMPTS
100. PERFORMANCE INITIAL ATTEMPTS
101. PERFORMANCE LATER ATTEMPTS
102. PERFORMANCE LATER ATTEMPTS
103. PERFORMANCE LATER ATTEMPTS
104. PERFORMANCE LATER ATTEMPTS
105. PERFORMANCE LATER ATTEMPTS
106. PERFORMANCE LATER ATTEMPTS
107. PERFORMANCE COLD START Source: Anatomy of AWS Lambda Damian Sosnowski
108. PERFORMANCE GOLANG COLD START Source: Cold Starts in AWS Lambda Mikhail Shilkov - Sep 26, 2019
109. PERFORMANCE GOLANG COLD START Source: Cold Starts in AWS Lambda Mikhail Shilkov - Sep 26, 2019
110. PERFORMANCE API GW + LAMBDA vs ALB + EC2
111. PERFORMANCE API GW + LAMBDA vs ALB + EC2
112. PERFORMANCE API GW + LAMBDA vs ALB + EC2
113. PERFORMANCE ALB + LAMBDA vs ALB + EC2
114. PERFORMANCE ALB + LAMBDA vs ALB + EC2
115. PERFORMANCE ALB + LAMBDA vs ALB + EC2
116. PERFORMANCE API GW + LAMBDA vs ALB + LAMBDA
117. PERFORMANCE API GW + LAMBDA vs ALB + LAMBDA
118. PERFORMANCE API GW + LAMBDA vs ALB + LAMBDA
119. COST
120. COST LAMBDA LOGS
121. COST LAMBDA LOGS
122. COST LAMBDA LOGS
123. COST LAMBDA LOGS Billed Duration is rounded UP to the nearest 100ms
124. COST LAMBDA ▸ Request Charges:
 
 Requests * $0.0000002 ▸ Compute Charges:
 
 Duration in Secs * GB Mem / 1024 * $0.00001667
 

125. COST LAMBDA ▸ Request Charges:
 
 30M * $0.0000002 = $6 ▸ Compute Charges:
 
 30M * 0.200 * 192 / 1024 * $0.00001667 = $18.75 ▸ Total Charges = $24.75

126. COST LAMBDA ▸ Request Charges:
 
 30M * $0.0000002 = $6 ▸ Compute Charges:
 
 30M * 0.200 * 192 / 1024 * $0.00001667 = $18.75 ▸ Total Charges = $24.75

127. COST
128. COST Memory: 1344 Time: 294 ms Cost: $0.0000066
129. COST Memory: 1344 Time: 294 ms Cost: $0.0000066 Memory: 1280 Time: 307 ms Cost: $0.0000083
130. COST AWS LAMBDA POWER TUNING ▸ Deployable via SAM ▸ Tuning Strategies: ▸ Speed ▸ Cost ▸ Balanced https://github.com/alexcasalboni/aws-lambda-power-tuning 
 by Alex Casalboni
131. COST TRANSFORM - NOT TRANSPORT
132. COST TRANSFORM - NOT TRANSPORT
133. COST TRANSFORM - NOT TRANSPORT Lambda Cost at 300 ms = $0.0000083 Lambda Cost at 200 ms = $0.0000063 Diff = $0,000002 DynamoDB Stream Read Request = $0,000000226
134. COST COMPARISON SOLUTION MONTHLY COST ($) API GW + LAMBDA 105.00 + 24.75 129.75 ALB + LAMBDA 21.03 + 24.75 45.78 ALB + EC2* 21.03 + 67.94 88.97 * 2 x t2.medium
135. COST COMPARISON SOLUTION MONTHLY COST ($) API GW + LAMBDA 105.00 + 24.75 129.75 ALB + LAMBDA 21.03 + 24.75 45.78 ALB + EC2* 21.03 + 67.94 88.97 * 2 x t2.medium
136. COST COMPARISON SOLUTION MONTHLY COST ($) API GW + LAMBDA 105.00 + 24.75 129.75 ALB + LAMBDA 21.03 + 24.75 45.78 ALB + EC2* 21.03 + 67.94 88.97 * 2 x t2.medium
137. COST FREE TIER SERVICE FREE TIER DURATION S3 5 GB, 20K GET, 5K PUT 12 MONTHS DYNAMODB 25 GB, 25 RCU, 25 WCU ALWAYS API GW 1 MILLION CALLS/MON 12 MONTHS SNS 1 MILLION PUB/MON 100K HTTP(S) DELIVERIES ALWAYS LAMBDA 1 MILLION EXECS/MON ALWAYS
138. Q&A