its affiliates. All rights reserved. 従来型とサーバーレスの比較 14 Webサーバー Appサーバー DBサーバー Amazon API Gateway AWS Lambda Amazon DynamoDB 処理ロジック REST API データ管理/永続化 … … サーバー/OSの準備・構築 設定・開発作業 + 規模の⾒積もり + 可⽤性設計 ロードバランス設定等 + データ保全の検討 サーバー/OSの準備・構築 設定・開発作業 ü リクエスト量に応じて ⾃動スケール ü 設計済みのリトライ マルチ AZ 構成済 ü データ可⽤性 LB
its affiliates. All rights reserved. 22 Integration API Destination API Gateway Lambda Batch CloudWatch ECS EventBridge Bus Kinesis Data Firehose Inspector Kinesis Data Streams Redshift SageMaker pipeline SNS SQS Step Functions Event Driven
its affiliates. All rights reserved. 23 Integration API Destination API Gateway Lambda Batch CloudWatch ECS EventBridge Bus Kinesis Data Firehose Inspector Kinesis Data Streams Redshift SageMaker pipeline SNS SQS Step Functions EventBridge Pipes Event Driven
its affiliates. All rights reserved. Generative AI とサーバーレスの統合 29 Prompt <Input at request time> Model Consumer 既存 Model + Model Tuner Domain Data + 新 Model Model Builder/Provider Internet Scale Dataset Or Domain Datasets + 新 Model Serverless Existing Model Time To Market
its affiliates. All rights reserved. アジリティと Generative AI の組み合わせ 30 イノベーションを スピーディーに! Power of Gen AI Amazon Bedrock Amazon SageMaker Amazon Code Whisperer Speed of Serverless AWS Lambda Amazon ECS AWS Fargate Amazon EventBridge AWS Step Functions
its affiliates. All rights reserved. 同期的なモデル呼び出し 31 Amazon API Gateway AWS Lambda FM Endpoint • Amazon Bedrock • Amazon SageMaker Jumpstart • Models hosted on: • EKS • Other computes FM Endpoint • Auth, Rate limiting, Caching with Amazon API Gateway • AWS Lambda calling an endpoint API + Compute • Simple Q/A • Content generation • Text Summarization Use cases
its affiliates. All rights reserved. • Amazon Bedrock • Amazon SageMaker Jumpstart • Models hosted on: • EKS • Other computes FM Endpoint • Auth, Rate limiting, Caching with Amazon API Gateway • Amazon SQS queue provides control over the scaling • AWS Lambda calling an endpoint API + Queue + Compute • Simple Q/A • Content generation • Text Summarization Use cases 非同期的なモデル呼び出し 32 Amazon API Gateway AWS Lambda Amazon SQS FM Endpoint
its affiliates. All rights reserved. 非同期の場合のレスポンス 33 Amazon API Gateway AWS Lambda Amazon SQS Polling/WebSocket FM Endpoint • Amazon Bedrock • Amazon SageMaker Jumpstart • Models hosted on: • EKS • Other computes FM Endpoint • Auth, Rate limiting, Caching with Amazon API Gateway • Amazon SQS queue provides control over the scaling • AWS Lambda calling an endpoint • Use polling, WebSocket, or IoT core topic for response API + Queue + Compute • Simple Q/A • Content generation • Text Summarization Use cases