Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introducing Kong AI Gateway

hashi
May 23, 2024

Introducing Kong AI Gateway

ChatGTP Meetup Osaka #2の登壇資料です。

hashi

May 23, 2024
Tweet

More Decks by hashi

Other Decks in Technology

Transcript

  1. The World Leading API Company • hashi (Shinichi Hashitani) •

    Staff Solutions Engineer • Kong <- Confluent <- Pivotal (VMware Tanzu) • Modernization, Kafka, stream processing, cloud data analytics. bit.ly/3yy1ZWk
  2. PLUGINS (e.g. Authentication, Authorization, Rate Limiting, logging,Analytics, etc) TARGET1 TARGET2

    API CLIENT LOAD BALANCER ROUTE SERVICE CONSUMER KONG ADMIN UPSTREAM TARGETS What is API Gateway?
  3. One API to rule them all { } AI Credentials

    AI Traffic Control AI Logging And more AI Security & AI Observability
  4. One API to rule them all { } AI Credentials

    AI Traffic Control AI Logging And more AI Security & AI Observability AI Prompt Guard AI Prompt Decorator AI Prompt Templator AI Compliance & AI Abuse prevention
  5. One API to rule them all { } AI Credentials

    AI Traffic Control AI Logging And more AI Security & AI Observability AI Prompt Guard AI Prompt Decorator AI Prompt Templator AI Compliance & AI Abuse prevention AI Request Transformer AI Response Transformer
  6. One API to rule them all { } AI Credentials

    AI Traffic Control AI Logging And more AI Security & AI Observability Prompt Guard Prompt Decorator Prompt Templator AI Compliance & AI Abuse prevention AI Request Transformer AI Response Transformer Use AI without coding
  7. One API to rule them all { } AI Credentials

    AI Traffic Control AI Logging And more AI Security & AI Observability Prompt Guard Prompt Decorator Prompt Templator AI Compliance & AI Abuse prevention AI Request Transformer AI Response Transformer Use AI without coding
  8. Future Kong Gateway v3.7 and v3.8 AI Train AI Sanitize

    AI Rate Limiting LLMs Apps And more Semantic Caching AI Azure Services AWS Bedrock