Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Ray Community LLM August Meetup
Search
Anyscale
PRO
August 31, 2023
Programming
0
33
Ray Community LLM August Meetup
Introductory remarks, upcoming events, and agenda.
Anyscale
PRO
August 31, 2023
Tweet
Share
More Decks by Anyscale
See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
PRO
0
32
Evaluating LLM Applications is hard
anyscale
PRO
0
43
Developing and serving RAG-Based LLM applications in production
anyscale
PRO
0
48
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
PRO
0
75
How to build a serverless database cloud service
anyscale
PRO
0
53
Multi-Region/Cloud Ray Pipeline with Distributed Caching
anyscale
PRO
0
65
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
PRO
0
42
5 Painful Lessons using LLMs
anyscale
PRO
0
58
How continuous batching enables 23x throughput in LLM inference
anyscale
PRO
0
630
Other Decks in Programming
See All in Programming
Effectで作る堅牢でスケーラブルなAPIゲートウェイ / Robust and Scalable API Gateway Built on Effect
yasaichi
7
1.1k
Amazon SQSコンシューマー疎結合への旅 - 出張! #DevelopersIO IT技術ブログの中の人が語る勉強会 #3
quiver
0
370
Scalable Customer Journey Orchestration (CJO)
lewuathe
0
470
PHPコードの実行モデルを理解する / Understanding-the-PHP-Execution-Model
shin1x1
0
570
Open standards for building event-driven applications in the cloud
meteatamel
0
200
R言語の環境構築と基礎 Tokyo.R 112
bob3bob3
0
290
TCAとKMPを用いた新規動画配信アプリ 「ABEMA Live」の設計
tomu28
2
140
Direct Style Effect Systems The Print[A] ExampleA Comprehension Aid
philipschwarz
PRO
0
380
Fragment Composition of GraphQL
quramy
14
1.6k
酒飲んでたらテックリードになった話
spbaya0141
0
190
Documentation testsの恩恵 / Documentation testing benefits
ssssota
1
510
哲学史とモデリング
tanakahisateru
2
360
Featured
See All Featured
Principles of Awesome APIs and How to Build Them.
keavy
121
16k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
21
1.6k
StorybookのUI Testing Handbookを読んだ
zakiyama
13
4.6k
KATA
mclloyd
16
12k
Pencils Down: Stop Designing & Start Developing
hursman
117
11k
4 Signs Your Business is Dying
shpigford
176
21k
What's in a price? How to price your products and services
michaelherold
238
11k
Optimizing for Happiness
mojombo
370
69k
Fontdeck: Realign not Redesign
paulrobertlloyd
76
4.9k
Learning to Love Humans: Emotional Interface Design
aarron
267
39k
From Idea to $5000 a Month in 5 Months
shpigford
377
45k
A better future with KSS
kneath
231
16k
Transcript
Welcome to the Bay Area Ray LLMs Community talks August
29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email:
[email protected]
X: @2twitme
Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules
S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻
Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/
Luminary Featured Speakers ….
2 days of dedicated LLM tracks sessions
1 full day of Ray & LLM training sessions TBD
Ray book signing … https://www.anyscale.com/blog
QConSF Ray + LLM Talks
https://www.ray.io/community
None