Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
44

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
76
Evaluating LLM Applications is hard
anyscale
0
4k
Developing and serving RAG-Based LLM applications in production
anyscale
0
100
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
120
How to build a serverless database cloud service
anyscale
0
76
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
110
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
62
5 Painful Lessons using LLMs
anyscale
0
89
How continuous batching enables 23x throughput in LLM inference
anyscale
0
950

Other Decks in Programming

See All in Programming
CSC509 Lecture 09
javiergs
PRO
0
140
『ドメイン駆動設計をはじめよう』のモデリングアプローチ
masuda220
PRO
8
520
Jakarta EE meets AI
ivargrimstad
0
360
Generative AI Use Cases JP (略称:GenU)奮闘記
hideg
0
230
シールドクラスをはじめよう / Getting Started with Sealed Classes
mackey0225
3
430
TypeScript Graph でコードレビューの心理的障壁を乗り越える
ysk8hori
1
330
AWS IaCの注目アップデート 2024年10月版
konokenj
3
3.3k
ピラミッド、アイスクリームコーン、SMURF: 自動テストの最適バランスを求めて / Pyramid Ice-Cream-Cone and SMURF
twada
PRO
10
1.2k
Tauriでネイティブアプリを作りたい
tsucchinoko
0
360
Contemporary Test Cases
maaretp
0
120
ふかぼれ！CSSセレクターモジュール / Fukabore! CSS Selectors Module
petamoriken
0
150
[PyCon Korea 2024 Keynote] 커뮤니티와 파이썬, 그리고 우리
beomi
0
120

Featured

See All Featured
How to Think Like a Performance Engineer
csswizardry
20
1.1k
How to train your dragon (web standard)
notwaldorf
88
5.7k
What's in a price? How to price your products and services
michaelherold
243
12k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
7
570
Become a Pro
speakerdeck
PRO
25
5k
Designing for humans not robots
tammielis
250
25k
Typedesign – Prime Four
hannesfritz
40
2.4k
Art, The Web, and Tiny UX
lynnandtonic
297
20k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
47
2.1k
Scaling GitHub
holman
458
140k
5 minutes of I Can Smell Your CMS
philhawksworth
202
19k
Why You Should Never Use an ORM
jnunemaker
PRO
54
9k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None