Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
57

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
110
Evaluating LLM Applications is hard
anyscale
0
4.1k
Developing and serving RAG-Based LLM applications in production
anyscale
0
120
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
140
How to build a serverless database cloud service
anyscale
0
88
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
130
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
86
5 Painful Lessons using LLMs
anyscale
0
100
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1.1k

Other Decks in Programming

See All in Programming
プログラミング言語学習のススメ / why-do-i-learn-programming-language
yashi8484
0
130
もう僕は OpenAPI を書きたくない
sgash708
3
990
第3回 Snowflake 中部ユーザ会 - dbt × Snowflake ハンズオン
hoto17296
4
370
ソフトウェアエンジニアの成長
masuda220
PRO
10
920
富山発の個人開発サービスで日本中の学校の業務を改善した話
krpk1900
4
380
ペアーズでの、Langfuseを中心とした評価ドリブンなリリースサイクルのご紹介
fukubaka0825
2
310
JavaScriptツール群「UnJS」を5分で一気に駆け巡る！
k1tikurisu
9
1.8k
[JAWS-UG横浜 #80] うわっ…今年のServerless アップデート、少なすぎ…？
maroon1st
1
180
社内フレームワークとその依存性解決 / in-house framework and its dependency management
vvakame
1
550
Java Webフレームワークの現状 / java web framework at burikaigi
kishida
9
2.2k
『品質』という言葉が嫌いな理由
korimu
0
160
GoとPHPのインターフェイスの違い
shimabox
2
170

Featured

See All Featured
The Illustrated Children's Guide to Kubernetes
chrisshort
48
49k
Build The Right Thing And Hit Your Dates
maggiecrowley
34
2.5k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
The Straight Up "How To Draw Better" Workshop
denniskardys
232
140k
Automating Front-end Workflow
addyosmani
1367
200k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
10
1.3k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
How GitHub (no longer) Works
holman
313
140k
Fireside Chat
paigeccino
34
3.2k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
27
1.5k
Statistics for Hackers
jakevdp
797
220k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None