Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
53

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
100
Evaluating LLM Applications is hard
anyscale
0
4.1k
Developing and serving RAG-Based LLM applications in production
anyscale
0
110
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
130
How to build a serverless database cloud service
anyscale
0
87
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
120
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
75
5 Painful Lessons using LLMs
anyscale
0
99
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1.1k

Other Decks in Programming

See All in Programming
KubeCon NA 2024の全DB関連セッションを紹介
nnaka2992
0
110
Findy Team+ Awardを受賞したかった！ベストプラクティス応募内容をふりかえり、開発生産性向上もふりかえる / Findy Team Plus Award BestPractice and DPE Retrospective 2024
honyanya
0
140
20241217　競争力強化とビジネス価値創出への挑戦：モノタロウのシステムモダナイズ、開発組織の進化と今後の展望
monotaro
PRO
0
250
令和7年版 あなたが使ってよいフロントエンド機能とは
mugi_uno
3
1.6k
rails newと同時に型を書く
aki19035vc
5
690
PSR-15 はあなたのための ものではない？ - phpcon2024
myamagishi
0
380
Оптимизируем производительность блока Казначейство
lamodatech
0
920
アクターシステムに頼らずEvent Sourcingする方法について
j5ik2o
6
690
Kaigi on Railsに初参加したら、その日にLT登壇が決定した件について
tama50505
0
140
責務を分離するための例外設計 - PHPカンファレンス 2024
kajitack
9
2.3k
htmxって知っていますか？次世代のHTML
hiro_ghap1
0
410
コンテナをたくさん詰め込んだシステムとランタイムの変化
makihiro
1
190

Featured

See All Featured
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
29
2.1k
Fashionably flexible responsive web design (full day workshop)
malarkey
406
66k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
49k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
59k
How to Think Like a Performance Engineer
csswizardry
22
1.3k
GraphQLの誤解/rethinking-graphql
sonatard
68
10k
Intergalactic Javascript Robots from Outer Space
tanoku
270
27k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
BBQ
matthewcrist
85
9.4k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
3
240
Product Roadmaps are Hard
iamctodd
PRO
50
11k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None