Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
69

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
130
Evaluating LLM Applications is hard
anyscale
0
4.1k
Developing and serving RAG-Based LLM applications in production
anyscale
0
130
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
140
How to build a serverless database cloud service
anyscale
0
94
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
140
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
97
5 Painful Lessons using LLMs
anyscale
0
110
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1.2k

Other Decks in Programming

See All in Programming
複雑なフォームと複雑な状態管理にどう向き合うか / #newt_techtalk vol. 15
izumin5210
4
3.3k
‘무차별 LGTM~👍’만 외치던 우리가 ‘고봉밥 코드 리뷰’를?
hannah0731
0
530
RCPと宣言型ポリシーについてのお話し
kokitamura
2
150
goにおける コネクションプールの仕組み を軽く掘って見た
aronokuyama
0
140
SideKiqでジョブが二重起動した事象を深堀りしました
t_hatachi
0
240
NestJSのコードからOpenAPIを自動生成する際の最適解を探す
astatsuya
0
190
Firebase Dynamic Linksの代替手段を自作する / Create your own Firebase Dynamic Links alternative
kubode
0
180
パスキーのすべて / 20250324 iddance Lesson.5
kuralab
0
130
OpenTelemetryを活用したObservability入門 / Introduction to Observability with OpenTelemetry
seike460
PRO
0
340
複数ドメインに散らばってしまった画像…！ 運用中のPHPアプリに後からCDNを導入する…！
suguruooki
0
430
아직도 SOLID 를 '글'로만 알고 계신가요?
sh1mj1
0
360
Boost Your Performance and Developer Productivity with Jakarta EE 11
ivargrimstad
0
160

Featured

See All Featured
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
2.9k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
51
2.4k
Docker and Python
trallard
44
3.3k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
30
2.3k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
25k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Six Lessons from altMBA
skipperchong
27
3.7k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
44
7.1k
Bash Introduction
62gerente
611
210k
Optimising Largest Contentful Paint
csswizardry
35
3.2k
A better future with KSS
kneath
238
17k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
356
30k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None