Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
49

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
90
Evaluating LLM Applications is hard
anyscale
0
4k
Developing and serving RAG-Based LLM applications in production
anyscale
0
110
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
120
How to build a serverless database cloud service
anyscale
0
81
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
110
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
68
5 Painful Lessons using LLMs
anyscale
0
94
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1k

Other Decks in Programming

See All in Programming
rails stats で紐解く ANDPAD のイマを支える技術たち
andpad
1
280
なまけものオバケたち -PHP 8.4 に入った新機能の紹介-
tanakahisateru
1
110
数十万行のプロジェクトを Scala 2から3に完全移行した
xuwei_k
0
160
開発者とQAの越境で自動テストが増える開発プロセスを実現する
92thunder
1
160
iOS18とヘルスケアの睡眠対応
takuyaosawa
0
110
Fibonacci Function Gallery - Part 1
philipschwarz
PRO
0
140
nekko cloudにおけるProxmox VE利用事例
irumaru
3
350
Security_for_introducing_eBPF
kentatada
0
100
N.E.X.T LEVEL
pluu
2
290
layerx_20241129.pdf
kyoheig3
2
270
暇に任せてProxmoxコンソール 作ってみました
karugamo
1
660
社内活動の取り組み紹介
~ スリーシェイクでこんな取り組みしてます ~
bells17
0
400

Featured

See All Featured
A Modern Web Designer's Workflow
chriscoyier
693
190k
Fashionably flexible responsive web design (full day workshop)
malarkey
405
65k
The Invisible Side of Design
smashingmag
298
50k
Designing for Performance
lara
604
68k
YesSQL, Process and Tooling at Scale
rocio
169
14k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
44
6.9k
Thoughts on Productivity
jonyablonski
67
4.3k
Reflections from 52 weeks, 52 projects
jeffersonlam
346
20k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
330
21k
Being A Developer After 40
akosma
87
590k
No one is an island. Learnings from fostering a developers community.
thoeni
19
3k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None