Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
80

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.
Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
140
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.2k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
140
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
150
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
100
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
150
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
100
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
120
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.2k

Other Decks in Programming

See All in Programming
Rubyの!メソッドをちゃんと理解する
Avatar for Yuto Urushima alstrocrack
1
130
状態と共に暮らす：ステートフルへの挑戦
Avatar for ypresto ypresto
3
1.2k
データと事例で振り返るDevin導入の"リアル" / The Realities of Devin Reflected in Data and Case Studies
Avatar for r-kagaya rkaga
1
250
Flutterでllama.cppをつかってローカルLLMを試してみた
Avatar for sakuraidayo sakuraidayo
0
130
API for docs
Avatar for Soutaro Matsumoto soutaro
4
1.7k
Orleans + Sekiban + SignalR でリアルタイムWeb作ってみた
Avatar for Tomohisa Takaoka tomohisa
0
240
Laravel × Clean Architecture
Avatar for Takayuki bumptakayuki
PRO
0
150
Cursor/Devin全社導入の理想と現実
Avatar for Ryoichi Saito saitoryc
28
22k
Embracing Ruby magic
Avatar for Vinicius Stock vinistock
2
140
AWS Summit Hong Kong 2025: Reinventing Programming - How AI Transforms Our Enterprise Coding Approach
Avatar for Ernest Chiang dwchiang
0
130
今話題のMCPサーバーをFastAPIでサッと作ってみた
Avatar for Yuuki Shimizu yuukis
0
120
設計の本質：コード、システム、そして組織へ / The Essence of Design: To Code, Systems, and Organizations
Avatar for nrs nrslib
10
3.7k

Featured

See All Featured
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
35
2.7k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
85
4.7k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
23
1.6k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
299
50k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.1k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
30
2k
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
16k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
344
40k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
81
9k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
378
70k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
268
20k
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
29
2.6k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None