Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
110

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
180
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
160
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
180
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
120
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
200
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
120
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
150
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.5k

Other Decks in Programming

See All in Programming
CSC305 Lecture 10
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
250
One Enishi After Another
Avatar for Koji SHIMADA snoozer05
PRO
0
160
CSC305 Lecture 11
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
270
AI Agent 時代的開發者生存指南
Avatar for 高見龍 eddie
4
2.1k
Catch Up: Go Style Guide Update
Avatar for ANDPAD inc andpad
0
250
Migration to Signals, Resource API, and NgRx Signal Store
Avatar for Manfred Steyer manfredsteyer
PRO
0
120
Devoxx BE - Local Development in the AI Era
Avatar for Kevin Dubois kdubois
0
140
Go言語の特性を活かした公式MCP SDKの設計
Avatar for hond hond0413
2
520
Webサーバーサイド言語としてのRustについて
Avatar for kaza kouyuume
1
4.9k
他言語経験者が Golangci-lint を最初のコーディングメンターにした話 / How Golangci-lint Became My First Coding Mentor: A Story from a Polyglot Programmer
Avatar for uMa uma31
0
420
エンジニアインターン「Treasure」とHonoの2年、そして未来へ / Our Journey with Hono Two Years at Treasure and Beyond
Avatar for CARTA Engineering carta_engineering
0
430
Range on Rails ―「多重範囲型」という新たな選択肢が、複雑ロジックを劇的にシンプルにしたワケ
Avatar for RIZAPテクノロジーズ rizap_tech
0
7.7k

Featured

See All Featured
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
190
55k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.3k
KATA
Avatar for Megan Lloyd mclloyd
PRO
32
15k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
116
20k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
671
58k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
269
13k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
161
23k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
59
9.6k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
233
18k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
37
2.6k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
132
19k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None