Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
83

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.
Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
140
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.2k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
140
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
150
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
100
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
160
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
110
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
120
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.3k

Other Decks in Programming

See All in Programming
「MCPを使ってる人」が より詳しくなるための解説
Avatar for Kota-Yamaguchi yamaguchidesu
0
590
生成AI時代のフルスタック開発
Avatar for Kenn Ejima kenn
10
2.7k
OpenNext + Hono on Cloudflare で イマドキWeb開発スタックを実現する
Avatar for rokuosan rokuosan
0
110
Interface vs Types ~型推論が過多推論~
Avatar for Hiroki Omote hirokiomote
1
230
ユーザーにサブドメインの ECサイトを提供したい (あるいは) 2026年函館で一番熱くなるかもしれない言語の話
Avatar for uvb_76 uvb_76
0
170
JVM の仕組みを理解して PHP で実装してみよう
Avatar for memory m3m0r7
PRO
1
250
REST API設計の実践 – ベストプラクティスとその落とし穴
Avatar for 武田 憲太郎 kentaroutakeda
2
310
Building an Application with TDD, DDD and Hexagonal Architecture - Isn't it a bit too much?
Avatar for Mufrid Krilic mufrid
0
370
TSConfigからTypeScriptの世界を覗く
Avatar for らいと planck16
2
1.3k
抽象データ型について学んだ
Avatar for ryounasso ryounasso
0
210
OpenTelemetry + LLM = OpenLLMetry!?
Avatar for Yunosuke Yamada yunosukey
2
400
TypeScript Language Service Plugin で CSS Modules の開発体験を改善する
Avatar for mizdra mizdra
PRO
3
2.4k

Featured

See All Featured
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
280
13k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
137
34k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
137
7k
Fireside Chat
Avatar for paigeccino paigeccino
37
3.5k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
39
1.8k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
92
6k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
71
11k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
233
17k
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
5.6k
Building Adaptive Systems
Avatar for Chris Keathley keathley
41
2.6k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
271
27k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None