Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
190
0

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
250
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.5k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
230
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
260
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
180
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
310
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
210
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
240
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
2.4k

Other Decks in Programming

See All in Programming
Vibes Containers 〜AIで変わるコンテナ設計と運用〜
Avatar for Tetsuya Kikuchi tkikuc
3
550
MVNOの申込からeSIM開通までをiOSアプリでつなぐ- 本人確認・MNP・通信事業者基盤をまたぐ実装
Avatar for Sato Takeshi satotakeshi
0
450
Verilogで学ぶCPU自作入門.pdf
Avatar for uyuki uyuki234
1
180
WebRTC映像をAirPlayに対応させる挑戦.pdf
Avatar for monolithic-adam monolithic_adam
0
290
Security issues being discussed on Web Platforms
Avatar for petamoriken / 森建 petamoriken
0
1k
Building an Out-of-Order CPU
Avatar for Latte72 latte72
1
790
ゲームコントローラやキーボードのファームウェアをSwiftで書く
Avatar for Kishikawa Katsumi kishikawakatsumi
1
250
iOSDC2026登壇資料.pdf
Avatar for RioFujimon riofujimon
0
170
Go × SIMDで高速化するベクトル検索 ~ルーフラインモデルでSIMDが効く境界を探れ！ ~
Avatar for po3rin po3rin
1
2.5k
SREの越境 / SRE Collaboration
Avatar for y-ohgi y0hgi
2
260
Starting & Sustaining Code-Based E2E Testing for Non-Coding QA Teams( #jasstniigata )
Avatar for teyamagu teyamagu
PRO
1
490
一人だけ、Kiroが静止する日
Avatar for Hideyuki Nagata hideg
0
120

Featured

See All Featured
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
320
More Than Pixels: Becoming A User Experience Designer
Avatar for Michelle Schulp Hunt marktimemedia
3
530
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
331
25k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.9k
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
63k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
250
1.3M
Scaling GitHub
Avatar for Zach Holman holman
464
140k
Paper Plane (Part 1)
Avatar for Katie Cordina Lindsey katiecoart
PRO
2
11k
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
680
The Impact of AI in SEO - AI Overviews June 2024 Edition
Avatar for Aleyda Solis aleyda
6
1.2k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.9k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None