Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
200
0

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
250
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.5k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
240
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
270
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
190
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
320
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
220
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
250
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
2.4k

Other Decks in Programming

See All in Programming
複雑なUIコンポーネントとの ⻑い付き合い⽅：波及するバグからテスト戦略を経て、安全な再設計へ
Avatar for masahiko.asai mixplace
0
360
カツオ、ご期待ください
Avatar for saku_totomi suneo3476
0
160
mrbgem 三角測量 開発
Avatar for ogom ogom
0
230
Turning Architecture into Unit Tests in the AI Era (NSSpain XIV)
Avatar for Stelios Frantzeskakis steliosf
PRO
1
140
Vue Fes Japan 2026 タイムテーブル徹底解説
Avatar for 448jp | OKI Yoshiya 448jp
1
650
Compiling a real-world CLI tool to native with Static Hermes
Avatar for Tzvetan Mikov tmikov2023
0
110
すこし踏み込む CancellationToken
Avatar for tkym htkym
2
1.7k
プロダクトコードからライブラリの境界を見つける
Avatar for elmetal elmetal
PRO
0
110
SREの越境 / SRE Collaboration
Avatar for y-ohgi y0hgi
2
300
Java 27新機能 / Java 27 new features
Avatar for Naoki Kishida kishida
2
220
Herb in Rails 8.2: Your ERB views, now HTML-aware @ Rails World 2026, Austin, Texas
Avatar for Marco Roth marcoroth
0
200
モデルのリファクタリングが難しいと思ったら、そもそも複雑だったのはビジネス仕様だった ? / is-the-business-domain-the-real-complexity
Avatar for hatsu hatsu38
0
460

Featured

See All Featured
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
430
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
17k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.8k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
53k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1369
210k
Groundhog Day: Seeking Process in Gaming for Health
Avatar for Sebastian Deterding codingconduct
0
400
First, design no harm
Avatar for Per Axbom axbom
PRO
2
1.3k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
10k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
210
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
331
25k
Exploring anti-patterns in Rails
Avatar for Elle Meredith aemeredith
4
530

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None