Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
140
0

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
220
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.4k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
190
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
220
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
140
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
240
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
150
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
190
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.9k

Other Decks in Programming

See All in Programming
レガシーPHP転生 〜父がドメインエキスパートだったのでDDD+Claude Codeでチート開発します〜
Avatar for panda_program panda_program
0
220
アーキテクチャモダナイゼーションとは何か
Avatar for nwiizo nwiizo
10
2.7k
安いハードウェアでVulkan
Avatar for Fadis fadis
1
890
それはエンジニアリングの糧である：AI開発のためにAIのOSSを開発する現場より / It serves as fuel for engineering: insights from the field of developing open-source AI for AI development.
Avatar for nrs nrslib
1
820
仕様漏れ実装漏れをなくすトレーサビリティAI基盤のご紹介
Avatar for Kuniwak orgachem
PRO
8
4.4k
forteeの改修から振り返るPHPerKaigi 2026
Avatar for muno92 muno92
PRO
3
210
条件判定に名前、つけてますか？ #phperkaigi #c
Avatar for Hiromi Hishida 77web
2
940
Coding at the Speed of Thought: The New Era of Symfony Docker
Avatar for Kévin Dunglas dunglas
0
4.5k
PHP 7.4でもOpenTelemetryゼロコード計装がしたい！ / PHPerKaigi 2026
Avatar for Arthur arthur1
1
490
Going Multiplatform with Your Android App (Android Makers 2026)
Avatar for Márton Braun zsmb
1
280
ファインチューニングせずメインコンペを解く方法
Avatar for pokutuna pokutuna
0
260
AIエージェントで業務改善してみた
Avatar for takumi taku271
0
360

Featured

See All Featured
Joys of Absence: A Defence of Solitary Play
Avatar for Sebastian Deterding codingconduct
1
330
A better future with KSS
Avatar for Kyle Neath kneath
240
18k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
200k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
WENDY [Excerpt]
Avatar for Tessa Abrams tessaabrams
9
37k
Exploring the relationship between traditional SERPs and Gen AI search
Avatar for Ray Grieselhuber raygrieselhuber
PRO
2
3.8k
The Spectacular Lies of Maps
Avatar for Per Axbom axbom
PRO
1
680
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
12
1.1k
Paper Plane
Avatar for Katie Cordina Lindsey katiecoart
PRO
1
49k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
160
The innovator’s Mindset - 
Leading Through an Era of Exponential Change - McGill University 2025
Avatar for Jean-Marc De Jonghe jdejongh
PRO
1
140
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
34
9.2k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None