Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
120

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
200
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
170
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
200
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
130
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
220
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
130
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
160
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.6k

Other Decks in Programming

See All in Programming
フルサイクルエンジニアリングをAI Agentで全自動化したい 〜構想と現在地〜
Avatar for Kaito Minatoya kamina_zzz
0
310
AI時代を生き抜く 新卒エンジニアの生きる道
Avatar for coconala_engineer coconala_engineer
1
440
Pythonではじめるオープンデータ分析〜書籍の紹介と書籍で紹介しきれなかった事例の紹介〜
Avatar for Ryo YOSHI welliving
3
610
Combinatorial Interview Problems with Backtracking Solutions - From Imperative Procedural Programming to Declarative Functional Programming - Part 2
Avatar for Philip Schwarz philipschwarz
PRO
0
120
生成AI時代を勝ち抜くエンジニア組織マネジメント
Avatar for coconala_engineer coconala_engineer
0
23k
これならできる！個人開発のすゝめ
Avatar for Tsubasa SEKIGUCHI tinykitten
PRO
0
130
안드로이드 9년차 개발자, 프론트엔드 주니어로 커리어 리셋하기
Avatar for Seungmin 마량 maryang
1
140
Implementation Patterns
Avatar for Denys Poltorak denyspoltorak
0
120
Tinkerbellから学ぶ、Podで DHCPをリッスンする手法
Avatar for Tomofumi Kondo tomokon
0
140
マスタデータ問題、マイクロサービスでどう解くか
Avatar for Kato Keisuke kts
0
130
The Past, Present, and Future of Enterprise Java
Avatar for ivargrimstad ivargrimstad
0
370
ゆくKotlin くるRust
Avatar for TATSUNO Yasuhiro exoego
1
160

Featured

See All Featured
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
520
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
25
1.7k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
7.8k
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon szymonslowik
1
170
Lessons Learnt from Crawling 1000+ Websites
Avatar for Charles Meaden charlesmeaden
PRO
0
960
A better future with KSS
Avatar for Kyle Neath kneath
240
18k
エンジニアに許された特別な時間の終わり
Avatar for watany watany
106
220k
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
3
35k
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
130
A Soul's Torment
Avatar for Nat Ma seathinner
1
2k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
77
5.2k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None