Upgrade to Pro — share decks privately, control downloads, hide ads and more …

LLMOps Operationalizing Large Language Models f...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Raj Raj
March 28, 2025
Technology
88
0

LLMOps Operationalizing Large Language Models for the Real World

LLMOps Operationalizing Large Language Models for the Real World

Avatar for Raj

Raj

March 28, 2025

More Decks by Raj

See All by Raj
A Software Engineer’s Guide to Raising Future-Ready Kids
Avatar for Raj rajkumarsakthi
0
160
Power of Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
140
Minimalism in DevOps 2023
Avatar for Raj rajkumarsakthi
0
180
Are You a Modern Software Engineer?
Avatar for Raj rajkumarsakthi
0
59
Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
89
Are You are a Modern DevOps Engineer?🤔
Avatar for Raj rajkumarsakthi
0
73
PHP Vegas : Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
2
110
PHP & Coding : Modern Software Developer
Avatar for Raj rajkumarsakthi
0
200
Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
0
120

Other Decks in Technology

See All in Technology
自称宇宙最速で不合格となったAIP-C01にリベンジを果たすべくAIで問題集アプリを作ってみた。
Avatar for Yuuki Yamashita yama3133
0
250
先取りMaven4 ～16年ぶりのメジャーアップデート、その進化とは？～
Avatar for 荻原利雄 ogiwarat
0
110
速さだけじゃない！ VoidZero ツールが移行先に選ばれる理由
Avatar for mizdra mizdra
PRO
6
690
プラットフォームエンジニア ワークショップ/ platform-workshop
Avatar for Databricks Japan databricksjapan
0
140
電子辞書Brainをネットに繋げてみた(自力編)
Avatar for らすぴー raspython3
0
370
さきさん文庫の書籍ができるまで
Avatar for H.Saki sakiengineer
0
320
Strands Agents超入門
Avatar for KintoTech_Dev kintotechdev
1
150
A Harness for Behaviour: how to get AI to generate code that does what we intend, or "TDD in the age of AI"
Avatar for Matteo Vaccari xpmatteo
1
520
React、まだ楽しくて草
Avatar for uhyo uhyo
2
250
GitHub Copilot CLIでWebアクセシビリティを改善した話
Avatar for tomokusaba tomokusaba
0
140
AI駆動開発でなんでもハンズオン環境をつくってみた
Avatar for yoshimi0227 yoshimi0227
0
180
NFLコンペ2026 解法
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
130

Featured

See All Featured
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
3.2k
The Curse of the Amulet
Avatar for Matthew Lei leimatthew05
1
13k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
How People are Using Generative and Agentic AI to Supercharge Their Products, Projects, Services and Value Streams Today
Avatar for Helen Beal helenjbeal
1
190
sira's awesome portfolio website redesign presentation
Avatar for ElsiraPls elsirapls
0
270
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
340
Design in an AI World
Avatar for tapps tapps
1
220
The B2B funnel & how to create a winning content strategy
Avatar for Katarina Dahlin katarinadahlin
PRO
1
370
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
810
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
22k
Leveraging LLMs for student feedback in introductory data science courses - posit::conf(2025)
Avatar for Mine Cetinkaya-Rundel minecr
1
270
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k

Transcript

  1. LLMOps Operationalizing Large Language Models for the Real World

  2. Hello! I’m Raj 😊 I ❤ to design & develop

    modern software

  3. About me Rajkumar Sakthivel (Raj) Senior Pro Dev @ Tesco

    Technology Founder @ tessellit_uk @rajkumarsakthi

  4. LLMOps Operationalizing Large Language Models for the Real World

  5. AI Disaster

  6. None
  7. None
  8. None
  9. None
  10. None
  11. None

  12. Cost

  13. None

  14. Real-World Challenges

  15. Hallucinations & Safety

  16. Cost Management

  17. Model Drift

  18. Security

  19. Best Practices

  20. RAG Workflow Rule 1: Start with RAG & Fine tune

    later

  21. Prompt Versioning: Rule 2: Treat prompts like code diff tool

    showing how changing ‘Summarize’ to ‘TLDR’ boosted accuracy

  22. GPU Optimization: Rule 3: Right-size GPUs Use A100s for training,

    T4s for inference
  23. None

  24. LLMOps bridges the prototype-to-production gap. Start small, monitor obsessively, and

    never trust an LLM alone with customers.

  25. Any Questions? 😊