Upgrade to Pro — share decks privately, control downloads, hide ads and more …

LLMOps Operationalizing Large Language Models f...

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Raj Raj
March 28, 2025
Technology
79
0

LLMOps Operationalizing Large Language Models for the Real World

LLMOps Operationalizing Large Language Models for the Real World

Avatar for Raj

Raj

March 28, 2025

More Decks by Raj

See All by Raj
A Software Engineer’s Guide to Raising Future-Ready Kids
Avatar for Raj rajkumarsakthi
0
150
Power of Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
140
Minimalism in DevOps 2023
Avatar for Raj rajkumarsakthi
0
170
Are You a Modern Software Engineer?
Avatar for Raj rajkumarsakthi
0
53
Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
86
Are You are a Modern DevOps Engineer?🤔
Avatar for Raj rajkumarsakthi
0
65
PHP Vegas : Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
2
100
PHP & Coding : Modern Software Developer
Avatar for Raj rajkumarsakthi
0
190
Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
0
110

Other Decks in Technology

See All in Technology
Rapid Start: Faster Internet Connections, with Ruby's Help
Avatar for kazuho kazuho
2
170
マルチプロダクトの信頼性を効率良く保っていくために
Avatar for KNOWLEDGE WORK / 株式会社ナレッジワーク kworkdev
PRO
0
150
AI バイブコーティングでキーボード不要？！
Avatar for Sam Akada samakada
0
480
最新の脅威動向から考える、コンテナサプライチェーンのリスクと対策
Avatar for Kyohei Mizumoto kyohmizu
1
690
基盤を育てる 外部SaaS連携の運用
Avatar for Hiroto Gamo gamonges_dresscode
1
110
サイボウズ 開発本部採用ピッチ / Cybozu Engineer Recruit
Avatar for Cybozu cybozuinsideout
PRO
10
78k
弁護士ドットコム株式会社 エンジニア職向け 会社紹介資料
Avatar for 弁護士ドットコム bengo4com
1
140
20260423_執筆の工夫と裏側 技術書の企画から刊行まで / From the planning to the publication of technical book
Avatar for nash_efp nash_efp
3
380
The Journey of Box Building
Avatar for Satoshi Tagomori tagomoris
4
1.6k
QGISプラグイン CMChangeDetector
Avatar for Forestgeo.info naokimuroki
1
380
Standards et agents IA : un tour d’horizon de MCP, A2A, ADK et plus encore
Avatar for Guillaume Laforge glaforge
0
140
Introduction to Sansan, inc / Sansan Global Development Center, Inc.
Avatar for Sansan, Inc. sansan33
PRO
0
3k

Featured

See All Featured
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.8k
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
320
WENDY [Excerpt]
Avatar for Tessa Abrams tessaabrams
10
37k
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
Avatar for UX Y'all uxyall
0
1.1k
Why Your Marketing Sucks and What You Can Do About It - Sophie Logan
Avatar for Sophie Logan marketingsoph
0
130
Building a A Zero-Code AI SEO Workflow
Avatar for Ian Lurie portentint
PRO
0
450
The Power of CSS Pseudo Elements
Avatar for Geoffrey Crofte geoffreycrofte
82
6.2k
The Limits of Empathy - UXLibs8
Avatar for Cassini Nazir cassininazir
1
300
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.2k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
29
4.2k

Transcript

  1. LLMOps Operationalizing Large Language Models for the Real World

  2. Hello! I’m Raj 😊 I ❤ to design & develop

    modern software

  3. About me Rajkumar Sakthivel (Raj) Senior Pro Dev @ Tesco

    Technology Founder @ tessellit_uk @rajkumarsakthi

  4. LLMOps Operationalizing Large Language Models for the Real World

  5. AI Disaster

  6. None
  7. None
  8. None
  9. None
  10. None
  11. None

  12. Cost

  13. None

  14. Real-World Challenges

  15. Hallucinations & Safety

  16. Cost Management

  17. Model Drift

  18. Security

  19. Best Practices

  20. RAG Workflow Rule 1: Start with RAG & Fine tune

    later

  21. Prompt Versioning: Rule 2: Treat prompts like code diff tool

    showing how changing ‘Summarize’ to ‘TLDR’ boosted accuracy

  22. GPU Optimization: Rule 3: Right-size GPUs Use A100s for training,

    T4s for inference
  23. None

  24. LLMOps bridges the prototype-to-production gap. Start small, monitor obsessively, and

    never trust an LLM alone with customers.

  25. Any Questions? 😊