Upgrade to Pro — share decks privately, control downloads, hide ads and more …

LLMOps Operationalizing Large Language Models f...

Avatar for Raj Raj
March 28, 2025
Technology
0
73

LLMOps Operationalizing Large Language Models for the Real World

LLMOps Operationalizing Large Language Models for the Real World

Avatar for Raj

Raj

March 28, 2025
Tweet

More Decks by Raj

See All by Raj
A Software Engineer’s Guide to Raising Future-Ready Kids
Avatar for Raj rajkumarsakthi
0
150
Power of Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
130
Minimalism in DevOps 2023
Avatar for Raj rajkumarsakthi
0
170
Are You a Modern Software Engineer?
Avatar for Raj rajkumarsakthi
0
45
Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
78
Are You are a Modern DevOps Engineer?🤔
Avatar for Raj rajkumarsakthi
0
60
PHP Vegas : Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
2
94
PHP & Coding : Modern Software Developer
Avatar for Raj rajkumarsakthi
0
180
Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
0
100

Other Decks in Technology

See All in Technology
マルチアカウント環境でSecurity Hubの運用！導入の苦労とポイント / JAWS DAYS 2026
Avatar for GENDA genda
0
110
マルチプレーンGPUネットワークを実現するシャッフルアーキテクチャの整理と考察
Avatar for Masayuki Kobayashi markunet
2
160
DevOpsエージェントで実現する!！ AWS Well-Architected（W-A） を実現するシステム設計 / 20260307 Masaki Okuda
Avatar for SHIFT EVOLVE shift_evolve
PRO
3
270
タスク管理も1on1も、もう「管理」じゃない ― KiroとBedrock AgentCoreで変わった"判断の仕事"
Avatar for Yusuke Shimizu yusukeshimizu
5
2k
楽しく学ぼう！コミュニティ入門 AWSと人が つむいできたストーリー
Avatar for hiroramos hiroramos4
PRO
1
160
Yahoo!ショッピングのレコメンデーション・システムにおけるML実践の一例 
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
1
150
[JAWS DAYS 2026]私の AWS DevOps Agent 推しポイント
Avatar for Toshihiro Furuno furuton
0
120
楽しく学ぼう！ネットワーク入門
Avatar for Shota Shiratori shotashiratori
0
310
ブラックボックス観測に基づくAI支援のプロトコルのリバースエンジニアリングと再現 ~AIを用いたリバースエンジニアリング~ @ SECCON 14 電脳会議 / Reverse Engineering and Reproduction of an AI-Assisted Protocol Based on Black-Box Observation @ SECCON 14 DENNO-KAIGI
Avatar for chibiegg chibiegg
0
160
Oracle Database@Azure：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
4
1.1k
20260305_【白金鉱業】分析者が地理情報を武器にするための軽量なアドホック分析環境
Avatar for Yuya Kaneta yucho147
1
200
ビズリーチにおける検索・推薦の取り組み / DEIM2026
Avatar for Visional Engineering ＆ Design visional_engineering_and_design
1
120

Featured

See All Featured
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
273
27k
Odyssey Design
Avatar for Ryan Kendrick rkendrick25
PRO
2
540
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
8.4k
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
76
Exploring anti-patterns in Rails
Avatar for Elle Meredith aemeredith
2
280
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
2.4k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
0
32k
Designing Experiences People Love
Avatar for Jonathan Moore moore
143
24k
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
Avatar for David Carrasco davidcarrasco
3
67
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
770
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k

Transcript

  1. LLMOps Operationalizing Large Language Models for the Real World

  2. Hello! I’m Raj 😊 I ❤ to design & develop

    modern software

  3. About me Rajkumar Sakthivel (Raj) Senior Pro Dev @ Tesco

    Technology Founder @ tessellit_uk @rajkumarsakthi

  4. LLMOps Operationalizing Large Language Models for the Real World

  5. AI Disaster

  6. None
  7. None
  8. None
  9. None
  10. None
  11. None

  12. Cost

  13. None

  14. Real-World Challenges

  15. Hallucinations & Safety

  16. Cost Management

  17. Model Drift

  18. Security

  19. Best Practices

  20. RAG Workflow Rule 1: Start with RAG & Fine tune

    later

  21. Prompt Versioning: Rule 2: Treat prompts like code diff tool

    showing how changing ‘Summarize’ to ‘TLDR’ boosted accuracy

  22. GPU Optimization: Rule 3: Right-size GPUs Use A100s for training,

    T4s for inference
  23. None

  24. LLMOps bridges the prototype-to-production gap. Start small, monitor obsessively, and

    never trust an LLM alone with customers.

  25. Any Questions? 😊