Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

LLMOps Operationalizing Large Language Models f...

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Raj Raj
March 28, 2025
Technology
110
0

LLMOps Operationalizing Large Language Models for the Real World

LLMOps Operationalizing Large Language Models for the Real World

Avatar for Raj

Raj

March 28, 2025

More Decks by Raj

See All by Raj
AI ENGINEER WORLD'S FAIR 2026 - We Cut 94% of Our AI Coding Tokens With a Local Code Index
Avatar for Raj rajkumarsakthi
0
42
A Software Engineer’s Guide to Raising Future-Ready Kids
Avatar for Raj rajkumarsakthi
0
190
Power of Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
150
Minimalism in DevOps 2023
Avatar for Raj rajkumarsakthi
0
190
Are You a Modern Software Engineer?
Avatar for Raj rajkumarsakthi
0
80
Minimalism in DevOps
Avatar for Raj rajkumarsakthi
0
100
Are You are a Modern DevOps Engineer?🤔
Avatar for Raj rajkumarsakthi
0
86
PHP Vegas : Modern Software Developer Best Practices 2020
Avatar for Raj rajkumarsakthi
2
120
PHP & Coding : Modern Software Developer
Avatar for Raj rajkumarsakthi
0
220

Other Decks in Technology

See All in Technology
Microsoft Entra Kerberos で実現するクラウド デバイス管理
Avatar for tamaiyutaro tamaiyutaro
2
660
An Introduction to Context Ontology Accelerator (teaching AI agents what your data means)
Avatar for Riku INADA inariku
PRO
1
200
属人化したISMS運用をGitHubとAIで仕組み化した1年間の記録
Avatar for Shohei Koyama / Sion sioncojp
4
1.9k
【dbts2026】AIエージェントの 判断と探索を変える、 データベース エンジニアリング― 既存DBの処理と依存関係から作る、オペレーショナルオントロジー ―
Avatar for KoheiOgawa shisyu_gaku
0
270
AWS基盤改善を支える 私たちの理念と行動指針
Avatar for Kento Suzuki kentosuzuki
0
140
Gifu WordPress Meetup #200 に向けて、私たちには何ができるだろうか？/ 2026-11-07 Gifu WordPress Meetup
Avatar for Toro_Unit (Hiroshi Urabe) torounit
0
240
Sizing, Benchmarking and Performance Tuning Apache Flink Clusters
Avatar for Robert Metzger rmetzger
0
140
AWSを利用する上で知っておきたい名前解決の話 2026
Avatar for nagisa_53 nagisa53
5
3.3k
Kiro を使うコツ (頼み方、覚えさせ方、任せ方) | 目指せ Kiro マスター 09
Avatar for Riku INADA inariku
PRO
3
120
少ない人手 限られた予算 それでも守る 消せない・見つける・戻れる オールハザード型BCP on AWS / 20261107 Mitsutoshi Matsuo
Avatar for SHIFT EVOLVE shift_evolve
PRO
0
330
AX時代の自治体支援リソース再配分と役割分担の再構成：戦略とロードマップ（概要）
Avatar for Sayaka Isizuka sishi2026
0
210
AWS構成から考えるWebセキュリティ ― WordPressの構築経験から考える公開範囲と更新運用【JAWS FESTA 2026 in AKITA】
Avatar for サイバーセキュリティクラウド cscengineer
PRO
2
390

Featured

See All Featured
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
211
25k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
306
120k
The SEO identity crisis: Don't let AI make you average
Avatar for Varn varn
0
630
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
4k
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
340
Mind Mapping
Avatar for Hélio Medeiros helmedeiros
1
430
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.9k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
560
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
45
9.3k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
Avatar for Morgane Peng morganepeng
133
20k
Pawsitive SEO: Lessons from My Dog (and Many Mistakes) on Thriving as a Consultant in the Age of AI
Avatar for David Carrasco davidcarrasco
0
300
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.6k

Transcript

  1. LLMOps Operationalizing Large Language Models for the Real World

  2. Hello! I’m Raj 😊 I ❤ to design & develop

    modern software

  3. About me Rajkumar Sakthivel (Raj) Senior Pro Dev @ Tesco

    Technology Founder @ tessellit_uk @rajkumarsakthi

  4. LLMOps Operationalizing Large Language Models for the Real World

  5. AI Disaster

  6. None
  7. None
  8. None
  9. None
  10. None
  11. None

  12. Cost

  13. None

  14. Real-World Challenges

  15. Hallucinations & Safety

  16. Cost Management

  17. Model Drift

  18. Security

  19. Best Practices

  20. RAG Workflow Rule 1: Start with RAG & Fine tune

    later

  21. Prompt Versioning: Rule 2: Treat prompts like code diff tool

    showing how changing ‘Summarize’ to ‘TLDR’ boosted accuracy

  22. GPU Optimization: Rule 3: Right-size GPUs Use A100s for training,

    T4s for inference
  23. None

  24. LLMOps bridges the prototype-to-production gap. Start small, monitor obsessively, and

    never trust an LLM alone with customers.

  25. Any Questions? 😊