Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Avatar for Hoon Heo Hoon Heo
July 25, 2024
Technology
2.5k
0

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning

Avatar for Hoon Heo

Hoon Heo

July 25, 2024

More Decks by Hoon Heo

See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
Avatar for Hoon Heo huffon
0
790
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
Avatar for Hoon Heo huffon
0
1.6k
​고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
Avatar for Hoon Heo huffon
3
2k
Autonomous Agent in Production
Avatar for Hoon Heo huffon
2
1.3k
Generative UX in LLM Application
Avatar for Hoon Heo huffon
1
1.1k

Other Decks in Technology

See All in Technology
CARTA HOLDINGS エンジニア向け 採用ピッチ資料 / CARTA-GUIDE-for-Engineers
Avatar for CARTA Engineering carta_engineering
0
47k
Oracle Base Database Service 技術詳細
Avatar for oracle4engineer oracle4engineer
PRO
15
100k
PdM・Eng・QAで進めるAI駆動開発の現在地/aidd-with-pdm-eng-qa
Avatar for butatamasoba / Shota Kusaba / 草場翔太 shota_kusaba
0
260
インプロセスQAのための要因から捉えるプロジェクトリスクマネジメントnano #1 開発リソース効率状態への対処 #jasstnano
Avatar for barus_qa_dev barus_qa
0
190
開発サイクルのボーダーレス化に伴う組織変革から学んだこと / Organizational Transformation Amid the Borderless Development Cycle
Avatar for miisan mii3king
0
290
"うちにはまだ早い"は本当？ ─ 小さく始めるPlatform Engineering入門
Avatar for Haruka Sakihara harukasakihara
7
640
Databricks 月刊サービスアップデートまとめ 2026年04月号
Avatar for ちょし tyosi1212
0
130
20260515 ID管理は会社を守る大切な砦！〜🔰情シス向け〜
Avatar for OpenID Foundation Japan oidfj
0
730
最新技術を"今は選ばない"という技術選定
Avatar for Tech Leverages leveragestech
PRO
0
270
Directions Asia 2026 | Beyond Buildable AI Agents: Let’s Visualize Partner Value in the AI Era
Avatar for Dynamics Ryo ryoheig0405
0
120
The Bag-of-Documents Model for Query Understanding and Retrieval
Avatar for Daniel Tunkelang dtunkelang
0
170
【関西製造業祭り2026春】現場を変える技術はここまで来た〜世界最大の製造業見本市から持って帰ってきたもの〜
Avatar for 田中 聖也 tanakaseiya
0
190

Featured

See All Featured
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
28
3.5k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
Lessons Learnt from Crawling 1000+ Websites
Avatar for Charles Meaden charlesmeaden
PRO
1
1.2k
Believing is Seeing
Avatar for Spiro Bolos oripsolob
1
130
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
1.9k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.4k
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
330
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.7k
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.6k
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
0
33k
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
Avatar for Aleyda Solis aleyda
2
10k
Between Models and Reality
Avatar for mayunak mayunak
4
290

Transcript

  1. ,BSUFS)FP!-JOFS What if…? ୊਺ࠗఠ ׮द LLM য೒ܻா੉࣌ਸ ѐߊೠ׮ݶ : ૑դ

    1֙ р੄ ߓ਑ ӒܻҊ ࢿࣼ೧оח ী੉੹౟ ѐߊ ࢤక҅

  2. ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH

  3. Orchestration

  4. Orchestration ݽ؛ࢶఖदੌ߈੸ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS

  5. Orchestration ഑਷ࢎਊ੗ীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ੓਺

  6. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  7. Orchestration .PEFM'BNJMZ߹۽׹߸ࢤࢿ۽૒ਸ߹ѐҳഅ೧઱যঠೣ

  8. Orchestration ੉ਬחݽفة੗੸ੋ4%,ܳഝਊೞҊ੓ӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,

  9. Orchestration ೞա੄4%,ীࢲࢲ۽׮ܲী۞ী؀ೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU

  10. Orchestration ী੉੹౟ѐߊਸҳਗ೧઴-JUF--.

  11. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  12. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  13. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  14. Orchestration ઑӘ؊਄बਸղࠄ׮ݶ3PVUF--.ѐ֛ө૑੸ਊ

  15. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  16. Orchestration 3PVUF--.਷औѱ݈೧௪ܻܳۄ਋ఠীకਕ੸׼ೠݽ؛۽ࠁղחѐ֛

  17. Orchestration 3PVUF--.ѐ֛੄੸ਊਸా೧ࣘب৬࠺ਊ୭੸ചоמ

  18. Cost Operation

  19. Cost Operation ݆਷ӝস੉--.࠺ਊҙܻীয۰਑ਸѻҊ੓਺

  20. Cost Operation ৔ܻӝস਷ѾҴઁಿਸా೧੉ਮਸٜ݅যյࣻ੓যঠೣ

  21. Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ

  22. Cost Operation ѾҴ--.য೒ܻா੉࣌਷--.࠺ਊ୭੸ചীٮۄӝস੉ਮী৔ೱਸ઱ѱؽ

  23. Cost Operation ޷द੸ҙ੼ীࢲஹನք౟ױਤ࠺ਊ࠺઺ী؀ೠхਸղ੤ച೧ঠೣ

  24. Cost Operation xyz ࡺ݅ইפۄੌ੗߹۽যځೠন࢚ਸࠁ੉ח૑ ౠ੉੼਷হ঻ח૑١بҙஏ

  25. Cost Operation Ѣद੸ҙ੼ীࢲੌр࠺ਊ૑ࠛ੉যڌѱഋࢿغח૑ب੗زചా೧ҙஏ

  26. Cost Operation ب؀୓੉۞ೠࣻ஖חযڌѱࢸ੿ೞѱغחѦө

  27. Cost Operation ೠݺ੄ࢎਊ੗ীѱ঴݃ܳߥযٜੌࣻ੓ח૑҅࢑

  28. Cost Operation ೠݺ੄ࢎਊ੗ীѱੌрदр࠙рಣӐ঴݃ܳై੗ೡࣻ੓ח૑҅࢑

  29. Cost Operation ੸੿ై੗оמࣻ஖ܳઁಿী੸ਊ

  30. Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆੉աয়Ҋ੓਺

  31. Cost Operation ↟࠺ਊী੓য--.ীై੗оמೠࣻળী؀ೠхਸ૑פҊ੓যঠೣ ↟੉ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١੸ਊ ↟૑ࣘ੸ਵ۽ઑ૒ղ࠺ਊхпਸ੊൧ࣻ੓ب۾ݽפఠ݂ दпചъച ↟--.ਸ׸׼ೞחઑ૒਷ࢿמ ࠺ਊ

    ࣘبࣁਃੋী؀೧ࢻࣁೞѱ੽Ӕ ↟ࣁਃੋ઺बਵ۽ઑ૒ݾ಴ܳࢸ੿ೞҊ ୭੸ചܳਤೠز۱ਸٜ݅যঠೣ

  32. Fine-tuning

  33. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 1&'5

  34. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ 1&'5 1&'5

  35. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH

  36. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSח੉ױ҅ীਤ஖ ֙ਘ

  37. Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ੹'JOFUVOJOHਸ೧ঠ݅ೞח੉ਬী؀೧೤੄ܳݏ୶যঠೣ

  38. Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭੸ചܳ੉ܖযյࣻ੓ਸ૑  ೐۽ં࣌೙ਃ

  39. Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁ׮ڪযդஹನք౟ٜܳ݅যյࣻ੓ਸ૑  ࢿמૐݺ೙ਃ

  40. Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻ૑ೡࣻ੓ח1SPQSJFUBSZؘ੉ఠо੓ח૑  झझ۽ঌҊ੓ਸѪ

  41. Fine-tuning খ੄җ੿ਸ૑աݶಽҊ੗ೞחޙઁী؀ೠ੿੄о೙ࣻ੸

  42. Fine-tuning ޙઁ੿੄о࢚ࣁ൤ ೤੄ػ଻۽غ૑ঋਵݶ೟ण੉়ڨೞѱൗ۞тࣻ੓਺

  43. Fine-tuning ੉റ೟णҗ੿ীࢲஏ੿ೡࣻ੓חݫ౟ܼী؀ೠ੿੄о೙ਃ

  44. Fine-tuning ੹ా੸ੋݫ౟ܼ੄੸ਊ੉য۵׮ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ੓਺

  45. Fine-tuning ੿੄ػޙઁ৬ݫ౟ܼ ӒܻҊపझ౟ؘ੉ఠࣇী؀ೠ"4*4ஏ੿

  46. Fine-tuning ೟णػݽ؛੄ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ੿

  47. We are hiring!

  48. Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥