Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Search
Hoon Heo
July 25, 2024
Technology
0
2.5k
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning
Hoon Heo
July 25, 2024
Tweet
Share
More Decks by Hoon Heo
See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
huffon
0
740
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
huffon
0
1.5k
고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
huffon
3
2k
Autonomous Agent in Production
huffon
2
1.2k
Generative UX in LLM Application
huffon
1
1.1k
Other Decks in Technology
See All in Technology
SSO方式とJumpアカウント方式の比較と設計方針
yuobayashi
6
280
re:Invent2025 コンテナ系アップデート振り返り(+CloudWatchログのアップデート紹介)
masukawa
0
300
“決まらない”NSM設計への処方箋 〜ビットキーにおける現実的な指標デザイン事例〜 / A Prescription for "Stuck" NSM Design: Bitkey’s Practical Case Study
bitkey
PRO
1
580
「Managed Instances」と「durable functions」で広がるAWS Lambdaのユースケース
lamaglama39
0
260
AI時代の開発フローとともに気を付けたいこと
kkamegawa
0
2k
エンジニアリングマネージャー はじめての目標設定と評価
halkt
0
250
コミューンのデータ分析AIエージェント「Community Sage」の紹介
fufufukakaka
0
420
Bakuraku Engineering Team Deck
layerx
PRO
12
7k
[CMU-DB-2025FALL] Apache Fluss - A Streaming Storage for Real-Time Lakehouse
jark
0
110
Snowflakeでデータ基盤を もう一度作り直すなら / rebuilding-data-platform-with-snowflake
pei0804
2
300
品質のための共通認識
kakehashi
PRO
1
190
21st ACRi Webinar - Univ of Tokyo Presentation Slide (Ayumi Ohno)
nao_sumikawa
0
120
Featured
See All Featured
The Cost Of JavaScript in 2023
addyosmani
55
9.3k
Six Lessons from altMBA
skipperchong
29
4.1k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
249
1.3M
Principles of Awesome APIs and How to Build Them.
keavy
127
17k
How Fast Is Fast Enough? [PerfNow 2025]
tammyeverts
3
390
The Straight Up "How To Draw Better" Workshop
denniskardys
239
140k
GraphQLとの向き合い方2022年版
quramy
50
14k
How STYLIGHT went responsive
nonsquared
100
5.9k
The Hidden Cost of Media on the Web [PixelPalooza 2025]
tammyeverts
1
92
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
17k
Designing for humans not robots
tammielis
254
26k
Practical Orchestrator
shlominoach
190
11k
Transcript
,BSUFS)FP!-JOFS What if…? ࠗఠ द LLM যܻா࣌ਸ ѐߊೠݶ : դ
1֙ р ߓ ӒܻҊ ࢿࣼ೧оח ী ѐߊ ࢤక҅
ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH
Orchestration
Orchestration ݽ؛ࢶఖदੌ߈ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS
Orchestration ࢎਊীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration .PEFM'BNJMZ߹۽߸ࢤࢿ۽ਸ߹ѐҳഅ೧যঠೣ
Orchestration ਬחݽفةੋ4%,ܳഝਊೞҊӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,
Orchestration ೞա4%,ীࢲࢲ۽ܲী۞ীೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU
Orchestration ীѐߊਸҳਗ೧-JUF--.
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ઑӘ؊बਸղࠄݶ3PVUF--.ѐ֛өਊ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration 3PVUF--.औѱ݈೧௪ܻܳۄఠীకਕೠݽ؛۽ࠁղחѐ֛
Orchestration 3PVUF--.ѐ֛ਊਸా೧ࣘب৬࠺ਊ୭ചоמ
Cost Operation
Cost Operation ݆ӝস--.࠺ਊҙܻীয۰ਸѻҊ
Cost Operation ܻӝসѾҴઁಿਸా೧ਮਸٜ݅যյࣻযঠೣ
Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ
Cost Operation ѾҴ--.যܻா࣌--.࠺ਊ୭ചীٮۄӝসਮীೱਸѱؽ
Cost Operation दҙীࢲஹನքױਤ࠺ਊ࠺ীೠхਸղച೧ঠೣ
Cost Operation xyz ࡺ݅ইפۄੌ߹۽যځೠন࢚ਸࠁח ౠহח١بҙஏ
Cost Operation Ѣदҙীࢲੌр࠺ਊࠛযڌѱഋࢿغחبزചా೧ҙஏ
Cost Operation ب۞ೠࣻחযڌѱࢸೞѱغחѦө
Cost Operation ೠݺࢎਊীѱ݃ܳߥযٜੌࣻח҅
Cost Operation ೠݺࢎਊীѱੌрदр࠙рಣӐ݃ܳైೡࣻח҅
Cost Operation ైоמࣻܳઁಿীਊ
Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆աয়Ҋ
Cost Operation ↟࠺ਊীয--.ীైоמೠࣻળীೠхਸפҊযঠೣ ↟ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١ਊ ↟ࣘਵ۽ઑղ࠺ਊхпਸ൧ࣻب۾ݽפఠ݂ दпചъച ↟--.ਸೞחઑࢿמ ࠺ਊ
ࣘبࣁਃੋী೧ࢻࣁೞѱӔ ↟ࣁਃੋबਵ۽ઑݾܳࢸೞҊ ୭ചܳਤೠز۱ਸٜ݅যঠೣ
Fine-tuning
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ 1&'5 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSחױ҅ীਤ ֙ਘ
Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ'JOFUVOJOHਸ೧ঠ݅ೞחਬী೧ܳݏ୶যঠೣ
Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭ചܳܖযյࣻਸ ۽ં࣌ਃ
Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁڪযդஹನքٜܳ݅যյࣻਸ ࢿמૐݺਃ
Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻೡࣻח1SPQSJFUBSZؘఠоח झझ۽ঌҊਸѪ
Fine-tuning খҗਸաݶಽҊೞחޙઁীೠоࣻ
Fine-tuning ޙઁо࢚ࣁ ػ۽غঋਵݶण়ڨೞѱൗ۞тࣻ
Fine-tuning റणҗীࢲஏೡࣻחݫܼীೠоਃ
Fine-tuning ాੋݫܼਊয۵ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ
Fine-tuning ػޙઁ৬ݫܼ ӒܻҊపझؘఠࣇীೠ"4*4ஏ
Fine-tuning णػݽ؛ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ
We are hiring!
Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥