Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Search
Hoon Heo
July 25, 2024
Technology
0
2.3k
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning
Hoon Heo
July 25, 2024
Tweet
Share
More Decks by Hoon Heo
See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
huffon
0
620
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
huffon
0
950
고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
huffon
3
1.9k
Autonomous Agent in Production
huffon
2
1.2k
Generative UX in LLM Application
huffon
1
1k
Other Decks in Technology
See All in Technology
マネコン操作いらず! TerraformでAWSインフラのコーディングに入門しよう
minorun365
PRO
5
1.5k
エンジニア採用と 技術広報の実践/acaricsummit2025
nishiuma
1
180
Codar: Arte ou Ciência?! A Jornada de um DEV na Creator Economy
vclementino
0
190
【Oracle Cloud ウェビナー】【入門&再入門】はじめてのOracle Cloud Infrastructure [+最新情報]
oracle4engineer
PRO
1
270
Microsoft_20250311_第2回AI_IoT共創ラボ.pdf
iotcomjpadmin
0
350
完璧を捨てろ! “攻め”のQAがもたらすスピードと革新/20250306 Hiroki Hachisuka
shift_evolve
0
200
プルリクエストレビューを終わらせるためのチーム体制 / The Team for Completing Pull Request Reviews
nekonenene
4
2.2k
エンジニアの健康管理術 / Engineer Health Management Techniques
y_sone
8
7.2k
プロダクトの一番の理解者を目指してQAが取り組んでいること 〜現場・マネジメント各視点のプラクティス〜
hacomono
PRO
0
100
アウトカムを最大化させるプロダクトエンジニアの動き
hacomono
PRO
0
290
セキュリティグループの”タイプ”を改めて考えてみる
masakiokuda
0
130
AWSサービスアップデート2025年2月分
yuobayashi
2
110
Featured
See All Featured
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
How GitHub (no longer) Works
holman
314
140k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
22
2.5k
Become a Pro
speakerdeck
PRO
26
5.2k
Designing for humans not robots
tammielis
250
25k
Why Our Code Smells
bkeepers
PRO
336
57k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
251
21k
Making Projects Easy
brettharned
116
6.1k
The Straight Up "How To Draw Better" Workshop
denniskardys
232
140k
Unsuck your backbone
ammeep
669
57k
Done Done
chrislema
182
16k
Transcript
,BSUFS)FP!-JOFS What if…? ࠗఠ द LLM যܻா࣌ਸ ѐߊೠݶ : դ
1֙ р ߓ ӒܻҊ ࢿࣼ೧оח ী ѐߊ ࢤక҅
ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH
Orchestration
Orchestration ݽ؛ࢶఖदੌ߈ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS
Orchestration ࢎਊীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration .PEFM'BNJMZ߹۽߸ࢤࢿ۽ਸ߹ѐҳഅ೧যঠೣ
Orchestration ਬחݽفةੋ4%,ܳഝਊೞҊӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,
Orchestration ೞա4%,ীࢲࢲ۽ܲী۞ীೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU
Orchestration ীѐߊਸҳਗ೧-JUF--.
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ઑӘ؊बਸղࠄݶ3PVUF--.ѐ֛өਊ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration 3PVUF--.औѱ݈೧௪ܻܳۄఠীకਕೠݽ؛۽ࠁղחѐ֛
Orchestration 3PVUF--.ѐ֛ਊਸా೧ࣘب৬࠺ਊ୭ചоמ
Cost Operation
Cost Operation ݆ӝস--.࠺ਊҙܻীয۰ਸѻҊ
Cost Operation ܻӝসѾҴઁಿਸా೧ਮਸٜ݅যյࣻযঠೣ
Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ
Cost Operation ѾҴ--.যܻா࣌--.࠺ਊ୭ചীٮۄӝসਮীೱਸѱؽ
Cost Operation दҙীࢲஹನքױਤ࠺ਊ࠺ীೠхਸղച೧ঠೣ
Cost Operation xyz ࡺ݅ইפۄੌ߹۽যځೠন࢚ਸࠁח ౠহח١بҙஏ
Cost Operation Ѣदҙীࢲੌр࠺ਊࠛযڌѱഋࢿغחبزചా೧ҙஏ
Cost Operation ب۞ೠࣻחযڌѱࢸೞѱغחѦө
Cost Operation ೠݺࢎਊীѱ݃ܳߥযٜੌࣻח҅
Cost Operation ೠݺࢎਊীѱੌрदр࠙рಣӐ݃ܳైೡࣻח҅
Cost Operation ైоמࣻܳઁಿীਊ
Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆աয়Ҋ
Cost Operation ↟࠺ਊীয--.ীైоמೠࣻળীೠхਸפҊযঠೣ ↟ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١ਊ ↟ࣘਵ۽ઑղ࠺ਊхпਸ൧ࣻب۾ݽפఠ݂ दпചъച ↟--.ਸೞחઑࢿמ ࠺ਊ
ࣘبࣁਃੋী೧ࢻࣁೞѱӔ ↟ࣁਃੋबਵ۽ઑݾܳࢸೞҊ ୭ചܳਤೠز۱ਸٜ݅যঠೣ
Fine-tuning
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ 1&'5 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSחױ҅ীਤ ֙ਘ
Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ'JOFUVOJOHਸ೧ঠ݅ೞחਬী೧ܳݏ୶যঠೣ
Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭ചܳܖযյࣻਸ ۽ં࣌ਃ
Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁڪযդஹನքٜܳ݅যյࣻਸ ࢿמૐݺਃ
Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻೡࣻח1SPQSJFUBSZؘఠоח झझ۽ঌҊਸѪ
Fine-tuning খҗਸաݶಽҊೞחޙઁীೠоࣻ
Fine-tuning ޙઁо࢚ࣁ ػ۽غঋਵݶण়ڨೞѱൗ۞тࣻ
Fine-tuning റणҗীࢲஏೡࣻחݫܼীೠоਃ
Fine-tuning ాੋݫܼਊয۵ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ
Fine-tuning ػޙઁ৬ݫܼ ӒܻҊపझؘఠࣇীೠ"4*4ஏ
Fine-tuning णػݽ؛ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ
We are hiring!
Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥