Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Search
Hoon Heo
July 25, 2024
Technology
2.6k
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning
Hoon Heo
July 25, 2024
More Decks by Hoon Heo
See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
huffon
0
810
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
huffon
0
1.7k
고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
huffon
3
2k
Autonomous Agent in Production
huffon
2
1.3k
Generative UX in LLM Application
huffon
1
1.1k
Other Decks in Technology
See All in Technology
Bet AI Day 2026丨Agentは、「金融」という巨大産業の何を変えられるのか
layerx
PRO
0
970
深夜のクラウド懺悔室 1:29:300 or 1:0:0
kazzpapa3
0
180
AI時代におけるプロダクト横断勉強会の設計
zozotech
PRO
0
160
DINO-EdgeQuery:Edge-First Polygon Decoding for Building Footprint Extraction from Satellite Imagery
lehupa
0
150
現場に行くだけでは足りない——プロダクトエンジニアが業務の流れを捉える観点と、その鍛え方
takumiengineering
0
300
20260903 Tokyo Jazug Night #62 | Azure エンジニアよ、 その環境は本当にセキュアか?
olivia_0707
1
620
生成AIのテナント制御とシャドーMCP対策 | AIを"止めずに"、情報を守る
yukun
0
120
AI活用の現在地、 ちゃんと見えてますか?/XPfest-2026
visional_engineering_and_design
0
160
どんな手を使っても絶対間に合わせるスケジューラ
asari194617
0
1.6k
Azure App Service / Container Apps の組み込み認証
kuniteru
0
200
作り直せるコードは迅速に 作り直せないDBは慎重に - AI時代のプロダクトエンジニアが「判断の不可逆性」で開発速度を変える話
kinosuke01
0
250
AIとペアプロを始める。人とのペアプロをやめる。ペアプロの良さを改めて知る。もっと好きになった。 / Rediscovering Pair Programming
honyanya
1
250
Featured
See All Featured
Building a A Zero-Code AI SEO Workflow
portentint
PRO
0
710
The browser strikes back
jonoalderson
0
1.6k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
25
2.1k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
21
1.6k
Java REST API Framework Comparison - PWX 2021
mraible
34
9.7k
A brief & incomplete history of UX Design for the World Wide Web: 1989–2019
jct
2
500
The Pragmatic Product Professional
lauravandoore
37
7.4k
BBQ
matthewcrist
89
10k
<Decoding/> the Language of Devs - We Love SEO 2024
nikkihalliwell
1
320
Organizational Design Perspectives: An Ontology of Organizational Design Elements
kimpetersen
PRO
1
820
The Curse of the Amulet
leimatthew05
2
14k
Optimizing for Happiness
mojombo
378
71k
Transcript
,BSUFS)FP!-JOFS What if…? ࠗఠ द LLM যܻா࣌ਸ ѐߊೠݶ : դ
1֙ р ߓ ӒܻҊ ࢿࣼ೧оח ী ѐߊ ࢤక҅
ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH
Orchestration
Orchestration ݽ؛ࢶఖदੌ߈ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS
Orchestration ࢎਊীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration .PEFM'BNJMZ߹۽߸ࢤࢿ۽ਸ߹ѐҳഅ೧যঠೣ
Orchestration ਬחݽفةੋ4%,ܳഝਊೞҊӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,
Orchestration ೞա4%,ীࢲࢲ۽ܲী۞ীೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU
Orchestration ীѐߊਸҳਗ೧-JUF--.
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ઑӘ؊बਸղࠄݶ3PVUF--.ѐ֛өਊ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration 3PVUF--.औѱ݈೧௪ܻܳۄఠীకਕೠݽ؛۽ࠁղחѐ֛
Orchestration 3PVUF--.ѐ֛ਊਸా೧ࣘب৬࠺ਊ୭ചоמ
Cost Operation
Cost Operation ݆ӝস--.࠺ਊҙܻীয۰ਸѻҊ
Cost Operation ܻӝসѾҴઁಿਸా೧ਮਸٜ݅যյࣻযঠೣ
Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ
Cost Operation ѾҴ--.যܻா࣌--.࠺ਊ୭ചীٮۄӝসਮীೱਸѱؽ
Cost Operation दҙীࢲஹನքױਤ࠺ਊ࠺ীೠхਸղച೧ঠೣ
Cost Operation xyz ࡺ݅ইפۄੌ߹۽যځೠন࢚ਸࠁח ౠহח١بҙஏ
Cost Operation Ѣदҙীࢲੌр࠺ਊࠛযڌѱഋࢿغחبزചా೧ҙஏ
Cost Operation ب۞ೠࣻחযڌѱࢸೞѱغחѦө
Cost Operation ೠݺࢎਊীѱ݃ܳߥযٜੌࣻח҅
Cost Operation ೠݺࢎਊীѱੌрदр࠙рಣӐ݃ܳైೡࣻח҅
Cost Operation ైоמࣻܳઁಿীਊ
Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆աয়Ҋ
Cost Operation ↟࠺ਊীয--.ীైоמೠࣻળীೠхਸפҊযঠೣ ↟ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١ਊ ↟ࣘਵ۽ઑղ࠺ਊхпਸ൧ࣻب۾ݽפఠ݂ दпചъച ↟--.ਸೞחઑࢿמ ࠺ਊ
ࣘبࣁਃੋী೧ࢻࣁೞѱӔ ↟ࣁਃੋबਵ۽ઑݾܳࢸೞҊ ୭ചܳਤೠز۱ਸٜ݅যঠೣ
Fine-tuning
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ 1&'5 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSחױ҅ীਤ ֙ਘ
Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ'JOFUVOJOHਸ೧ঠ݅ೞחਬী೧ܳݏ୶যঠೣ
Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭ചܳܖযյࣻਸ ۽ં࣌ਃ
Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁڪযդஹನքٜܳ݅যյࣻਸ ࢿמૐݺਃ
Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻೡࣻח1SPQSJFUBSZؘఠоח झझ۽ঌҊਸѪ
Fine-tuning খҗਸաݶಽҊೞחޙઁীೠоࣻ
Fine-tuning ޙઁо࢚ࣁ ػ۽غঋਵݶण়ڨೞѱൗ۞тࣻ
Fine-tuning റणҗীࢲஏೡࣻחݫܼীೠоਃ
Fine-tuning ాੋݫܼਊয۵ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ
Fine-tuning ػޙઁ৬ݫܼ ӒܻҊపझؘఠࣇীೠ"4*4ஏ
Fine-tuning णػݽ؛ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ
We are hiring!
Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥