Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Search
Sponsored
·
Your Podcast. Everywhere. Effortlessly.
Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
→
Hoon Heo
July 25, 2024
Technology
2.5k
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning
Hoon Heo
July 25, 2024
More Decks by Hoon Heo
See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
huffon
0
800
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
huffon
0
1.6k
고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
huffon
3
2k
Autonomous Agent in Production
huffon
2
1.3k
Generative UX in LLM Application
huffon
1
1.1k
Other Decks in Technology
See All in Technology
Kaggleで成長するために意識したこと
prgckwb
2
430
AIが実装を自走する時代の認知負債との戦い
lycorptech_jp
PRO
2
970
発表と総括 / Presentations and Summary
ks91
PRO
0
150
個人開発で育てる「大規模設計の苗床」 - AI時代の1人開発から始める業務への知識接続 / The Seedbed for Large-Scale Design - From AI-Era Solo Projects to Professional Knowledge
bitkey
PRO
1
290
LLM/Agent評価:トップ営業の発言を「正解」にする 〜暗黙的正解による評価を営業資産に変える〜
takkuhiro
1
240
マルチアカウント環境でSecurity Hubの運用、その後どうなった? / SRE NEXT 2026 miniLT会
genda
0
110
SoccerMaster: A Vision Foundation Model for Soccer Understanding
kzykmyzw
0
150
アップデートで何が変わった?デモで学んで使いこなすIBM Bob2.0
muehara
0
200
「守りたい体験」を渡すだけで E2E を生成させられるようになった話
hinac0
1
880
AI Native なプロダクト組織の立ち上げ方 : 生産性 100 倍への挑戦
mikesorae
0
640
Playwright × AI Agent でE2Eテストはどう変わるか AI駆動テストの可能性と実用検証の結果
taiga7543
1
660
OPENLOGI Company Profile for engineer
hr01
1
74k
Featured
See All Featured
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
inesmontani
PRO
3
3.6k
Information Architects: The Missing Link in Design Systems
soysaucechin
0
1k
Side Projects
sachag
455
43k
Making the Leap to Tech Lead
cromwellryan
135
10k
Build your cross-platform service in a week with App Engine
jlugia
234
18k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
52
6k
Kristin Tynski - Automating Marketing Tasks With AI
techseoconnect
PRO
0
290
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
sarafernandez
2
1.5k
Skip the Path - Find Your Career Trail
mkilby
1
170
Large-scale JavaScript Application Architecture
addyosmani
515
110k
State of Search Keynote: SEO is Dead Long Live SEO
ryanjones
0
220
Fashionably flexible responsive web design (full day workshop)
malarkey
408
67k
Transcript
,BSUFS)FP!-JOFS What if…? ࠗఠ द LLM যܻா࣌ਸ ѐߊೠݶ : դ
1֙ р ߓ ӒܻҊ ࢿࣼ೧оח ী ѐߊ ࢤక҅
ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH
Orchestration
Orchestration ݽ؛ࢶఖदੌ߈ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS
Orchestration ࢎਊীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration .PEFM'BNJMZ߹۽߸ࢤࢿ۽ਸ߹ѐҳഅ೧যঠೣ
Orchestration ਬחݽفةੋ4%,ܳഝਊೞҊӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,
Orchestration ೞա4%,ীࢲࢲ۽ܲী۞ীೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU
Orchestration ীѐߊਸҳਗ೧-JUF--.
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ઑӘ؊बਸղࠄݶ3PVUF--.ѐ֛өਊ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration 3PVUF--.औѱ݈೧௪ܻܳۄఠীకਕೠݽ؛۽ࠁղחѐ֛
Orchestration 3PVUF--.ѐ֛ਊਸా೧ࣘب৬࠺ਊ୭ചоמ
Cost Operation
Cost Operation ݆ӝস--.࠺ਊҙܻীয۰ਸѻҊ
Cost Operation ܻӝসѾҴઁಿਸా೧ਮਸٜ݅যյࣻযঠೣ
Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ
Cost Operation ѾҴ--.যܻா࣌--.࠺ਊ୭ചীٮۄӝসਮীೱਸѱؽ
Cost Operation दҙীࢲஹನքױਤ࠺ਊ࠺ীೠхਸղച೧ঠೣ
Cost Operation xyz ࡺ݅ইפۄੌ߹۽যځೠন࢚ਸࠁח ౠহח١بҙஏ
Cost Operation Ѣदҙীࢲੌр࠺ਊࠛযڌѱഋࢿغחبزചా೧ҙஏ
Cost Operation ب۞ೠࣻחযڌѱࢸೞѱغחѦө
Cost Operation ೠݺࢎਊীѱ݃ܳߥযٜੌࣻח҅
Cost Operation ೠݺࢎਊীѱੌрदр࠙рಣӐ݃ܳైೡࣻח҅
Cost Operation ైоמࣻܳઁಿীਊ
Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆աয়Ҋ
Cost Operation ↟࠺ਊীয--.ীైоמೠࣻળীೠхਸפҊযঠೣ ↟ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١ਊ ↟ࣘਵ۽ઑղ࠺ਊхпਸ൧ࣻب۾ݽפఠ݂ दпചъച ↟--.ਸೞחઑࢿמ ࠺ਊ
ࣘبࣁਃੋী೧ࢻࣁೞѱӔ ↟ࣁਃੋबਵ۽ઑݾܳࢸೞҊ ୭ചܳਤೠز۱ਸٜ݅যঠೣ
Fine-tuning
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ 1&'5 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSחױ҅ীਤ ֙ਘ
Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ'JOFUVOJOHਸ೧ঠ݅ೞחਬী೧ܳݏ୶যঠೣ
Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭ചܳܖযյࣻਸ ۽ં࣌ਃ
Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁڪযդஹನքٜܳ݅যյࣻਸ ࢿמૐݺਃ
Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻೡࣻח1SPQSJFUBSZؘఠоח झझ۽ঌҊਸѪ
Fine-tuning খҗਸաݶಽҊೞחޙઁীೠоࣻ
Fine-tuning ޙઁо࢚ࣁ ػ۽غঋਵݶण়ڨೞѱൗ۞тࣻ
Fine-tuning റणҗীࢲஏೡࣻחݫܼীೠоਃ
Fine-tuning ాੋݫܼਊয۵ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ
Fine-tuning ػޙઁ৬ݫܼ ӒܻҊపझؘఠࣇীೠ"4*4ஏ
Fine-tuning णػݽ؛ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ
We are hiring!
Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥