Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Search
Hoon Heo
July 25, 2024
Technology
2.5k
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning
Hoon Heo
July 25, 2024
More Decks by Hoon Heo
See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
huffon
0
800
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
huffon
0
1.6k
고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
huffon
3
2k
Autonomous Agent in Production
huffon
2
1.3k
Generative UX in LLM Application
huffon
1
1.1k
Other Decks in Technology
See All in Technology
伝票作成AIエージェントを支える、LLMOpsとインフラの選択肢 / AICon2026_takeda
rakus_dev
0
220
複数プロダクトで進めるAI機能実装 ── 実践から得たリアルな学びとロードマップ実現への挑戦 / AICon2026_yanari
rakus_dev
0
230
CDKで書くECSのベストプラクティス、 改めて考え直す2026 #cdkconf2026
makies
3
880
データエンジニアリングとドメイン駆動設計
masuda220
PRO
9
1.4k
SRE Next 2026 何でも屋からの脱却
bto
0
1.1k
2年前に削除したPHPクラスが、 ある日突然決済をエラーにした
ykagano
1
600
発表と総括 / Presentations and Summary
ks91
PRO
0
150
キャリアLT会#3
beli68
0
150
DatabricksにおけるMCPソリューション
taka_aki
1
310
「早く出す」より「事業に効く」 ── 顧客の業務サイクルから逆算するAI時代の二重ループ開発と「変化の設計者」 / devsumi2026
rakus_dev
1
490
大量データに対しても、生成AIを用いてリーズナブルにデータ加工をしたい!Databricksのai_queryについて調べてみた
kamoshika
1
230
AI時代の開発生産性は、個人技からチーム設計へ
moongift
PRO
4
2.4k
Featured
See All Featured
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4.4k
Paper Plane (Part 1)
katiecoart
PRO
1
9.7k
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
madoxten
64
56k
Mozcon NYC 2025: Stop Losing SEO Traffic
samtorres
1
400
Bootstrapping a Software Product
garrettdimon
PRO
307
120k
Music & Morning Musume
bryan
47
7.3k
Groundhog Day: Seeking Process in Gaming for Health
codingconduct
0
250
Conquering PDFs: document understanding beyond plain text
inesmontani
PRO
4
2.9k
Reality Check: Gamification 10 Years Later
codingconduct
0
2.2k
Scaling GitHub
holman
464
140k
Building Adaptive Systems
keathley
44
3.1k
Future Trends and Review - Lecture 12 - Web Technologies (1019888BNR)
signer
PRO
0
3.6k
Transcript
,BSUFS)FP!-JOFS What if…? ࠗఠ द LLM যܻா࣌ਸ ѐߊೠݶ : դ
1֙ р ߓ ӒܻҊ ࢿࣼ೧оח ী ѐߊ ࢤక҅
ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH
Orchestration
Orchestration ݽ؛ࢶఖदੌ߈ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS
Orchestration ࢎਊীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration .PEFM'BNJMZ߹۽߸ࢤࢿ۽ਸ߹ѐҳഅ೧যঠೣ
Orchestration ਬחݽفةੋ4%,ܳഝਊೞҊӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,
Orchestration ೞա4%,ীࢲࢲ۽ܲী۞ীೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU
Orchestration ীѐߊਸҳਗ೧-JUF--.
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ాੌػੋఠಕझ۽ࢲ۽ܲݽ؛ഝਊҗ'BMMCBDLоמ
Orchestration ઑӘ؊बਸղࠄݶ3PVUF--.ѐ֛өਊ
Orchestration নೞѱߊࢤೡࣻח࠙ӝ߂'BMMCBDL۽ ↟աѱӟਃٜয৳ਸٸ ܳযڌѱܻೡѪੋо ↟۱ݽ؛3BUFMJNJUীѦܻѱغਸٸ ܳযڌѱܻೡѪੋо ↟ࢿמࠁࣘبա࠺ਊਃೠ҃ ܳযڌѱܻೡѪੋо
↟ࢎਊоਗೞחݽ؛ਸࢶఖೠ҃ ܳযڌѱܻೡѪੋо ↟ਗঋח࢚ടীࢲఠ݂Ѧܽ҃ ܳযڌѱܻೡѪੋо ↟j
Orchestration 3PVUF--.औѱ݈೧௪ܻܳۄఠীకਕೠݽ؛۽ࠁղחѐ֛
Orchestration 3PVUF--.ѐ֛ਊਸా೧ࣘب৬࠺ਊ୭ചоמ
Cost Operation
Cost Operation ݆ӝস--.࠺ਊҙܻীয۰ਸѻҊ
Cost Operation ܻӝসѾҴઁಿਸా೧ਮਸٜ݅যյࣻযঠೣ
Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ
Cost Operation ѾҴ--.যܻா࣌--.࠺ਊ୭ചীٮۄӝসਮীೱਸѱؽ
Cost Operation दҙীࢲஹನքױਤ࠺ਊ࠺ীೠхਸղച೧ঠೣ
Cost Operation xyz ࡺ݅ইפۄੌ߹۽যځೠন࢚ਸࠁח ౠহח١بҙஏ
Cost Operation Ѣदҙীࢲੌр࠺ਊࠛযڌѱഋࢿغחبزചా೧ҙஏ
Cost Operation ب۞ೠࣻחযڌѱࢸೞѱغחѦө
Cost Operation ೠݺࢎਊীѱ݃ܳߥযٜੌࣻח҅
Cost Operation ೠݺࢎਊীѱੌрदр࠙рಣӐ݃ܳైೡࣻח҅
Cost Operation ైоמࣻܳઁಿীਊ
Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆աয়Ҋ
Cost Operation ↟࠺ਊীয--.ীైоמೠࣻળীೠхਸפҊযঠೣ ↟ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١ਊ ↟ࣘਵ۽ઑղ࠺ਊхпਸ൧ࣻب۾ݽפఠ݂ दпചъച ↟--.ਸೞחઑࢿמ ࠺ਊ
ࣘبࣁਃੋী೧ࢻࣁೞѱӔ ↟ࣁਃੋबਵ۽ઑݾܳࢸೞҊ ୭ചܳਤೠز۱ਸٜ݅যঠೣ
Fine-tuning
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ 1&'5 1&'5
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH
Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM যܻா࣌ ߊ ӝ 1IBTF
1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧যܻா࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛ण߂ࢲࡂۖಬഝਊ (16۞झఠഛࠁ೧ ݽ؛ण߂ࢲࡂ୭ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSחױ҅ীਤ ֙ਘ
Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ'JOFUVOJOHਸ೧ঠ݅ೞחਬী೧ܳݏ୶যঠೣ
Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭ചܳܖযյࣻਸ ۽ં࣌ਃ
Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁڪযդஹನքٜܳ݅যյࣻਸ ࢿמૐݺਃ
Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻೡࣻח1SPQSJFUBSZؘఠоח झझ۽ঌҊਸѪ
Fine-tuning খҗਸաݶಽҊೞחޙઁীೠоࣻ
Fine-tuning ޙઁо࢚ࣁ ػ۽غঋਵݶण়ڨೞѱൗ۞тࣻ
Fine-tuning റणҗীࢲஏೡࣻחݫܼীೠоਃ
Fine-tuning ాੋݫܼਊয۵ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ
Fine-tuning ػޙઁ৬ݫܼ ӒܻҊపझؘఠࣇীೠ"4*4ஏ
Fine-tuning णػݽ؛ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ
We are hiring!
Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥