Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Avatar for Hoon Heo Hoon Heo
July 25, 2024
Technology
0
2.4k

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning
Avatar for Hoon Heo

Hoon Heo

July 25, 2024
Tweet

More Decks by Hoon Heo

See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
Avatar for Hoon Heo huffon
0
680
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
Avatar for Hoon Heo huffon
0
1.4k
​고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
Avatar for Hoon Heo huffon
3
1.9k
Autonomous Agent in Production
Avatar for Hoon Heo huffon
2
1.2k
Generative UX in LLM Application
Avatar for Hoon Heo huffon
1
1.1k

Other Decks in Technology

See All in Technology
5min GuardDuty Extended Threat Detection EKS
Avatar for takakuni takakuni
0
180
Glacierだからってコストあきらめてない？ / JAWS Meet Glacier Cost
Avatar for sasaki taishin
1
140
Tokyo_reInforce_2025_recap_iam_access_analyzer
Avatar for h-ashisan hiashisan
0
170
PO初心者が考えた ”POらしさ”
Avatar for (Ha)rady nb_rady
0
190
Tech-Verse 2025 Global CTO Session
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
1.6k
fukabori.fm 出張版: 売上高617億円と高稼働率を陰で支えた社内ツール開発のあれこれ話 / 20250704 Yoshimasa Iwase & Tomoo Morikawa
Avatar for SHIFT EVOLVE shift_evolve
PRO
2
6.1k
生成AI時代の開発組織・技術・プロセス 〜 ログラスの挑戦と考察 〜
Avatar for Hiroshi Ito itohiro73
1
410
OPENLOGI Company Profile
Avatar for OPENLOGI hr01
0
67k
Backlog ユーザー棚卸しRTA、多分これが一番早いと思います
Avatar for あれ __allllllllez__
1
130
無意味な開発生産性の議論から抜け出すための予兆検知とお金とAI
Avatar for Masato Ishigaki / 石垣雅人 i35_267
3
11k
高速なプロダクト開発を実現、創業期から掲げるエンタープライズアーキテクチャ
Avatar for かわうそ kawauso
2
7.6k
マネジメントって難しい、けどおもしろい / Management is tough, but fun! #em_findy
Avatar for ar_tama ar_tama
5
680

Featured

See All Featured
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
351
20k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
10
680
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
233
17k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
126
17k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
39
1.9k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
179
9.8k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
26k
The Language of Interfaces
Avatar for Des Traynor destraynor
158
25k
Making Projects Easy
Avatar for Brett Harned brettharned
116
6.3k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
231
18k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
36
2.8k
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
223
9.7k

Transcript

  1. ,BSUFS)FP!-JOFS What if…? ୊਺ࠗఠ ׮द LLM য೒ܻா੉࣌ਸ ѐߊೠ׮ݶ : ૑դ

    1֙ р੄ ߓ਑ ӒܻҊ ࢿࣼ೧оח ী੉੹౟ ѐߊ ࢤక҅

  2. ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH

  3. Orchestration

  4. Orchestration ݽ؛ࢶఖदੌ߈੸ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS

  5. Orchestration ഑਷ࢎਊ੗ীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ੓਺

  6. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  7. Orchestration .PEFM'BNJMZ߹۽׹߸ࢤࢿ۽૒ਸ߹ѐҳഅ೧઱যঠೣ

  8. Orchestration ੉ਬחݽفة੗੸ੋ4%,ܳഝਊೞҊ੓ӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,

  9. Orchestration ೞա੄4%,ীࢲࢲ۽׮ܲী۞ী؀ೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU

  10. Orchestration ী੉੹౟ѐߊਸҳਗ೧઴-JUF--.

  11. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  12. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  13. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  14. Orchestration ઑӘ؊਄बਸղࠄ׮ݶ3PVUF--.ѐ֛ө૑੸ਊ

  15. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  16. Orchestration 3PVUF--.਷औѱ݈೧௪ܻܳۄ਋ఠীకਕ੸׼ೠݽ؛۽ࠁղחѐ֛

  17. Orchestration 3PVUF--.ѐ֛੄੸ਊਸా೧ࣘب৬࠺ਊ୭੸ചоמ

  18. Cost Operation

  19. Cost Operation ݆਷ӝস੉--.࠺ਊҙܻীয۰਑ਸѻҊ੓਺

  20. Cost Operation ৔ܻӝস਷ѾҴઁಿਸా೧੉ਮਸٜ݅যյࣻ੓যঠೣ

  21. Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ

  22. Cost Operation ѾҴ--.য೒ܻா੉࣌਷--.࠺ਊ୭੸ചীٮۄӝস੉ਮী৔ೱਸ઱ѱؽ

  23. Cost Operation ޷द੸ҙ੼ীࢲஹನք౟ױਤ࠺ਊ࠺઺ী؀ೠхਸղ੤ച೧ঠೣ

  24. Cost Operation xyz ࡺ݅ইפۄੌ੗߹۽যځೠন࢚ਸࠁ੉ח૑ ౠ੉੼਷হ঻ח૑١بҙஏ

  25. Cost Operation Ѣद੸ҙ੼ীࢲੌр࠺ਊ૑ࠛ੉যڌѱഋࢿغח૑ب੗زചా೧ҙஏ

  26. Cost Operation ب؀୓੉۞ೠࣻ஖חযڌѱࢸ੿ೞѱغחѦө

  27. Cost Operation ೠݺ੄ࢎਊ੗ীѱ঴݃ܳߥযٜੌࣻ੓ח૑҅࢑

  28. Cost Operation ೠݺ੄ࢎਊ੗ীѱੌрदр࠙рಣӐ঴݃ܳై੗ೡࣻ੓ח૑҅࢑

  29. Cost Operation ੸੿ై੗оמࣻ஖ܳઁಿী੸ਊ

  30. Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆੉աয়Ҋ੓਺

  31. Cost Operation ↟࠺ਊী੓য--.ীై੗оמೠࣻળী؀ೠхਸ૑פҊ੓যঠೣ ↟੉ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١੸ਊ ↟૑ࣘ੸ਵ۽ઑ૒ղ࠺ਊхпਸ੊൧ࣻ੓ب۾ݽפఠ݂ दпചъച ↟--.ਸ׸׼ೞחઑ૒਷ࢿמ ࠺ਊ

    ࣘبࣁਃੋী؀೧ࢻࣁೞѱ੽Ӕ ↟ࣁਃੋ઺बਵ۽ઑ૒ݾ಴ܳࢸ੿ೞҊ ୭੸ചܳਤೠز۱ਸٜ݅যঠೣ

  32. Fine-tuning

  33. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 1&'5

  34. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ 1&'5 1&'5

  35. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH

  36. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSח੉ױ҅ীਤ஖ ֙ਘ

  37. Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ੹'JOFUVOJOHਸ೧ঠ݅ೞח੉ਬী؀೧೤੄ܳݏ୶যঠೣ

  38. Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭੸ചܳ੉ܖযյࣻ੓ਸ૑  ೐۽ં࣌೙ਃ

  39. Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁ׮ڪযդஹನք౟ٜܳ݅যյࣻ੓ਸ૑  ࢿמૐݺ೙ਃ

  40. Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻ૑ೡࣻ੓ח1SPQSJFUBSZؘ੉ఠо੓ח૑  झझ۽ঌҊ੓ਸѪ

  41. Fine-tuning খ੄җ੿ਸ૑աݶಽҊ੗ೞחޙઁী؀ೠ੿੄о೙ࣻ੸

  42. Fine-tuning ޙઁ੿੄о࢚ࣁ൤ ೤੄ػ଻۽غ૑ঋਵݶ೟ण੉়ڨೞѱൗ۞тࣻ੓਺

  43. Fine-tuning ੉റ೟णҗ੿ীࢲஏ੿ೡࣻ੓חݫ౟ܼী؀ೠ੿੄о೙ਃ

  44. Fine-tuning ੹ా੸ੋݫ౟ܼ੄੸ਊ੉য۵׮ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ੓਺

  45. Fine-tuning ੿੄ػޙઁ৬ݫ౟ܼ ӒܻҊపझ౟ؘ੉ఠࣇী؀ೠ"4*4ஏ੿

  46. Fine-tuning ೟णػݽ؛੄ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ੿

  47. We are hiring!

  48. Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥