Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Avatar for Hoon Heo Hoon Heo
July 25, 2024
Technology
0
2.4k

What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면

Liner LLM 어플리케이션 개발 배움: Orchestration, Cost Operation, Fine-tuning
Avatar for Hoon Heo

Hoon Heo

July 25, 2024
Tweet

More Decks by Hoon Heo

See All by Hoon Heo
LLM 시대의 Compliance: Safety & Security
Avatar for Hoon Heo huffon
0
660
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
Avatar for Hoon Heo huffon
0
1.3k
​고군분투 LLM 프로덕트 적용기: Blind Prompting 부터 Agent까지
Avatar for Hoon Heo huffon
3
1.9k
Autonomous Agent in Production
Avatar for Hoon Heo huffon
2
1.2k
Generative UX in LLM Application
Avatar for Hoon Heo huffon
1
1.1k

Other Decks in Technology

See All in Technology
LT:組込み屋さんのオシロが壊れた！
Avatar for windy windy_pon
0
350
Bill One 開発エンジニア 紹介資料
Avatar for Sansan, Inc. sansan33
PRO
4
12k
超簡単！RAGアプリケーション構築術
Avatar for oracle4engineer oracle4engineer
PRO
0
120
令和最新版TypeScriptでのnpmパッケージ開発
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
110
Machine Intelligence for Vision, Language, and Actions
Avatar for Semantic Machine Intelligence Lab., Keio Univ. keio_smilab
PRO
0
490
CloudBruteによる外部からのS3バケットの探索・公開の発見について / 20250605 Kumiko Hennmi
Avatar for SHIFT EVOLVE shift_evolve
3
110
データプレーンプログラミングとは？ DPU＆スイッチASICの開発経験から語る
Avatar for ebiken ebiken
PRO
1
260
コードの考古学 〜労務システムから発掘した成長の糧〜
Avatar for Kenta SEKINE kenta_smarthr
1
1.1k
GitHub Coding Agent 概要
Avatar for KAMEGAWA Kazushi kkamegawa
1
1.6k
プロジェクトマネジメント実践論｜現役エンジニアが語る！～チームでモノづくりをする時のコツとは？～
Avatar for MIXI ENGINEERS mixi_engineers
PRO
3
180
Node−RED で Ollama を使ったローカルLLM（node-red-contrib-ollamaを利用） / ビジュアルプログラミングIoTLT vol.20
Avatar for you（@youtoy） you
PRO
0
140
Introduction to Bill One Development Engineer
Avatar for Sansan, Inc. sansan33
PRO
0
240

Featured

See All Featured
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
35
6.7k
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
276
23k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
106
19k
Building Applications with DynamoDB
Avatar for Matt Wood mza
95
6.4k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
267
13k
Embracing the Ebb and Flow
Avatar for Simon Collison colly
85
4.7k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
30
2.4k
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
16k
The Language of Interfaces
Avatar for Des Traynor destraynor
158
25k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
346
40k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
233
140k

Transcript

  1. ,BSUFS)FP!-JOFS What if…? ୊਺ࠗఠ ׮द LLM য೒ܻா੉࣌ਸ ѐߊೠ׮ݶ : ૑դ

    1֙ р੄ ߓ਑ ӒܻҊ ࢿࣼ೧оח ী੉੹౟ ѐߊ ࢤక҅

  2. ݾର 0SDIFTUSBUJPO $PTU0QFSBUJPO 'JOFUVOJOH

  3. Orchestration

  4. Orchestration ݽ؛ࢶఖदੌ߈੸ੋҊ۰ࢎ೦ ↟$POUFYU-FOHUI ↟1FSGPSNBODF ↟-BUFODZ ↟$PTU ↟3BUFMJNJU ↟4BGFUZ'JMUFS

  5. Orchestration ഑਷ࢎਊ੗ীѱݽ؛ࢶఖӂਸઁҕ೧ঠೡࣻ੓਺

  6. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  7. Orchestration .PEFM'BNJMZ߹۽׹߸ࢤࢿ۽૒ਸ߹ѐҳഅ೧઱যঠೣ

  8. Orchestration ੉ਬחݽفة੗੸ੋ4%,ܳഝਊೞҊ੓ӝٸޙ 0QFO"*4%, (PPHMF(FNJOJ4%,

  9. Orchestration ೞա੄4%,ীࢲࢲ۽׮ܲী۞ী؀ೠ'BMMCBDLਸೠٲೠٲҳഅ೧ঠೣ $POUFYU-FOHUI 4BGFUZ 3BUF-JNJU

  10. Orchestration ী੉੹౟ѐߊਸҳਗ೧઴-JUF--.

  11. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  12. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  13. Orchestration ాੌػੋఠಕ੉झ۽ࢲ۽׮ܲݽ؛ഝਊҗ'BMMCBDL؀਽੉оמ

  14. Orchestration ઑӘ؊਄बਸղࠄ׮ݶ3PVUF--.ѐ֛ө૑੸ਊ

  15. Orchestration ׮নೞѱߊࢤೡࣻ੓ח࠙ӝ߂'BMMCBDL۽૒ ↟૑ա஖ѱӟਃ୒੉ٜয৳ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟઱۱ݽ؛੉3BUFMJNJUীѦܻѱغ঻ਸٸ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ࢿמࠁ׮ࣘبա࠺ਊ੉઺ਃೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо

     ↟ࢎਊ੗оਗೞחݽ؛ਸ૒੽ࢶఖೠ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟ਗ஖ঋח࢚ടীࢲ೙ఠ݂੉Ѧܽ҃਋ ੉ܳযڌѱ୊ܻೡѪੋо  ↟j

  16. Orchestration 3PVUF--.਷औѱ݈೧௪ܻܳۄ਋ఠীకਕ੸׼ೠݽ؛۽ࠁղחѐ֛

  17. Orchestration 3PVUF--.ѐ֛੄੸ਊਸా೧ࣘب৬࠺ਊ୭੸ചоמ

  18. Cost Operation

  19. Cost Operation ݆਷ӝস੉--.࠺ਊҙܻীয۰਑ਸѻҊ੓਺

  20. Cost Operation ৔ܻӝস਷ѾҴઁಿਸా೧੉ਮਸٜ݅যյࣻ੓যঠೣ

  21. Cost Operation ࠺ऴоѺഋࢿਵ۽߸ز࠺ࢿѺীоӰѱ࠙ܨغח--.࠺ਊ

  22. Cost Operation ѾҴ--.য೒ܻா੉࣌਷--.࠺ਊ୭੸ചীٮۄӝস੉ਮী৔ೱਸ઱ѱؽ

  23. Cost Operation ޷द੸ҙ੼ীࢲஹನք౟ױਤ࠺ਊ࠺઺ী؀ೠхਸղ੤ച೧ঠೣ

  24. Cost Operation xyz ࡺ݅ইפۄੌ੗߹۽যځೠন࢚ਸࠁ੉ח૑ ౠ੉੼਷হ঻ח૑١بҙஏ

  25. Cost Operation Ѣद੸ҙ੼ীࢲੌр࠺ਊ૑ࠛ੉যڌѱഋࢿغח૑ب੗زചా೧ҙஏ

  26. Cost Operation ب؀୓੉۞ೠࣻ஖חযڌѱࢸ੿ೞѱغחѦө

  27. Cost Operation ೠݺ੄ࢎਊ੗ীѱ঴݃ܳߥযٜੌࣻ੓ח૑҅࢑

  28. Cost Operation ೠݺ੄ࢎਊ੗ীѱੌрदр࠙рಣӐ঴݃ܳై੗ೡࣻ੓ח૑҅࢑

  29. Cost Operation ੸੿ై੗оמࣻ஖ܳઁಿী੸ਊ

  30. Cost Operation ୭Ӕ--.оѺ࠺Үبҳب݆੉աয়Ҋ੓਺

  31. Cost Operation ↟࠺ਊী੓য--.ীై੗оמೠࣻળী؀ೠхਸ૑פҊ੓যঠೣ ↟੉ীӝ߈ೞৈ#VEHFUJOH 3PVUJOH 5ISFTIPME١੸ਊ ↟૑ࣘ੸ਵ۽ઑ૒ղ࠺ਊхпਸ੊൧ࣻ੓ب۾ݽפఠ݂ दпചъച ↟--.ਸ׸׼ೞחઑ૒਷ࢿמ ࠺ਊ

    ࣘبࣁਃੋী؀೧ࢻࣁೞѱ੽Ӕ ↟ࣁਃੋ઺बਵ۽ઑ૒ݾ಴ܳࢸ੿ೞҊ ୭੸ചܳਤೠز۱ਸٜ݅যঠೣ

  32. Fine-tuning

  33. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 1&'5

  34. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ 1&'5 1&'5

  35. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH

  36. Fine-tuning: ࣁ ױ҅۽ ա־য ࠁח LLM য೒ܻா੉࣌ ߊ੹ ઱ӝ 1IBTF

    1IBTF 1IBTF 0QFO"* "OUISPQJD (FNJOJ١ 1SPWJEFSഝਊ೧য೒ܻா੉࣌ҳഅ 'JSFXPSLT"* 5PHFUIFS"*١ ݽ؛೟ण߂ࢲࡂ೒ۖಬഝਊ (16௿۞झఠഛࠁ೧ ૒੽ݽ؛೟ण߂ࢲࡂ୭੸ച 1&'5 1&'5 1&'5 'VMMQBSBNFUFSUVOJOH 1PTUUSBJOJOH -JOFSח੉ױ҅ীਤ஖ ֙ਘ

  37. Fine-tuning 'JOFUVOJOHਵ۽ֈযоӝ੹'JOFUVOJOHਸ೧ঠ݅ೞח੉ਬী؀೧೤੄ܳݏ୶যঠೣ

  38. Fine-tuning 'JOFUVOJOHਸా೧--.࠺ਊ୭੸ചܳ੉ܖযյࣻ੓ਸ૑  ೐۽ં࣌೙ਃ

  39. Fine-tuning 'JOFUVOJOHਸా೧ఋࢎࠁ׮ڪযդஹನք౟ٜܳ݅যյࣻ੓ਸ૑  ࢿמૐݺ೙ਃ

  40. Fine-tuning 'JOFUVOJOHਸా೧ۨߡܻ૑ೡࣻ੓ח1SPQSJFUBSZؘ੉ఠо੓ח૑  झझ۽ঌҊ੓ਸѪ

  41. Fine-tuning খ੄җ੿ਸ૑աݶಽҊ੗ೞחޙઁী؀ೠ੿੄о೙ࣻ੸

  42. Fine-tuning ޙઁ੿੄о࢚ࣁ൤ ೤੄ػ଻۽غ૑ঋਵݶ೟ण੉়ڨೞѱൗ۞тࣻ੓਺

  43. Fine-tuning ੉റ೟णҗ੿ীࢲஏ੿ೡࣻ੓חݫ౟ܼী؀ೠ੿੄о೙ਃ

  44. Fine-tuning ੹ా੸ੋݫ౟ܼ੄੸ਊ੉য۵׮ݶ--.BTB+VEHFܳഝਊ೧ࠅࣻ੓਺

  45. Fine-tuning ੿੄ػޙઁ৬ݫ౟ܼ ӒܻҊపझ౟ؘ੉ఠࣇী؀ೠ"4*4ஏ੿

  46. Fine-tuning ೟णػݽ؛੄ࢿמҗ"4*4࠺Үೞݴࢿמ ࠺ਊ ࣘبୋب۽ߓನѾ੿

  47. We are hiring!

  48. Thank you 5IBOLTUP5ZMFS ,BOF ,BJ +VTUJO♥