Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KDDI DIGITAL GATEのLLM事例紹介
Search
sh-tsukamoto
November 06, 2023
Technology
3
660
KDDI DIGITAL GATEのLLM事例紹介
sh-tsukamoto
November 06, 2023
Tweet
Share
Other Decks in Technology
See All in Technology
TailwindCSSでUIライブラリを作る際のハマりどころ
shuta13
0
230
SWC Transformerから見るTypeScript関数記述ベストプラクティス
fujiyamaorange
1
180
データ基盤を支える技術
chanyou0311
5
3k
5分で分かる(かもしれない) Vector engine for OpenSearch Serverless
tsukuboshi
1
410
能動学習のいろは:書籍「Human-in-the-Loop機械学習」3〜5章
hiroyoshiito
0
290
From here to resilience - a travel guide
ufried
1
160
【TSkaigi】2024/05/11 当日スライド
kimitashoichi
14
4k
「できる!」を増やすGitHub Copilot活用法 / How to use GitHub Copilot to expand your possibilities
sansan_randd
1
240
OPENLOGI Company Profile for engineer
hr01
1
2.2k
「知的単純作業」を自動化する、地に足の着いた大規模言語モデル (LLM) の活用
nrryuya
8
8.3k
本当のガバクラ基礎
toru_kubota
0
320
テストコードを書きながらCompose Multiplatformを乗りこなす
subroh0508
0
140
Featured
See All Featured
Mobile First: as difficult as doing things right
swwweet
217
8.6k
Happy Clients
brianwarren
92
6.4k
Large-scale JavaScript Application Architecture
addyosmani
504
110k
Ruby is Unlike a Banana
tanoku
96
10k
Build your cross-platform service in a week with App Engine
jlugia
226
17k
It's Worth the Effort
3n
180
27k
Making Projects Easy
brettharned
109
5.5k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
23
1.7k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
352
28k
Git: the NoSQL Database
bkeepers
PRO
423
63k
Teambox: Starting and Learning
jrom
128
8.4k
Designing for Performance
lara
601
67k
Transcript
KDDI DIGITAL GATEͷ LLMࣄྫհ 2023/11/02 KDDIגࣜձࣾ ௩ຊ Ұ࿕
ࣗݾհ ௩ຊ Ұ࿕ KDDIגࣜձࣾ KDDI DIGITAL GATEॴଐ ιϑτΣΞΤϯδχΞ • ීஈWEB/ϞόΠϧΞϓϦ։ൃ͕த৺
• ࠷ۙLLMΛ׆༻ͨ͠։ൃଟ͍ͬͯ͘·͢ • ̍ϲ݄લɺAmazon Bedrockͷਖ਼ࣜϦϦʔεͱ΄΅ ಉ࣌͡ظʹ່͕ੜ͠·ͨ͠
KDDI DIGITAL GATEʹ͍ͭͯ σβΠϯࢥߟδϣϒཧΛ༻͍ͨαʔϏεσβΠϯ ΞδϟΠϧ։ൃʹΑΔϓϩμΫτ։ൃɾݕূ Λ௨ͯ͠๏ਓސ٬ͷDXࣄۀ্ཱͪ͛Λαϙʔτ͢Δ৫ ࠷ۙҎԼͷΑ͏ͳ׆ಈʹྗ • ੜAIΛ׆༻ͨ͠ϓϩμΫτ։ൃ •
ࣾ֎ͰͷੜAIษڧձ։࠵
DXਪਐΛ͞Ε͚ͨͲαʔϏεσβΠϯͬͯԿΛ͢Ε͍͍ͷʁͱ͍͏୲ऀ͕ αʔϏεσβΠϯख๏ΛήʔϜײ֮ͰֶΔ Amazon Bedrock࣮ΞϓϦ ʮϏδωεΛͭ͘Ζ͏ʂʯ ུͯ͠ʮϏδͭ͘ʂʯ ※Amazon Bedrock: AWS͕ఏڙ͢ΔੜܥAIαʔϏε
ઌAWSͷهऀձݟͰগ͚ͩ͠հ͞Ε·ͨ͠
Amazon Bedrock࣮ΞϓϦʮϏδͭ͘ʂʯ ࠷ॳʹاըςʔϚΛೖྗ͢Δ͚ͩͰ
Amazon Bedrock࣮ΞϓϦʮϏδͭ͘ʂʯ པ͍͠ϝϯόʔ(LLM)͕δϣϒཧʹ͓͚ΔδϣϒϏδωεΞΠσΞΛෳఏࣔͯ͘͠ΕΔ
Amazon Bedrock࣮ΞϓϦʮϏδͭ͘ʂʯ ఏࣔ͞ΕͨδϣϒϏδωεΞΠσΞΛબͯ͠ਐΊ͍ͯ͘ͱ
Amazon Bedrock࣮ΞϓϦʮϏδͭ͘ʂʯ ࠷ऴతʹΩϟονίϐʔ·Ͱੜͯ͘͠ΕͯɺاըҊͱͯ͠ར༻Մೳ
γεςϜΞʔΩςΫνϟ ϑϩϯτ όοΫΤϯυ AWSͰ݁ʂ Ϟσϧ Anthoropicࣾͷ Claude 2Λར༻
ϓϩϯϓταϯϓϧ """Human: ҎԼͷςʔϚʹ͍ͭͯɺδϣϒཧʹج͍ͮͯδϣϒͷྫΛ4ͭ࡞͠·͢ɻ࡞͢Δδϣϒҙ֎ੑͷ͋ΔྫΛؚΊɺ੍݅ʹ ैͬͯग़ྗ͠·͢ɻ ### ςʔϚ {theme} ### ϑΥʔϚοτ {format_instructions}
### ੍݅ ϑΥʔϚοτʹै͍ɺϑΥʔϚοτ෦ͷΈग़ྗɻ Assistant:"""
Bedrock(Claude 2)ͷྑ͍ͱ͜Ζ • ίετɺճ࣭ͱʹGPT3.5ͱGPT4ͷؒ͘Β͍ ➢ 3.5ͩͱճ࣭͕ෆ͚҆ͩͲɺ4ͩͱίετ͕ߴ͗͢Δͱ͍͏ʹधཁ͕͋Γͦ ͏ • ࠷େτʔΫϯ͕10ສτʔΫϯ ➢
ChatGPT࠷େ3.2ສτʔΫϯ • ଟ͘ͷΤϯδχΞ͕͍׳ΕͨAWSڥͰ݁ͯ͠ϓϩμΫτ։ൃ͕Ͱ͖Δ • LLMܥͷ։ൃͰศརͳLangChainͱΈ߹Θͤͯར༻Մೳ
Bedrock(Claude 2)Λͬͯۤ࿑ͨ͠ • ChatGPTʹ͓͚ΔFunction Callingػೳ͕ݱ࣌Ͱͳ͍ ➢ ΞϓϦʹΈࠐΉࡍLangchainͷύʔαʔͰJSONܗࣜͰฦ٫͞ΕΔΑ͏ʹͨ͠ ➢ Function Callingʹ૬͢Δػೳ͕͋Ε։ൃ͕ͬͱָʹͳΓͦ͏
• Bedrock APIͷԠ͕ฦͬͯ͘Δ·Ͱʹ͕͔͔࣌ؒΔ͜ͱ͕͋Δ ➢ APIͷԠʹ10ඵఔ͔͔Δ ➢ ݁Ռදࣔ͢Δલͷը໘ͰࣄલʹAPIΛόοΫάϥϯυ࣮ߦ͠ɺϢʔβମײͰ API࣮ߦͷ͕ͪ࣌ؒݮΔΑ͏ʹ ➢ Claude 2౦ژϦʔδϣϯͰ͑ΔΑ͏ʹͳΕԠ͕࣌ؒ͘ͳΔ͔ʁ ※ݱ࣌(11/2)Ͱ౦ژϦʔδϣϯະରԠ
Bedrock(Claude 2)Λͬͯۤ࿑ͨ͠ • ChatGPTʹ͓͚ΔFunction Callingػೳ͕ݱ࣌Ͱͳ͍ ➢ ΞϓϦʹΈࠐΉࡍLangchainͷύʔαʔͰJSONܗࣜͰฦ٫͞ΕΔΑ͏ʹͨ͠ ➢ Function Callingʹ૬͢Δػೳ͕͋Ε։ൃ͕ͬͱָʹͳΓͦ͏
• Bedrock APIͷԠ͕ฦͬͯ͘Δ·Ͱʹ͕͔͔࣌ؒΔ͜ͱ͕͋Δ ➢ APIͷԠʹ10ඵఔ͔͔Δ ➢ ݁Ռදࣔ͢Δલͷը໘ͰࣄલʹAPIΛόοΫάϥϯυ࣮ߦ͠ɺϢʔβମײͰ API࣮ߦͷ͕ͪ࣌ؒݮΔΑ͏ʹ ➢ Claude 2౦ژϦʔδϣϯͰ͑ΔΑ͏ʹͳΕԠ͕࣌ؒ͘ͳΔ͔ʁ ※ݱ࣌(11/2)Ͱ౦ژϦʔδϣϯະରԠ ͜ͷลΓ͜Ε͔ΒͲΜͲΜྑ͘ͳ͍ͬͯͣ͘ɻظ͍ͯ͠·͢ʂ
ͦͷଞ։ൃͨ͠ϓϩμΫτΛܰ͘հ
اۀͷ࠷৽ͷۀαϚϦʔΛڭ͑ͯ͘ΕΔʮEyeRʯ ࣾͷӦۀ୲͕ར༻͢Δ͜ͱΛఆ ηΩϡϦςΟʢใ࿙͍͑ʣରࡦ ↳ձ໊ࣾͷೖྗ͚ͩͰ༨ܭͳใΛೖྗͤ͞ͳ͍ GPTͷΧοτΦϑσʔλͷରࡦ ʢGPT3.520219݄·Ͱͷσʔλ͕جͱͳ͍ͬͯΔʣ ↳Bingʹͯ࠷৽HPใΛऔಘ͠αϚϦʔ͢Δ ใͷ͔֬Β͠͞ͷূ໌ ↳αϚϦʔͷجͱͳΔϖʔδͷURLΛදࣔ͢Δ
EyeRγεςϜߏਤ
؆୯ͳ࣭ʹ͑Δ͚ͩͰ໊͋ͩΛ͚ͭͯ͘ΕΔʮNick genieʯ ChatGPTྲྀߦΓͨͯͷࠒʹ3͘Β͍Ͱ࡞ͬͨษڧ༻ϓϩμΫτ