DevinはクラウドエンジニアAIになれるのか!? 実践的なガードレール設計/devin-can-become-a-cloud-engineer-ai-practical-guardrail-design

AI駆動開発勉強会 臨時回【Devin Meetup Japan #1】での登壇資料です。
https://aid.connpass.com/event/347052/

Transcript

1. 2025/03/26 ੡଄ϏδωεςΫϊϩδʔ෦ ࠤ౻ஐथ Devin͸Ϋϥ΢υΤϯδχΞAIʹͳΕΔͷ͔!? ࣮ફతͳΨʔυϨʔϧઃܭ
2. 2 ࣗݾ঺հ • 2020೥ Ϋϥεϝιουגࣜձࣾ ೖࣾ • 2022೥ AWS Community Builder(DevTools) ೝఆ • 2023೥ Japan AWS Top Engineer ೝఆ • 2024೥ Japan AWS Top Engineer ೝఆ • 2024೥ Japan AWS All Certifications Engineers ೝఆ • ෦ॺ ◦ ੡଄ϏδωεςΫϊϩδʔ෦ • ໊લʢχοΫωʔϜʣ ◦ ࠤ౻ஐथ ʢtmk2154/tomoki10ʣ
3. ݽಠʹDevinهࣄΛॻ͖ଓ͚͍ͯΔਓʢ࠷ۙଞͷࣾһ΋૿͑ͨʂʣ ࣗݾ঺հ 3 https://dev.classmethod.jp/tags/devin/
4. ໨࣍ 4 • Devinͱ͸Կ͔ɺͳͥDevinΛ࢖͏ͷ͔ • Devinͷߏ੒ཁૉͷղઆ • Ϋϥ΢υΤϯδχΞAIͷՄೳੑ • Ϋϥ΢υ؀ڥΛAIʹར༻ͤ͞Δࡍͷ՝୊ • ࣮ફతͳΨʔυϨʔϧઃܭ
5. ୺తʹݴ͏ͱੜ੒AIٕज़ΛԠ༻ͨࣗ͠཯ܕAIιϑτ΢ΣΞΤϯδχΞ SlackͳͲ͔ΒࣗવݴޠͰࢦࣔ͢Δ͚ͩͰɺίʔυͷ࣮૷ܭըɺ࣮૷ σόοάɺςετɺϒϥ΢βૢ࡞ͳͲΛࣗಈతʹߦͳͬͯ͘ΕΔ Devinͱ͸Կ͔ʁ 5
6. ͳͥDevinΛ࢖͏ͷ͔ 6 VSCode ͍··ͰɿAIΤʔδΣϯτͱڠௐ͠γϯάϧλεΫͰ࡞ۀΛ࣮ߦ AλεΫ BλεΫ CλεΫ ਓؒ with AI ͜Ε͔Βɿෳ਺ͷAIΤʔδΣϯτͱڠௐ͠ϚϧνλεΫͰ࡞ۀΛ࣮ߦ VSCode VSCode VSCode AλεΫ BλεΫ CλεΫ DλεΫ EλεΫ ਓؒ ਓؒ ਓؒ with AI ਓؒ with AI ਓؒ ਓؒ with AI ਓؒ with AI ਓؒ with AI ਓؒ ࢦࣔ AI AI ։ൃͷελΠϧ͕มΘͬͯ͘Δʂ
7. Devinͷߏ੒ཁૉͷղઆ
8. Devinͷߏ଄ͷެࣜਤ 8 https://docs.devin.ai/enterprise/deployment/overview
9. Devinͷ࢓૊ΈʢTeam Planʣ 9 Devin Brain VSCode KVM Frontend Devin UI User Backend Browser Slack & Slack App GitHub & GitHub App Internet Slack͔Devin UIͰࢦࣔ͢ΔͱSession͕࡞੒͞ΕKVM্ཱ͕͕ͪΔ KVM͔ΒGitHubͳͲSaaS΍ΠϯλʔωοτɺVPNܦ༝※Ͱࣾ಺VPCͳͲ΁઀ଓՄೳ VPC VPN ※https://docs.devin.ai/onboard-devin/vpn
10. ॳճͷࢦࣔͰSession͕࡞੒͞Εɺͦͷ෼KVM͕ฒྻͰ্ཱ͕ͪΔ Sessionಉ࢜͸௚઀৘ใͷڞ༗͕Ͱ͖ͳ͍ DevinͷSessionͷΠϝʔδ 10 Frontend Devin UI User Devin Brain KVM Backend Slack & Slack App Devin Brain KVM Devin Brain KVM
11. KVM୯ҐͰ෼཭͸͞Ε͍ͯΔ͕NWͷΠϯό΢ϯυ/Ξ΢τό΢ϯυͷ ੍ޚ͕Ͱ͖ͳ͍ͷͰࣾ಺نఆʹΑͬͯ͸஫ҙ͕ඞཁ DevinͷSessionͷΠϝʔδʢTeam Planʣ 11 Frontend Devin UI User Backend Slack & Slack App Devin Brain KVM Internet
12. DevinͷEnterprise PlanͷΠϝʔδ 12 https://docs.devin.ai/enterprise/deployment/overview EnterpriseͳΒࣗࣾͷAWSͷVPC/AzureͷVNET্ʹҰ෦ϗεςΟϯάՄೳ VNET VPC
13. Ϋϥ΢υΤϯδχΞAIͷՄೳੑ
14. Ϋϥ΢υΤϯδχΞͷఆٛ 14 ຊࢿྉͰ͸Ϋϥ΢υΤϯδχΞΛҎԼͱఆٛͱ͠·͢ • Ϋϥ΢υαʔϏεϓϩόΠμʔͷαʔϏεΛར༻͠ɺΫϥ΢υ্ͰΠϯϑ ϥ΍ΞϓϦͷઃܭͱߏஙͰ͖Δ • Infrastructure as Code(IaC)πʔϧΛ׆༻͠ɺΠϯϑϥͷσϓϩΠ΍ςετ αΠΫϧΛࣗಈԽ/ޮ཰ԽͰ͖Δ • ߏங͢Δ؀ڥͷηΩϡϦςΟରԠ/ίετ࠷దԽ/ύϑΥʔϚϯε؅ཧ/τϥ ϒϧγϡʔςΟϯάͳͲͷ࣮ߦͰ͖Δ
15. Ϋϥ΢υΤϯδχΞͷఆٛ 15 ຊࢿྉͰ͸Ϋϥ΢υΤϯδχΞΛҎԼͱఆٛͱ͠·͢ • Ϋϥ΢υαʔϏεϓϩόΠμʔͷαʔϏεΛར༻͠ɺΫϥ΢υ্ͰΠϯϑ ϥ΍ΞϓϦͷઃܭͱߏஙͰ͖Δ • Infrastructure as Code(IaC)πʔϧΛ׆༻͠ɺΠϯϑϥͷσϓϩΠ΍ςετ αΠΫϧΛࣗಈԽ/ޮ཰ԽͰ͖Δ • ߏங͢Δ؀ڥͷηΩϡϦςΟରԠ/ίετ࠷దԽ/ύϑΥʔϚϯε؅ཧ/τϥ ϒϧγϡʔςΟϯάͳͲͷ࣮ߦͰ͖Δ
16. Ϋϥ΢υΤϯδχΞAIͷՄೳੑ 16 Devin Brain VSCode KVM Backend Browser GitHub & GitHub App ਓؒͱDevin͕Ϋϥ΢υͷૢ࡞͢Δࡍͷڞ௨ݴޠΛIaCͱ͢Δ DevinʹIaCͰΫϥ΢υૢ࡞Λґཔ͠PRΛਓ͕ؒϨϏϡʔ͢Ε͹Մೳ!? AWS CDK AccessKey SecretKey Devin Secrets Devin UI Slack & Slack App
17. Ϋϥ΢υΤϯδχΞAIͷՄೳੑ̎ 17 Devin Brain VSCode KVM Backend GitHub & GitHub App ͞Βʹൃలͯ͠Devinࣗମ͕CI/IntegTestͳͲΛ࣮ߦͰ͖Ε͹಺෦/֎෦ͷ ϑΟʔυόοΫαΠΫϧΛࣗΒճͯ͠ख์͠Ͱ࡞ۀґཔՄೳ!? PRͰCI࣮ߦ ਖ਼ৗ&Τϥʔ Linter ࣮૷ ϑΟʔυόοΫ Type System Compiler Unit Test Coverage IntegTest ࣮ߦ ਖ਼ৗ&Τϥʔ AccessKey SecretKey Devin Secrets
18. DevinͷϕετϓϥΫςΟεΑΓൈਮʢ೔ຊޠ༁ʣ 18 🔍؆୯ʹݕূͰ͖ΔλεΫʹूத͠·͠ΐ͏
 ཧ૝తʹ͸ɺCI͕௨ա͢Δ͜ͱΛ֬ೝͨ͠ΓɺࣗಈσϓϩΠΛςετͨ͠Γ͢Δ͘Β͍؆୯ͳ ΋ͷ͕ྑ͍Ͱ͠ΐ͏ɻλεΫ͕ద੾ʹ׬ྃͨ͠Α͏ʹݟ͑Δ͕࣮ࡍ͸ผͷ͜ͱ͕ى͖͍ͯΔΑ ͏ͳɺᐆດͳλεΫ͸ආ͚͍ͯͩ͘͞ 🌱খ࢝͘͞Ί·͠ΐ͏
 ࢝ΊΔʹ͋ͨͬͯɺDevinͷ࠷దͳ࢖༻ྫΛݟ͚ͭΔͨΊʹɺଟ͘ͷখ͞ͳ࣮ߦΛ։࢝ͯͩ͘͠ ͍͞ɻҰ౓ͷ࣮ߦʹଟ͘ͷʢ10Ҏ্ͷʣACUΛඅ΍͞ͳ͍Α͏ʹ͠·͠ΐ͏ɻDevinͷύϑΥʔ Ϛϯε͸௕͍ηογϣϯͰ௿Լ͠·͢ https://docs.devin.ai/essential-guidelines/when-to-use-devin
19. λεΫΛۃখʹϒϨʔΫμ΢ϯ͍ͯ͘͠ 19 Infrastructure as Code(IaC)πʔϧΛ׆༻͠ɺΠϯϑϥͷσϓϩΠ΍ςετ αΠΫϧΛࣗಈԽ/ޮ཰ԽͰ͖Δ IaCͰΠϯϑϥߏங͕Ͱ͖Δ IaCͰߏங͢ΔΠϯϑϥͷηΩϡϦςΟରࡦ͕Ͱ͖Δ IaCʹηΩϡϦςΟπʔϧΛಋೖͰ͖Δ IaCͷηΩϡϦςΟπʔϧͷग़ྗͨ݁͠ՌʹશͯʹରԠͰ͖Δ ग़ྗͨ݁͠Ռͷ1ͭΛվળ͢ΔͨΊͷPR͕ग़ͤΔ
20. IaCͷηΩϡϦςΟπʔϧͰग़ͨ݁ՌͷվળλεΫ 20 CDKͷηΩϡϦςΟπʔϧͰ͋Δcdk-nagͷಋೖͱରԠΛґཔ φϨοδͳ͠Ͱࢦࣔ௨Γίʔυʢ5ߦఔ౓ʣΛ࡞੒
21. Ϋϥ΢υ؀ڥΛAIʹར༻ͤ͞Δࡍͷ՝୊
22. ݒ೦఺ʢηΩϡϦςΟ໘ʣ 22 Devin Brain VSCode KVM Frontend Devin UI User Backend Browser Slack & Slack App NWͷΞ΢τό΢ϯυ੍͕ݶ͞Ε͍ͯͳ͍ͷͰɺొ࿥ͨ͠γʔΫϨοτΛ Devin͕ޡͬͯΠϯλʔωοτ্ʹެ։ͯ͠͠·͏ݒ೦ AccessKey SecretKey Internet AccessKey SecretKey Devin Secrets
23. ݒ೦ͷݩ 23 Devin͕One-Time Password(OTP)ͷೝূΛಥഁ͢ΔͨΊʹࣗൃతʹOTP
 ੜ੒αΠτʹ͍͔ͭ͘ͷ஋Λૹ৴ʢSecretsʹొ࿥͞Εͨ৘ใͷૹ৴͸ͳ͠ʣ https://totp.danhersam.com/ ஫ҙ Cognitionࣾ΁ͷ໰͍߹ΘͤͰ֎෦WebαΠτ΁ Secretsͷσʔλసૹ͕ͳ͍͜ͱ͸֬ೝ ࣮ࡍͷฦ౴ɿ Those secrets are securely stored in your Devin org and you have complete control over them. They cannot be sent to any website.
24. DevinͷEnterprise PlanͷΠϝʔδʢ࠶ܝʣ 24 https://docs.devin.ai/enterprise/deployment/overview EnterpriseͳΒࣗࣾͷAWSͷVPC/AzureͷVNET্ʹҰ෦ϗεςΟϯάՄೳ VNET VPC
25. ࣮ફతͳΨʔυϨʔϧઃܭ
26. ΤϯδχΞAIͷΨʔυϨʔϧϨϕϧ 26 WebΞΫηεڐՄϨϕϧ • Level1ɿΞΫηεෆՄ • Level2ɿಛఆαΠτͷΈಡΈऔΓ • Level3ɿಛఆαΠτͷΈಡΈऔΓ/ॻ͖ࠐΈ • Level4ɿແ੍ݶΞΫηε ϑΝΠϧΞΫηεڐՄϨϕϧ • Level1ɿίϯςφ಺෦ͷΈ • Level2ɿಛఆͷϑΝΠϧಡΈऔΓ • Level3ɿಛఆͷϑΝΠϧಡΈऔΓ/ॻ͖ࠐΈ • Level4ɿແ੍ݶΞΫηε ΤϯδχΞAI͕΋ͭڐՄͷൣғΛཧղ͠ΨʔυϨʔϧͷઃఆ͢Δ͜ͱ͕ॏཁ
27. ΤϯδχΞAIͷΨʔυϨʔϧϨϕϧ 27 WebΞΫηεڐՄϨϕϧ • Level1ɿΞΫηεෆՄ • Level2ɿಛఆαΠτͷΈಡΈऔΓ • Level3ɿಛఆαΠτͷΈಡΈऔΓ/ॻ͖ࠐΈ • Level4ɿແ੍ݶΞΫηε ϑΝΠϧΞΫηεڐՄϨϕϧ • Level1ɿίϯςφ಺෦ͷΈ • Level2ɿಛఆͷϑΝΠϧಡΈऔΓ • Level3ɿಛఆͷϑΝΠϧಡΈऔΓ/ॻ͖ࠐΈ • Level4ɿແ੍ݶΞΫηε ΤϯδχΞAI͕΋ͭڐՄͷൣғΛཧղ͠ΨʔυϨʔϧͷઃఆ͢Δ͜ͱ͕ॏཁ Devin(Team Plan)͸WebΞΫηε͕ແ੍ݶͳͷͰ೦ͷҝผͷ੍ݶΛೖΕΔ
28. Ϋϥ΢υΤϯδχΞAIͷΨʔυϨʔϧϨϕϧ 28 IAMͷαʔϏε୯ҐͰͷڐՄϨϕϧ • Level1ɿΫϥ΢υΞΫηεෆՄ • Level2ɿಛఆͷAWSαʔϏεͷΈΞΫηεΛڐՄʢϗϫΠτϦετʣ • Level3ɿAdminݖݶ෇༩ɺಛఆͷAWSαʔϏεͷΈΞΫηεΛෆڐՄʢϒϥοΫϦετʣ • Level4ɿAdminݖݶ෇༩ Ϋϥ΢υ্ͷػೳʹରͯ͠༩͑Δݖݶ΋ߟ͑Δ
29. Ϋϥ΢υΤϯδχΞAIͷΨʔυϨʔϧϨϕϧ 29 IAMͷαʔϏε୯ҐͰͷڐՄϨϕϧ • Level1ɿΫϥ΢υΞΫηεෆՄ • Level2ɿಛఆͷAWSαʔϏεͷΈΞΫηεΛڐՄʢϗϫΠτϦετʣ • Level3ɿAdminݖݶ෇༩ɺಛఆͷAWSαʔϏεͷΈΞΫηεΛෆڐՄʢϒϥοΫϦετʣ • Level4ɿAdminݖݶ෇༩ Ϋϥ΢υ্ͷػೳʹରͯ͠༩͑Δݖݶ΋ߟ͑Δ ΤϯδχΞAIʹͰ͖Δ͚ͩݖݶΛ༩͑ͯࣗ૸͠΍͘͢͢Δ
30. DevinͷSecretsʹΞΫηεΩʔ/γʔΫϨοτΩʔ/MFAγʔυ஋Λొ࿥ ಡΈऔΓૢ࡞ɿReadOnlyRoleʹεΠονͯ͠ϦιʔεΛ֬ೝ ॻ͖ࠐΈૢ࡞ɿCDKΛ࢖͍CDK༻ͷϩʔϧʹεΠον࣮ͯ͠ߦ Devinʹೝূ/ೝՄ৘ใΛ༩੍͑ͭͭݶ 30 https://dev.classmethod.jp/articles/prologue-to-make-devin-an-aws-engineer/
31. Devin͕৽ػೳΛࣗൃతʹ։ൃ͢Δʹ͸·ͩ෺଍Γͳ͍ҹ৅ Knowledge΍Playbookͷ࡞ΓࠐΈ͸Ͱ͖͍ͯͳ͍ͷͰݕূத ݱঢ় 31 https://dev.classmethod.jp/tags/devin/
32. ʮࠓ࢖͍ͬͯΔAI͸ɺࠓޙ࢖༻͢ΔͲ ͷAIΑΓ΋ྼѱͩʯͱԾఆ͢Δ (p.104) ʮ͜Ε͔ΒͷAIɺਖ਼͍͠෇͖߹͍ํͱ࢖͍ํʯΑΓ 32 https://www.amazon.co.jp/dp/4041155274 ԾఆΛஔ͘͜ͱͰະདྷΛߟ͑Δ • ΋͠ηΩϡϦςΟϦεΫ͕վળ͞ΕΕ͹ʁ • ΋͠ίʔσΟϯάͷਫ਼౓͕վળ͞ΕΕ͹ʁ • ΋͠ίϯςΩετ͕࣋ଓͨ͠Βʁ