Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥

SRE の考えをマネジメントに活かす / applying SRE ideas to mana...

Takeshi Kondo
August 04, 2024
4.9k

SRE の考えをマネジメントに活かす / applying SRE ideas to management

Takeshi Kondo

August 04, 2024
Tweet

More Decks by Takeshi Kondo

Transcript

  1. Who am I chaspy Director of Engineering StudySapuri K12 at

    Recruit Co., Ltd. ✊ 4ճ໨Ͱ͢͜Μʹͪ͸ 📷 ࠓ೥͸ίΞελοϑ΋΍ͬͯ·͢ Takeshi Kondo https://chaspy.me chaspy_
  2. ͜Ε·ͰͷΩϟϦΞ • 2014~ Software Engineer, Cloud at FUJITSU • ࠃ࢈Ϋϥ΢υͷ։ൃ

    • OpenStack, Ծ૝Խ(VMWare, HyperV, Xen, KVM), Hardware(Server,Network,Storage) • 2018~ Software Engineer, SRE at Quipper • AWS, Kubernetes, SLI/SLO, Monitoring • 2021~ Engineering Manager, SRE at Recruit • 2022~ Engineering Manager, SRE & WebDev at Recruit • 2023~ Director of Engineering at Recruit IC(Individual Contributor) ͱͯ͠7೥ Manager ͱͯ͠3೥
  3. ࠓ೔࿩͢͜ͱ: SRE ͱϚωδϝϯτͷڞ௨఺ͱҧ͍ • ૝ఆ͢Δϩʔϧˍ࣋ͪؼ͍͖͍ͬͯͨͩͨ͜ͱ • SREing Λ΍͍ͬͯͯϚωδϝϯτʹڵຯ͕͋Δਓ • Ϛωδϝϯτ͕ΩϟϦΞͷબ୒ࢶͷ1ͭʹͳΕ͹خ͍͠

    • ݱ໾ͰϚωʔδϟͷਓ • ࢓ࣄΛ͢Δ্Ͱͷߟ͑ͷώϯτʹͳΕ͹ʂ • Ϛωʔδϟʹڵຯ͕ͳ͍ਓ • ਎ͷճΓͷϚωʔδϟ͕ߟ͍͑ͯΔ͜ͱΛ஌͍ͬͯͨͩ͘
  4. Ϛωδϝϯτͱ͸Կ͔ • Ϛωδϝϯτͱ͸ • ඞཁͳ΋ͷΛௐୡ/ௐ੔͠ɺظ଴͞ΕΔ੒ՌΛ্͛Δ͜ͱ • ϚωʔδϟͷΞ΢τϓοτ • = ࣗ૊৫ͷΞ΢τϓοτ

    + ྡͷ૊৫ͷΞ΢τϓοτ • ର৅͸ਓʢ૊৫ʣ https://bookplus.nikkei.com/atcl/catalog/17/P55010/ ࣗ૊৫ͷ Ξ΢τϓοτ ྡͷ૊৫ͷ Ξ΢τϓοτ* ϚωʔδϟͷΞ΢τϓοτ * ྡͷ૊৫ = Α͘Ұॹʹ࢓ࣄΛ͢ΔνʔϜΛ 
 ૝૾ͯ͠΋Β͑Ε͹ྑ͍Ͱ͢ʂ https://www.oreilly.co.jp/books/9784873119946/
  5. SRE ͱ͸Կ͔ • αʔϏεͷ৴པੑΛίϯτϩʔϧ͢Δ͜ͱ • ͋Δ͍͸ίϯτϩʔϧ͢ΔೳྗΛ૊৫ʹ࣮૷͢Δ͜ͱ • ίϯτϩʔϧͱ͸: • αʔϏεͷظ଴஋(SLO)Λઃఆ͠ɺ؍࡯͠ɺաෆ଍͋Ε͹ௐ੔͢Δ

    • ର৅͸αʔϏεʢγεςϜʣ γεςϜ SLI: http success rate SLO: 99.99% Actual: 99.98% 🔴 SRE Devs PdM Biz CS ૊৫ Enabling Embedding
  6. ϚωδϝϯτͱSREͷൺֱ Ϛωδϝϯτ SRE ϛογϣϯ 🙆 ࣗ૊৫ͱྡ઀૊৫ͷΞ΢τϓοτͷ ظ଴஋Λίϯτϩʔϧ͢Δ ✅ αʔϏεͷ৴པੑΛ ظ଴஋(SLO)ʹίϯτϩʔϧ͢Δ

    खஈ ʢ🙆🔨💰ʣϦιʔεͷௐୡɾௐ੔ 🙆 ૊৫΁ͷίϛϡχέʔγϣϯ 🖥 γεςϜɾΠϯϑϥͷߏஙɺௐ੔ 🙆 ૊৫΁ͷίϛϡχέʔγϣϯ ର৅ 🙆 ૊৫ 🙆 ૊৫ͱ🖥γεςϜ
  7. ϚωδϝϯτͱSREͷൺֱ Ϛωδϝϯτ SRE ϛογϣϯ 🙆 ࣗ૊৫ͱྡ઀૊৫ͷΞ΢τϓοτͷ ظ଴஋Λίϯτϩʔϧ͢Δ ✅ αʔϏεͷ৴པੑΛ ظ଴஋(SLO)ʹίϯτϩʔϧ͢Δ

    खஈ ʢ🙆🔨💰ʣϦιʔεͷௐୡɾௐ੔ 🙆 ૊৫΁ͷίϛϡχέʔγϣϯ 🖥 γεςϜɾΠϯϑϥͷߏஙɺௐ੔ 🙆 ૊৫΁ͷίϛϡχέʔγϣϯ ର৅ 🙆 ૊৫ 🙆 ૊৫ͱ🖥γεςϜ ର৅ͷظ଴஋Λௐ੔͠ɺ ίϯτϩʔϧ͢Δͱ͍͏ ҙຯͰ͸ಉ͡Ͱ͸ʁ ͢Ͱʹ૊৫Λ ݟ͍ͯΔ఺͸ ڞ௨Ͱ͸ʁ ௐୡɾௐ੔ͱ͍͏ खஈ΋ڞ௨Ͱ͸ʁ
  8. ϚωδϝϯτͱSREͷൺֱ • Ϛωδϝϯτ͸૊৫ͷظ଴஋Λຬͨͨ͢Ίʹௐ੔͢Δ • ର৅͸૊৫ • SRE ͸γεςϜͷظ଴஋Λຬͨͨ͢Ίʹௐ੔͢Δ • ର৅͸૊৫ͱγεςϜ

    • ͔ͳΓࣅ͍ͯΔͱࢥ͍·ͤΜ͔ʁ • ࣮ࡍʹࣗ෼͸Ϛωδϝϯτͱ͍͏ۀ຿Λ SRE ͷϝϯλϧϞσϧͰݟ͍ͯ·͢ • ͜Ε͕Ͱ͖Δͱࣗ਎͕ϓϨΠϠʔΛܦݧͯ͠ͳ͍νʔϜͰͷϚωδϝϯτΛ΍Δ৔߹ͷ෢ثʹͳΔ
  9. ΞϥʔτରԠ SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ SLO ͱΞϥʔτΛઃఆ͢Δ ΞϥʔτΛड͚Δ ରԠ͢Δ νʔϜʹ͓೚ͤ͢Δظ଴஋Λ఻͑Δ Ͳ͏ͳͬͨΒݺΜͰཉ͍͔͠఻͑Δ

    ΞϥʔτΛड͚Δ ରԠ͢Δ ✋ Ϛωδϝϯτͷ৔߹ͷ SLI/SLO ͸ʁ 😃 ఆྔతͳϝτϦΫε΋͋Δ͕ɺఆੑ৘ใΛ Ξϥʔτʹ࢖͏͜ͱ͕ଟ͍ ఆੑ * νʔϜͷৼΓฦΓͰग़Δ Problem * 1on1 Ͱͷձ࿩಺༰ * ԣͷϚωʔδϟ͔ΒͷΤεΧϨʔγϣϯ ఆྔ * νʔϜͷΞ΢τϓοτʢνέοτ౳ʣ * eNPSʢΤϯήʔδϝϯταʔϕΠʣ
  10. ϦεΫ”Ϛωδϝϯτ” SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ γεςϜ͕མͪͨΒ Ͳ͏͢Δʁ ৑௕Խ ͜ͷਓ͕ʢ௕ظͰʣ ٳΉ࣌Ͳ͏͢Δʁ ଞͷਓͰ΋ۀ຿Ͱ͖Δ

    Α͏Ҿ͖ܧ͗ ٸͳεύΠΫΞΫηε ͕དྷΔ͔΋ʁ ࣄલʹεέʔϧΞοϓ/ Ξ΢τ͢Δ ٸʹۀ຿ྔ૿͑Δ͔΋ ਓΛ࿈Εͯ͘Δ ૿͑ͳ͍Α͏ʹௐ੔ σʔλফ͑ͪΌͬͨΒ Ͳ͏͠Α͏ όοΫΞοϓ ಥવୀ৬ऀ͕ग़ͨΒ Ͳ͏͠Α͏ υΩϡϝϯςʔγϣϯ φϨοδγΣΞ
  11. ΞʔΩςΫνϟઃܭ SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ αʔϏεͷ໾ׂɾ੹຿Λઃܭ͢Δ ݸਓɾνʔϜͷ໾ׂΛઃܭ͢Δ ظ଴஋͸ ݸਓ/νʔϜ໨ඪ ظ଴஋͸ SLO

    ΠϯλʔϑΣʔε ͸ API ΠϯλʔϑΣʔε ͸ “Team API”* *શνʔϜʹରͯ͠ɺϝϯγϣϯάϧʔϓ໊ɺ ໾ׂɺ੹຿ɺίϛϡχέʔγϣϯํ๏Λ Spreadsheet Ͱ؅ཧ͠ɺ൒೥ʹ1౓ߋ৽ * Team Topologies ΑΓ https://pub.jmam.co.jp/book/b593881.html
  12. ΞʔΩςΫνϟઃܭ SRE ͷ৔߹ Ϛωʔδϟͷ৔߹ αʔϏεͷ໾ׂɾ੹຿Λઃܭ͢Δ ݸਓɾνʔϜͷ໾ׂΛઃܭ͢Δ ظ଴஋͸ ݸਓ/νʔϜ໨ඪ ظ଴஋͸ SLO

    ΠϯλʔϑΣʔε ͸ API ΠϯλʔϑΣʔε ͸ “Team API”* *શνʔϜʹରͯ͠ɺϝϯγϣϯάϧʔϓ໊ɺ ໾ׂɺ੹຿ɺίϛϡχέʔγϣϯํ๏Λ Spreadsheet Ͱ؅ཧ͠ɺ൒೥ʹ1౓ߋ৽ * Team Topologies ΑΓ https://pub.jmam.co.jp/book/b593881.html ✋ ΞʔΩςΫνϟઃܭʹ͸τϨʔυΦϑ͕ଘ ࡏ͠·͕͢ɺϚωδϝϯτͷ৔߹΋τϨʔυ Φϑ͸ଘࡏ͠·͔͢ʁ 😃 Yes ৗʹϝϦοτͱσϝϦοτΛ૝ఆ͠·͢ɻ e.g. νʔϜΛখ͘͞෼ׂ͢Ε͹ɺ໨ඪ͸γϯϓϧʹͳΓɺ ೝ஌ෛՙ͸࡟ݮ͞ΕΔ͕ɺۀ຿ྔͷ೾ʹΑͬͯՋͳ࣌ظ͕ ൃੜ͢Δ͔΋ جຊͷ੹຿ఆٛͱɺྫ֎࣌ʹͲ͏͢Δ͔Λఆٛ͠ɺ ྫ֎ൃੜ཰͕௿͘ͳΔΑ͏ʹ͢Δͷ͕ॏཁ
  13. ϚωδϝϯτͱSREͷൺֱ • Ϛωδϝϯτ͸૊৫ͷظ଴஋Λຬͨͨ͢Ίʹௐ੔͢Δ • ର৅͸૊৫ • SRE ͸γεςϜͷظ଴஋Λຬͨͨ͢Ίʹௐ੔͢Δ • ର৅͸૊৫ͱγεςϜ

    • ظ଴஋ௐ੔ͱɺͦͷظ଴஋΁ͷίϯτϩʔϧ͕ڞ௨͍ͯ͠Δ • ͔͠΋͢Ͱʹ૊৫ʹ΋൒෼޲͖߹͖͍ͬͯͯΔ! • ͳΜ͔ͩ΍ΕΔؾ͕͖ͯ͠·͔ͨ͠…?
  14. SRE ͱϚωδϝϯτͷ࠷େͷҧ͍ • ର৅͕ਓͰ͋Δ͜ͱ • ಉ͡ਓؒ͸୭Ұਓ͍ͳ͍ • ظ଴஋ௐ੔΋ΞϥʔτରԠ΋ಉ͡ํ๏͸௨͡ͳ͍ • ʮର࿩ʯ͠ɺʮཧղʯ͢Δ͜ͱ͕ॏཁ

    • ͦͷͨΊͷεΩϧ͸ޙఱతʹशಘՄೳ • ܏ௌɺݴޠԽɺϑΟʔυόοΫɺϑΝγϦςʔγϣϯ etc • ͱ͸͍͑ɺ͍͖ͳΓ΍Δͷ͸೉͍͠ͷͰஈ֊తʹ܇࿅ΛੵΉͷΛ͓͢͢Ί
  15. ·ͱΊ • 💡SRE ͱϚωδϝϯτ͸ظ଴஋ௐ੔ͷ఺Ͱڞ௨͍ͯ͠Δ • ϚωδϝϯτΛҰ෦͢Ͱʹ΍͍ͬͯΔͱ΋ݴ͑Δ • ͢Ͱʹ૊৫ʹ޲͖߹͍ͬͯΔ෼༗རͰ͋Δͱ΋ݴ͑Δ • 🤔͔͠͠ɺʢϐʔϓϧʣϚωδϝϯτ͸γεςϜͷΑ͏ʹ୯Ұతͳํ๏Ͱ

    ରॲ͢Δ͜ͱ͸೉͍͠ • ਓؒͬͯ೉͍͠…! • ͔͠͠ɺͦͷͨΊͷ܏ௌɺݴޠԽͳͲͷεΩϧ͸ޙఱతʹशಘՄೳ • 🤝Ϛωδϝϯτʹڵຯ͕͋Δਓ͸௅ઓͯ͠ཉ͍͠ͱࢥ͍·͢ • શྗͰԠԉ͠·͢ʂ
  16. 💡 ໌೔͔ΒͰ͖Δώϯτ • ϚωʔδϟΛ΍ͬͯΈ͍ͨਓ • ࣗ෼ͷ্௕ʹʮڵຯ͕͋Δʯ͜ͱΛ఻͑ͯΈΑ͏ • ਓ΍νʔϜʹରͯ͠ʮظ଴஋Λௐ੔͢Δʯ࿅शΛ΍ͬͯΈΑ͏ • ࣗ෼ͷಇ͖ํͷظ଴஋ΛνʔϜϝϯόʔ΍Ϛωʔδϟʹฉ͍ͯΈΑ͏

    • ࠓϚωʔδϟΛ΍͍ͬͯΔਓ޲͚ͷώϯτ • ϝϯόʔʹରͯ͠࢓ࣄͷظ଴஋Λձ࿩ͯ͠ΈΑ͏ • ϝϯόʔʹରͯ͠Ϛωʔδϟͷظ଴஋Λձ࿩ͯ͠ΈΑ͏ • ࣗ෼ͷνʔϜͷظ଴஋ΛྡͷνʔϜ΍্௕ʹ͋ΒͨΊͯฉ͍ͯΈΑ͏
  17. Thank you! chaspy Director of Engineering StudySapuri K12 at Recruit

    Co., Ltd. 😄 ୭͔1ਓͷΩϟϦΞͷબ୒ࢶΛ࡞ΕͨΒخ͍͠ 🗣 Ask the Speaker Ͱ࿩͠·͠ΐ͏ʂ Takeshi Kondo https://chaspy.me chaspy_