Share
Embed
210416_DODT2021_独立QAチーム1年戦記/210416-dodt2021-an-independent-qa-teams-1-years-war
DevOpsDays Tokyo 2021で登壇した資料です。
Scrum@Scaleの会社で独立QAチームが経験した1年間と教訓をまとめたものです。
This slide was provided on DevOpsDays Tokyo 2021.
1 Year's real story of a QA team which fought in Scrum@Scale company, and some precepts.
Written in both English and Japanese
Transcript
72 slides
-
Masanori Kawarada QA Brain in GLOBIS Agile TestingɿΞδϟΠϧςεςΟϯά 2021-04-16 15:00
- 15:45 @mkwrd ಠཱQAνʔϜ εΫϥϜͷ֎͔Β νʔϜͱ৫ͷ࣭ΛΔಓ An Independent QA Team’s 1 Year’s War Way to Create Quality of the Teams and the Organization from the Outside of Scrum 1ઓه Design Inspired by Eesti Vabariik, the Country of Andrei Solntsev. -
ՏݪాయʢϚʔΫɾΥʔυʣ Masanori Kawarada (Mark Ward) 2"ܙାʢϒϨΠϯʣ QA Brain / Evangelist
ΤϯδχΞྺ 9 Years Exp. as an Engineer @mkwrd ւ֎ΧϯϑΝϨϯεϑϦʔΫ International Conference Freak ొஃऀհ Speaker 1 2 3 4 5 גࣜձࣾάϩʔϏεʢڭҭࣄۀʣ Working for Living in this flat w/o bathroom -
@mkwrd ݱ࣮Yݹ͍ύϥμΠϜ Reality * Old Paradigm ཧY৽͍͠ύϥμΠϜ Theory * New
Paradigm ཧYݹ͍ύϥμΠϜ Theory * Old Paradigm ݱ࣮Y৽͍͠ύϥμΠϜ Reality * New Paradigm ߨԋͷ4ݶ Quadrant of Presentations -
εΫϥϜ࣮ફऀ Scrum Practitioner @mkwrd ͜ͷεϥΠυ In this slide, ςελʔ Tester
ʹ͚ͯ࡞ͬͨͷͰ͢ɻ I assume that will be the audience. ͓Αͼ and ɺ -
Tester ςελʔ ʮςετɾ࣭ͷઐՈʯͯ͢ Every “Test / Quality Specialist” ʮςετ࣮ߦऀʯ͚ͩ @mkwrd
Only “Test Operator” ͜ͷεϥΠυ In this slide, ͱ means Ͱɺ -
@mkwrd γΣΠΫεϐΞ W. Shakespeare ͜ͷ··Ͱ͍͍ͷ͔ɺ ʰϋϜϨοτʱ খాౡ༤ࢤʦ༁ʧനਫࣾ “Hamlet” ͦΕ͕ͩɻ question.
or not to be, To be that is the https://en.wikipedia.org/wiki/William_Shakespeare ͍͚ͳ͍ͷ͔ɺ -
ೖΒͳ͍ͷ͔ɺ εΫϥϜʹೖΔͷ͔ɺ https://en.wikipedia.org/wiki/William_Shakespeare @mkwrd Issue To Be Discussed in Scrum
ςελʔͷ Tester’s question. or not to be, To be that is the ςελʔ Tester ? ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ͦΕ͕ ͩɻ ΅͘Β͕ߟ͑Δ͍ -
ཁ݅ఆٛ @mkwrd %FTJHO ઃܭ $PEJOH ςετ 3FMFBTF WATERFALL 3FRVJSFNFOU
5FTUJOH ϦϦʔε 🙅🙅 🙆🙆 ςελʔ Tester -
։ൃऀ εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team
ςελʔ Tester ςε λ ʔ ͕ ײ ͡ ͯ ͍ Δ ͜ ͱ W hat Tester Feels @mkwrd Developers -
ςελʔ Tester εΫϥϜνʔϜͷҰମײ͕࡞Δݟ͑ͳ͍น Invisible Wall of Scrum Team Unity 💦
ෑډͷߴ͞ Feeling Hard to Work with @mkwrd ແݶʹݟ͔ͭΔ ෆ۩߹ɾҧײ Infinitive Bugs and Incongruity ։ൃऀ εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team Developers -
ςελʔ Tester ε Ϋ ϥϜ ν ʔϜ ͕ ײ ͡
ͯ ͍ Δ ͜ ͱ W hat Scrum Team Feels @mkwrd ։ൃऀ εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team Developers -
։ൃऀ εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team
ςελʔ Tester ࡶͳίϛϡχέʔγϣϯ Complicated Communication ࣌ؒͷϩε Loss of Time ͯ͞͠ॏཁͳΘ͚Ͱͳ͍ෆ۩߹ใࠂͷཛྷ Massive Number of Trivial Bug Reports 😡 @mkwrd 😡 😡 Developers -
։ൃऀ εΫϥϜϚελʔ Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team
ςελʔ Tester 💦 @mkwrd Ͳ͏ͬͯղܾ͠·͠ΐ͏ʁ How to Solve the Problem? 😡 😡 😡 Developers -
ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ @mkwrd Testers Join Scrum Team as Developers. ςελʔ͕։ൃऀͱͯ͠
εΫϥϜνʔϜʹࢀՃ͢Δ An Independent QA Team Supports Scrum 1 2 -
ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master
ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester ಠཱͨ͠2"νʔϜ Independent QA Team -
@mkwrd Testers Join Scrum Team as Developers. ςελʔ͕։ൃऀͱͯ͠ εΫϥϜνʔϜʹࢀՃ͢Δ ίϛϡχέʔ
γϣϯϩεΛ ࠷খʹͰ͖Δ εΫϥϜͰ δΣωϥϦετͷಇ͖͕ ٻΊΒΕΔ Minimized Communication Loss Obligation to Work as Generalist in Scrum, Not Specialist ϝϦοτ Pros. σϝϦοτ Cons. ʢҰྫͰ͢ʣ (An Example) 1 -
ίϛϡχέʔγϣϯϩε͕ େ͖͘ͳΔ தɾظͷ ্࣭ʹ ߩݙ͍͢͠ @mkwrd An Independent QA Team
Supports Scrum. ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ Contribution to The Quality Improvement in The Long Run Bigger Communication Loss 2 ϝϦοτ Pros. σϝϦοτ Cons. ʢҰྫͰ͢ʣ (An Example) -
@mkwrd Testers Join Scrum Team as Developers. ςελʔ͕։ൃऀͱͯ͠ εΫϥϜνʔϜʹࢀՃ͢Δ ಠཱͨ͠2"νʔϜ͕
εΫϥϜνʔϜΛࢧԉ͢Δ An Independent QA Team Supports Scrum. 1 2 -
1 ࠓճͷࣄྫͪ͜Β I’d like to talk about @mkwrd ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ
An Independent QA Team Supports Scrum. 2 ⾣ ⾣ -
ࢹ ࠲ VISION SHIZA @mkwrd ͳͥεΫϥϜνʔϜʹೖΒͳ͍ಓΛબΜ͔ͩ Reason Why Not to
Join Scrum Team 2 -
@mkwrd ۀͷڭҭࣄۀձࣾ Educational Company since 1992 Developing Web/Mobile App, LMS,
etc. ʹ։ൃ෦ઃཱɺ4DSVN!4DBMF 8FCɾϞόΠϧΞϓϦ-.4ͳͲΛ։ൃ Dev. Dept. since 2016, Scrum@Scale 2"νʔϜ QA Team ݄ɺ໊ͰνʔϜཱ֬ɿগਫ਼ӶͷʮϏδϣφϦʔɾ2"ʯ Started with 4 testers in Jan. 2020: Elite Corps as “Visionary QA” -
@mkwrd Can’t assign Testers to each Scrum Team due to
shortage ͦͦਓ͕ গͳ͘ɺཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ 1 -
ςελʔ @mkwrd ςελʔ Tester QAνʔϜ QA Team ։ൃऀ Developers εΫϥϜϚελʔ
Scrum Master ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team -
Would like to make the QA team who contributes quality
from not only testing but all aspects 2 Can’t assign Testers to each Scrum Team due to shortage @mkwrd ͦͦਓ͕ গͳ͘ɺཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ ςετ͚ͩͰͳ͘ ͋ΒΏΔଆ໘͔Β ࣭ʹߩݙ͢Δ2" νʔϜʹͳΓ͍ͨ 1 -
ςετ Test ্࣭ͷ औΓΈ Efforts to Improve Quality ςετʹͱΒΘΕͣ ࣭ʹूத͠Α͏
⾣ @mkwrd https://testcon.lt/wp-content/uploads/2020/11/Joel-Montvelisky-TestCon-Europe-2020-Focus-on-Quality-Not-Testing.pdf -
@mkwrd ͦͦਓ͕ গͳ͘ɺཧతʹ શεΫϥϜνʔϜʹ ΞαΠϯͰ͖ͳ͍ 1 ςετ͚ͩͰͳ͘ ͋ΒΏΔଆ໘͔Β ࣭ʹߩݙ͢Δ2" νʔϜʹͳΓ͍ͨ
2 Would like to create “QA team free” organization, ultimately! 2"νʔϜෆཁͷ ৫ʹ্͍͛ͨ 3 Would like to make the QA team who contributes quality from not only testing but all aspects Can’t assign Testers to each Scrum Team due to shortage -
Changing Billing System Platform ՝ۚ1'ସ 1 ՝ۚP/F [B] New Billing
System Platform ൣͳϦάϨογϣϯςετ Extensive Regression Testing ՝ۚP/F [A] Old Billing System Platform طଘސ٬ Existing Customer ৽نސ٬ New Customer @mkwrd ։ൃऀ͕࡞ͬͨςετέʔε Test Case provided by Dev. ςελʔ͕࡞ͬͨςετνϟʔλʔ Test Charter provided by Tester ܗࣜతςετ Formal Testing ୳ࡧతςετ Exploratory Testing -
Changing Billing System Platform ՝ۚ1'ସ 1 @mkwrd ։ൃऀ͕࡞ͬͨςετέʔε Test Case
provided by Dev. ςελʔ͕࡞ͬͨςετνϟʔλʔ Test Charter provided by Tester ܗࣜతςετ Formal Testing ୳ࡧతςετ Exploratory Testing LEARNING DESIGN EXECUTION ෆ۩߹ͷ Tendency of Defects Finding Many Bugs in Short Term & Reporting Selected Ones ࣌ؒͰଟ͘ͷෆ۩߹Λݕग़͠ɺݫબͯ͠ใࠂ ςελʔͷࣄΛՃ To Accelerate Tester’s Work -
@mkwrd Data Table Renewal σʔλ ςʔϒϧߋվ 2 ϦϦʔε1ϲ݄ޙ Only 1
Month until Release ൣͳϦάϨογϣϯςετ Extensive Regression Testing Dev SM PO Scrum QA Team Tester Shared Idea, “Testing Enough to Get a Peace of Mind” ʮ҆৺ײΛಘΒΕΔ·Ͱͷςετʯͷڞ௨ೝࣝ @mkwrd Close Communi- cation ີͳ ίϛϡχ έʔγϣϯ -
Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 ৽ΞϓϦͷߋ৽
App Renewal Phase. 1 @mkwrd Apple՝ۚͷରԠ In-App Billing Purchase Phase. 2 -
Apple՝ۚͷରԠ In-App Billing Purchase Phase. 2 Apple՝ۚͷରԠ In-App Billing Purchase
Phase. 2 Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 ୳ࡧతςετ Exploratory Testing Ensuring Transparency & Building a Peace of Mind ಁ໌ੑͷ୲อͱ҆৺ײͷৢ @mkwrd ৽ΞϓϦͷߋ৽ App Renewal Phase. 1 -
Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 Problems
to Be Resolved vs Scrum-QA Connected Team ղܾ͖͢՝ vs εΫϥϜνʔϜ & QAνʔϜ @mkwrd Dev SM PO Scrum QA Team Tester SANDBOX ༷ॻʹແ͍ڍಈ ͔ͨ͘͠͞Μ Many Behaviors Undefined in the Specification Apple՝ۚͷରԠ In-App Billing Purchase Phase. 2 -
Contribution to Scrum@Scale 4DSVN!4DBMF ͷߩݙ 4 @mkwrd https://scrumatscale.scruminc.com/scrum-at-scale-guide/ Scrum Master’s
Cycle ڞ௨ͷDoD੍ఆΛϦʔυ ࣭ͷٕज़ใఏڙ Defining Common “Definition of Done” Providing Quality Knowledge -
Contribution to Scrum@Scale 4DSVN!4DBMF ͷߩݙ 4 @mkwrd https://scrumatscale.scruminc.com/scrum-at-scale-guide/ Product Owner’s
Cycle ϢʔβʔετʔϦʔɺಛʹ डೖ݅ͷΞϓϩʔν Approaching to User Stories Refinement, especially Acceptance Criteria -
Changing Billing System Platform ՝ۚ1'ସ 1 Data Table Renewal σʔλ
ςʔϒϧߋվ 2 Major Update of iOS App J04ΞϓϦ େܕΞοϓ σʔτ 3 @mkwrd Contribution to Scrum@Scale 4DSVN!4DBMF ͷߩݙ 4 -
Essence for Successful Collaboration Is … ಠཱQAνʔϜͱεΫϥϜνʔϜͷ ڠۀͷൿ݃…… 1 2
3 ӽͨ͠ςετٕज़ @mkwrd 4 Experts’ Test Skills -
Essence for Successful Collaboration Is … ಠཱQAνʔϜͱεΫϥϜνʔϜͷ ڠۀͷൿ݃…… 1 2
3 ஸೡͳίϛϡχέʔγϣϯ @mkwrd 4 Cordial Communication -
@mkwrd 2"νʔϜɺεΫϥϜνʔϜ͕ࣗͨͪͰ ՌΛςετͰ͖ΔΑ͏ࢧԉ͢Δ QA Team will support Scrum Teams to
test artifacts on their own. ࣭ʹର͢ΔʮνʔϜશମΞϓϩʔνʯ “The Whole Team Approach” to Quality -
ϞμϯςεςΟϯά @mkwrd Modern Testing Alan Page Program Director at Unity
Brent Jensen Data Scientist at MS moderntesting.org -
ϞμϯςεςΟϯά @mkwrd Modern Testing Mission ϛογϣϯ ग़ՙͰ͖Δ࣭ͷ౸ୡΛ Ճͤ͞Δ͜ͱ Accelerate the
Achievement of Shippable Quality moderntesting.org -
6. σʔλυϦϒϯ ϞμϯςεςΟϯά @mkwrd Modern Testing 7 Principles 7ݪଇ 1.
Ϗδωεͷ 2. ϘτϧωοΫͷରॲ 3. ܧଓతͳվળ 4. ࣭จԽৢ 5. ސ٬࣭ͦ͜ͷධՁऀ 1. Business Growth 2. Dealing with Bottleneck 3. Continuous Improvement 4. Cultivating Quality Culture 5. Regarding Customer as Unique Quality Evaluator 6. Data Driven 7. ςετνʔϜʹؐΔ 7. Bringing Testing Back to the Team moderntesting.org -
7. ςετνʔϜʹؐΔ ϞμϯςεςΟϯά 7. Bringing Testing @mkwrd Modern Testing ςετεΩϧϊϋΛνʔϜʹΊΔɿ
ઐଐͷςετεϖγϟϦετͷधཁ͕ݮͬͨΓ ແ͘ͳͬͨΓ͢Δ͜ͱʹͳΔͱ͔͍ͬͯͯɺ ͦΕͰɺͩ We expand testing abilities and knowhow across the team; understanding that this may reduce (or eliminate) the need for a dedicated testing specialist. Back to the Team moderntesting.org -
Lisa Crispin & @mkwrd Janet Gregory agiletester.ca/ ϦαɾΫϦεϐϯ δϟωοτɾάϨΰϦʔ ະ༁😢
Not Translated into Japanese -
@mkwrd 2"νʔϜɺεΫϥϜνʔϜ͕ࣗͨͪͰ ՌΛςετͰ͖ΔΑ͏ࢧԉ͢Δ QA Team will support Scrum Teams to
test artifacts on their own. ࣭ʹର͢ΔʮνʔϜશମΞϓϩʔνʯ “The Whole Team Approach” to Quality -
ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master
ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester ʮ2"νʔϜͷςετΛ௨͢͜ͱʯ ͳΜͯ%P%ʹॻ͖ͨ͘ͳ͍ͳ͊ʜʜ We don’t want to write on DoD that “the artifacts have to pass QA team’s testing.” -
ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master
ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ςελʔ Tester εΫϥϜνʔϜ͞Μɺ ࣗ͝Ͱςετ͕Ͱ͖ΔΑ͏ʹ ͳΓͨ͋͘Γ·ͤΜ͔ʁ Hey, Scrum Team, why don’t you want to test on your own? -
ςελʔ QAνʔϜ QA Team @mkwrd ։ൃऀ Developers εΫϥϜϚελʔ Scrum Master
ϓϩμΫτΦʔφʔ Product Owner εΫϥϜνʔϜ Scrum Team ͦ͠ͷͭΓͳΒɺ 2"νʔϜ͕ςετͷΓํΛ ࣮ફͰ͓͑͠·͢Αʂ If so, QA team will tell you how to test in practice! ςελʔ Tester -
εΫϥϜνʔϜ͕ ςετΛओಋ͠ 2"νʔϜ ϨϏϡʔͱ ΞυόΠεΛ͢Δ εΫϥϜνʔϜ͕ ςετΛ΄΅શ࣮ͯࢪ͠ 2"νʔϜઐੑΛ ཁ͢Δͱ͖ʹࢧԉ͢Δɻ @mkwrd
QA team leads almost all test process and shares the way, how-to, etc. 2"νʔϜ͕ ςετϓϩηεΛ ΄΅શͯϦʔυ͠ աఔɾख๏ͳͲΛεΫ ϥϜνʔϜͱڞ༗͢Δ 1 2 3 Scrum team holds initiative, and QA team provides review and advice. Scrum team makes progress of almost all testing process without QA team instead of some tests requiring technical specialities. The Scrum team don’t need testers’ help to test. 4 εΫϥϜνʔϜ͕2"νʔϜͷ खΛआΓͣʹςετΛߦ͏ɻ ʮQAνʔϜཁΒͣʯͷ֊ஈ Stairway to “QA Team Free” -
“Should we include testers in Scrum to improve quality or
not?” There is still no absolute answer to this question. ʮ࣭ΛߴΊΔͨΊʹεΫϥϜʹ ςελʔΛೖΕΔ͔൱͔ʁʯͱ͍͏ͷ ઈରతͳ͑·ͩଘࡏ͠ͳ͍ɻ @mkwrd -
ಠཱQAνʔϜ͕ εΫϥϜΛࢧԉ͢Δ伴 ʮӽͨ͠ςετٕ๏ɾٕज़ʯͰͳ͘ ʮஸೡͳίϛϡχέʔγϣϯʯͰ͋Δɻ The key for an Independent QA
Team to support Scrum Team is not “Distinguishing Testing Skills” but “Cordial Communication”. @mkwrd -
ϓϩμΫτ࣭ͷ୲อ εΫϥϜ͕Λ࣋ͱ͏ɻ ಠཱQAνʔϜ͕͍ͳͯ͘ɺ ࣗͨͪͰςετͰ͖ΔΑ͏ʹͳΖ͏ɻ Scrum should ensure Product Quality. Without
an Independent QA Team, Scrum has to be able to test enough. @mkwrd -
@mkwrd ࠓͦͯ͜͢ͷςελʔɾεΫϥϜ࣮ફऀʹ͍·͢ Now is the Time to Ask All Testers
& Scrum Practitioners. -
@mkwrd 1 2 Testers Join Scrum Team as Developers. An
Independent QA Team Supports Scrum. ςελʔ͕։ൃऀͱͯ͠ εΫϥϜνʔϜʹࢀՃ͢Δ ಠཱͨ͠2"νʔϜ͕ εΫϥϜνʔϜΛࢧԉ͢Δ ͋ͳͨͳΒɺͲ͏ߟ͑·͔͢ʁ What would you think? -
ಠཱQAνʔϜ εΫϥϜͷ֎͔Β νʔϜͱ৫ͷ࣭ΛΔಓ An Independent QA Team’s 1 Year’s War
Way to Create Quality of the Teams and the Organization from the Outside of Scrum 1ઓه Design Inspired by Eesti Vabariik, the Country of Andrei Solntsev. Masanori Kawarada QA Brain in GLOBIS Agile TestingɿΞδϟΠϧςεςΟϯά 2021-04-16 15:00 - 15:45 @mkwrd