Customer as Anchor - The Stopping Challenge of Testing

Keynote at SLASSCOM Quality and Process Excellence Summit 2024

Transcript

1. © 2024 CGI Inc. 1 Customer as anchor The Stopping Challenge of Testing Maaret Pyhäjärvi October 2024
2. © 2024 CGI Inc. 2 2 Testing Find (some of) what other’s have missed! Photo by Kelly Sikkema on Unsplash
3. © 2024 CGI Inc. 3 3
4. © 2024 CGI Inc. 4 Testing works with invisible ink 4 REQUIREMENTS RISKS (of problems) CODE ENVIRONMENTS …to tell if there’s more and how well we know. We target these… …to find these... Coverage Test Ideas / Experiments Information of Relevance BUSINESS TIME USER WHAT WHEN WHO HOW WHY
5. © 2024 CGI Inc. 5 How good is your idea of risk coverage? 5 …394 line items in bug taxonomy …32 pages
6. © 2024 CGI Inc. 6 Challenges of Testing 6
7. © 2024 CGI Inc. 7 Modern Testing Principles 7 Principle 5. We believe that the customer is the only one capable to judge and evaluate the quality of our product
8. © 2024 CGI Inc. 8 Reframe Make Canvas Smaller 8
9. © 2024 CGI Inc. 9 Nothing changes if you change nothing 9 System version running in production Testing done by development partner Testing done by the system owner System version running in production Regression testing?
10. © 2024 CGI Inc. 10 If you change something… 10 System version running in production Testing done by development partner Testing done by the system owner System version running in production Regression testing? Regression testing?
11. © 2024 CGI Inc. 11 Prepare to Shift: Left and Down 11 Shift Left Shift down Quality engineering over quality assurance Whole team approach Clarifying core examples Single-commit delivery Test-driven development Exploratory unit testing “77% of production bugs could have been found with a unit test” We’re still half-way into the automation transformation that AI supports.
12. © 2024 CGI Inc. 12 Contemporary Exploratory Testing Programmatic tests as output. Feedback with agency. 12
13. © 2024 CGI Inc. 13 Reframe Designing location of testing 13
14. © 2024 CGI Inc. 14 Organizational boundaries, responsibility topologies Development partner testing Follow change. Programmatic safety net Testing services Bridging to information. Fixing phase of acceptance. Acceptance testing Domain knowledge. Realism. Short feedback cycle. Granularity. Risk coverage. Tech knowledge. Business knowledge. Demonstration.
15. © 2024 CGI Inc. 15 "QA is a revenue assurance unit." - Abimbola Adegbite 15 User experiences software Support is form of failure demand with customer facing upside Customer is the organization collating all revenue and expenses Testing optimizes lifecycle costs with information
16. © 2024 CGI Inc. 16 The Three Contemporary Testing Profiles (Contemporary) Exploratory Tester Start with information, document with automation. Finish with testing done. (Contemporary) Test Automation Engineer Start with automation, design for information. Finish with testing done. Programmer Start with intent, document with automation. Finish with testing done. Great collaboration skills compensate for lack in other skills. See the bigger picture for customer benefit.
17. © 2024 CGI Inc. 17 In conclusion 17
18. © 2024 CGI Inc. 18 Programming is like writing. Getting started is easy and it takes a lifetime to get good at. 18
19. © 2024 CGI Inc. 19 19 Everyone can test
20. © 2024 CGI Inc. 20 Customer as anchor 20 Anchor to a baseline in production. Human-size steps. Frequent to continuous delivery Reassignment of organizational testing responsibilities Left and down. Structural trust through automation. Same test is not same test by acceptance and system tester unless we collaborate on hands-on work and examples. Learning to agree scope and address risk. Decompose end to end automation to understanding in end to end.
21. © 2024 CGI Inc. 21 Testing provides visibility. Quality tells you how far to go. Quality engineering bridges the two. 21
22. © 2024 CGI Inc. 22 Insights you can act on Founded in 1976, CGI is among the largest IT and business consulting services firms in the world. We are insights-driven and outcomes-based to help accelerate returns on your investments. Across hundreds of locations worldwide, we provide comprehensive, scalable and sustainable IT and business consulting services that are informed globally and delivered locally. cgi.com