Share
Embed
Is Quality The Bottleneck?
Webinar for Telerik by Progress.
This is *NOT* a technical or product talk; it's a general talk.
Discusses ways Quality/Testing is perceived (rightly or wrongly) as a bottleneck to shipping software. Walks through a number of ways to address helping individuals, teams, and organizations improve how quality efforts can reduce waste and increase value.
Jim Holmes
February 17, 2021
Transcript
31 slides
-
Is Quality The Bottleneck? The Role of Testing in the
Modern Dev Cycle Presenter: Jim Holmes -
2 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. I’m Jim I test I coach I fail (lots) I learn -
3 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “Easy” -
© 2017 Progress Software Corporation and/or its subsidiaries or affiliates.
All rights reserved. What are one or two things you could look at differently in how your team/organization ships software? -
6 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 1: Challenges for Quality -
7 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. What’s Changing in Quality? -
8 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Economic Pressure Digital Experience (DX) Individual Value -
9 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Quality Related Costs and Bottlenecks Economic Pressures High rework High support effort Loss of sales, reputation More collaboration Earlier collaboration Clearer risk/value -
10 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. New Focus on Enabling Users Digital Experience (DX) LOTS of early work with users Journey mapping Interviews Workshops Earlier collaboration Far better user proxies Less confusion late in cycle! -
11 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. New Areas to Help Team & Organization Individual Value Bias IoT (not just the buzzword) Big Data Understand modeling Dive into the domains/industries -
12 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 2: What Software Failures are You Seeing? -
13 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. What’s The Same in Quality? -
14 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Setting Expectations Stakeholder Engagement Building Skills and Roles -
15 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Human Communication Is Hard Setting Expectations “Test Everything!” “Automate all test cases” “How long to test?” “What’s most important?” Better clarity for risk/value Avoid low-value edge cases -
16 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Testers do NOT “Assure Quality” Engaging Stakeholders Releasing unknowns Quality viewed as a cost center Act as an “information broker”, not a gatekeeper Understand priorities Know “Why” -
17 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “What decisions do you need to make? What information do you need to make them?” -
18 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Focus on Fundamentals First Skills and Roles Test Case Management pain Long regression cycles Testing late in sprint or N+1 Collaboration Risk/value Stop writing test cases and do more testing -
19 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Survey 3: Planning for Test Automation? -
20 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Leveraging Automation -
22 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Automate the Right Things Automate Well Automate in the Sprint -
23 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. (Focusing on UI Automation) -
24 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Build Great Coverage Automate the Right Things Lots of low value tests Lots of duplication Slow tests Workflows versus features Know what devs test Build support frameworks -
25 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Build Stable, High-Quality Tests Automate Well Scripts need maintenance Scripts are flakey Scripts don’t give good info Tests are production code Build together with devs Carefully choose scripts -
26 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. “Done” Means Automated Automate in Sprint Feedback comes long after dev Fixing errors takes longer Get testing in Definition of Done Even MORE collaboration Scaffold scripts at start -
28 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Focus on Value Focus on Risk Improve Value Improve Collaboration -
© 2017 Progress Software Corporation and/or its subsidiaries or affiliates.
All rights reserved. Follow ups: 0) Email with Recording 1) Blogpost -
30 © 2017 Progress Software Corporation and/or its subsidiaries or
affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. © 2017 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. Thank You!