Upgrade to Pro — share decks privately, control downloads, hide ads and more …

How would you test this? The Python Edition.

Avatar for Maaret Pyhäjärvi Maaret Pyhäjärvi
October 09, 2025
51

How would you test this? The Python Edition.

With generative AI in application testing, I see a repeated unhelpful agent message: insert specifications to generate test cases. It's now more important than ever to get this: test cases are not testing. Testing is the process of empirical research for information we might be missing. Test cases can be an input (as the traditional framing of it goes) or they can be an output (as the exploratory framing of it goes). I recommend they are code - and I demo this idea primarily in Python code.

In this session, we take a single page application and ask: how would you test this? With notes, programmatic tests in python, a listing of now known bugs, we will see how testing actually works, and why in age of AI the 'human in the loop' or 'alignment engineer' would do well with solid testing skills. And it does not hurt that those very same solid testing skills are valued in developers in the current market.

Avatar for Maaret Pyhäjärvi

Maaret Pyhäjärvi

October 09, 2025
Tweet

Transcript

  1. © 2025 CGI Inc. 1 How Would You Test This?

    Maaret Pyhäjärvi October 2025
  2. © 2025 CGI Inc. 2 How Would You Test This?

    by James Lyndsay https://www.workroom- productions.com/raster-reveal/ 2
  3. © 2025 CGI Inc. 3 How Would You Test This?

    by James Lyndsay https://www.workroom- productions.com/raster-reveal/ 3
  4. © 2025 CGI Inc. 4 How Would You Test This?

    by Alan Richardson https://exploratorytestingacademy.com/app/ 4
  5. © 2025 CGI Inc. 11 Pick and choose from approaches

    11 Oracles Locking: works as implemented! Properties: works to a common rule Heuristics: works to how we make sense of things Tests Examples: handcrafted intent Approvals / Snapshots: captured Model-based: generated Orchestrating Human Human in the center: generative, external imagination Human in the loop: agentic, LLM + MCP Executing Human ‘repair’ Exact flows & combinations Random walks Driver selection One time vs. keep around
  6. © 2025 CGI Inc. 13 Metaphorically speaking – Testing not

    Testers 13 450 $/kg 15 $/kg Commodity testing Contemporary exploratory testing
  7. © 2025 CGI Inc. 14 Insights you can act on

    Founded in 1976, CGI is among the largest IT and business consulting services firms in the world. We are insights-driven and outcomes-focused to help accelerate returns on your investments. Across hundreds of locations worldwide, we provide comprehensive, scalable and sustainable IT and business consulting services that are informed globally and delivered locally. cgi.com