Upgrade to Pro — share decks privately, control downloads, hide ads and more …

[XP Keynote] AI for teams: State of play for A...

[XP Keynote] AI for teams: State of play for AI assistance beyond code

Keynote presentation given at the 26th XP conference in Brugg-Windisch, June 2025

Avatar for Birgitta Boeckeler

Birgitta Boeckeler

June 05, 2025
Tweet

More Decks by Birgitta Boeckeler

Other Decks in Technology

Transcript

  1. © 2025 Thoughtworks AI for teams: State of play for

    AI assistance beyond code Birgitta Böckeler June 2025
  2. © 2025 Thoughtworks Stats from our internal tool tracking spreadsheet

    2 Each tool can be tagged with multiple task areas)
  3. © 2025 Thoughtworks Coding assistance is the noisiest space right

    now 3 Maintenance Deployment Testing Development Analysis Design Planning Research
  4. © 2025 Thoughtworks FAQ: “How much faster does AI make

    the team?” 4 Assumptions Scenario Part of cycle time spent on coding Part of coding supportable with coding assistant Rate of faster task completion with coding assistant Potential time saved in cycle time Very optimistic 40% 60% 55% 13%
  5. © 2025 Thoughtworks 5 Look up the SDK Research on

    the web Update tests Update code Fix linting errors Run tests Fix failed test …
  6. © 2025 Thoughtworks 6 I’ll not talk much about coding

    today, but I do elsewhere https://martinfowler.com/articles/exploring-gen-ai.html
  7. © 2025 Thoughtworks 9 picked up by a developer →

    Done CYCLE TIME How most teams measure speed Coding LEAD TIME All activities to bring one feature live Lots of things not even related to a specific feature
  8. © 2025 Thoughtworks Ideation with GenAI → Divergent Thinking →

    Non-linear → Finding unexpected connections 12
  9. © 2025 Thoughtworks Future of EV charging stations for elderly

    users? 14 Already happening Unlikely Made me curious
  10. © 2025 Thoughtworks 17 Gamification: Which team contributes the most?

    Grouping by type of insight Timeline view Comments on insights Pinning insights Ratings of insights Use of prototypes to review ideas
  11. © 2025 Thoughtworks Ideation with GenAI 18 Human needs to

    provide creative constraints and context Pre-filter ideas before team discussions
  12. © 2025 Thoughtworks 19 Tool archetypes for an AI-enabled engineering

    organisation AI Chat E.g. ChatGPT, Claude, Gemini, enterprise AI chat, … Browser Wiki … Read and write integration with knowledge bases … … … Rapid app generation E.g. Lovable, v0, Bolt, …
  13. © 2025 Thoughtworks Research synthesis 24 Draft key user archetypes,

    Jobs-to-be-done, user journeys Previous on-site research
  14. © 2025 Thoughtworks Synthetic users 26 User archetypes, Jobs-to-be-done, User

    Journeys Review and edit Personas: Tasks & activities, challenges & pain points
  15. © 2025 Thoughtworks Synthetic users 27 Chat with that persona

    and discover more Flow charts for each patient type Starting point for another discussion with SME
  16. © 2025 Thoughtworks AI as a design assistant 28 Faster

    domain context, helps deepen domain vocabulary Unburdens the SME Helps think out of the box Too many ideas can lead to delays and lack of clarity on the team UX design is much more than visuals of individual screens Prototypes donʼt fully replace high fidelity design
  17. © 2025 Thoughtworks 29 Tool archetypes for an AI-enabled engineering

    organisation Design Assistant E.g. Figma AI, Creatie, UX Pilot, … Rapid app generation E.g. Lovable, v0, Bolt, … AI Chat E.g. ChatGPT, Claude, Gemini, enterprise AI chat, … Browser Wiki … Read and write integration with knowledge bases … … …
  18. © 2025 Thoughtworks 33 “The persistence layer should not be

    a storyˮ “That first story is too big, break it down furtherˮ …
  19. © 2025 Thoughtworks AI as a specification assistant 35 Often

    goes too broad too quickly Hard to get it to slice thinly and vertically Great starting point, especially for commonplace domains Risk of scope creep
  20. © 2025 Thoughtworks “Is this a good work package?” 36

    For each idea, create a self-review and reflect if it's a good work package: - Is this a work package that creates value for an end user? - Is this a work package that is a vertical slice, i.e. that is touching all necessary layers of the implementation? - Is this a work package that is purely about technical setup? In that case, your review should point out that it should ideally be integrated into another more functional work package. Think about adding another functional requirement that would include this. - Is this a work package purely about a cross-functional concern, like "improve performance", or "make more user-friendly"? If so, your review should point out that this is not an ideal work package, as cross-functional requirements should be implemented as part of every single functional requirement. - Any testing or quality assurance should never be a separate work package, it should always be part of the functional work packages.
  21. © 2025 Thoughtworks AI as a specification assistant 39 Can

    help get more comprehensive scenarios and fill gaps in our thinking …but more details isnʼt always better!
  22. © 2025 Thoughtworks 40 Tool archetypes for an AI-enabled engineering

    organisation Design Assistant E.g. Figma AI, Creatie, UX Pilot, … Rapid app generation E.g. Lovable, v0, Bolt, … AI Chat E.g. ChatGPT, Claude, Gemini, enterprise AI chat, … Browser Wiki Read and write integration with knowledge bases … … … Canvas support for better AIhuman collab Image and diagram generation support Issue tracker
  23. © 2025 Thoughtworks GenAI can help us think 42 Methodologies

    / practices Our problem at hand Cognitive transfer apply understand What are good models of thinking to apply to this problem? What would that look like for my situation? LLM
  24. © 2025 Thoughtworks 43 What are good models of thinking

    to apply to this problem? What would that look like for my situation?
  25. © 2025 Thoughtworks Methodologies / practices Our problem at hand

    apply understand What are good models of thinking to apply to this problem? What would that look like for my situation? LLM Amplify a practice with a prompt 44 Reusable prompt Architectʼs require- ments
  26. © 2025 Thoughtworks Amplify a practice with a prompt 45

    Architecture decision records help communicate, align, understand our past Help me improve this record! My architecture context My current draft
  27. © 2025 Thoughtworks “Improve this Architecture Decision Record” 46 ...

    We want the ADR to have the following structure: - Title: Should always specify the decision that was taken, not the problem that is solved - Decision summary - Context relevant to the decision: should describe the status quo and goals, and describe the requirements and WHY we need the requirements; Should mention how this decision would affect the business - Options considered: Should always be more than one - Each option should start with a short description of the option - Each option should have a section called "Consequences" that describes the trade-offs for each option (positive and negative consequences) One of the "Options considered" should always be "Do nothing". ...
  28. © 2025 Thoughtworks 48 Tool archetypes for an AI-enabled engineering

    organisation Design Assistant E.g. Figma AI, Creatie, UX Pilot, … Rapid app generation E.g. Lovable, v0, Bolt, … AI Chat E.g. ChatGPT, Claude, Gemini, enterprise AI chat, … Browser Read and write integration with knowledge bases … … … Canvas support for better AIhuman collab Image and diagram generation support Issue tracker Curated, reusable prompt library
  29. © 2025 Thoughtworks 49 Lots of opportunities! Software delivery Analysis

    Design Coding & Architecture Inception & Planning Operations Testing
  30. © 2025 Thoughtworks And how do they help us in

    software delivery? Super powers of Gen AI Product ideation More comprehensive requirements More comprehensive testing Architecture Exploratory testing Brainstorming and ideation Remembering details and learning Understanding errors Providing organisational context Amplifying and socialising knowledge within a team Finding knowledge Change logs Incident management: Run books Research Documentation Summarisation and clustering Requirements to code Code to code Language to queries Standard to standard Translation
  31. © 2025 Thoughtworks Donʼt use it when you need repeatability,

    e.g. in deployment Properties of Gen AI to be wary of in software delivery Non- deterministic Not a compiler Cannot do maths (by itself) LLMs “thinkˮ in tokens Context is key! Especially in brownfield LLMs donʼt know what we donʼt tell them Generates very plausible outputs, but the devil is in the details Can lead to review fatigue Superficial plausibility
  32. © 2025 Thoughtworks 52 Tool archetypes for an AI-enabled engineering

    organisation AI Chat E.g. ChatGPT, Claude, Gemini, enterprise AI chat, … Curated, reusable prompt library Canvas support for better AIhuman collab Image and diagram generation support Wiki Issues Drives Read and write integration with knowledge bases (e.g. via MCP Browser … … Coding assistant (with agentic mode) E.g. Cursor, Windsurf, Cline, Roo Code, GitHub Copilot Design Assistant E.g. Figma AI, Creatie, UX Pilot, … Rapid app generation E.g. Lovable, v0, Bolt, …
  33. © 2025 Thoughtworks 53 Tools Practices People Tool effectiveness is

    a function of the people using them, and the environment around them
  34. © 2025 Thoughtworks How does AI impact team productivity? 57

    There is no “X%ˮ answer to this question. Reduced story cycle time 1020% with a coding assistant) Faster onboarding and upskilling Improved Developer Experience Higher test coverage Code quality and maintain- ability Faster feedback loops Stability: MTTR, Incidents, Availability Less delivery friction
  35. © 2025 Thoughtworks User stories Task list Task list {code}

    Epic <code> Money Software creation is not just a chain of artifacts
  36. © 2025 Thoughtworks GenAI complements our toolbox because it’s NOT

    great at the repeatable “factory” stuff! 59
  37. © 2025 Thoughtworks Higher coding throughput is putting pressure on

    the system. If you can code faster, can you review faster? Can you test faster? Can you ship faster? If you can code faster, can you fill the backlog faster? If you can produce more code, can you keep your technical debt in check? 62 Higher coding throughput
  38. © 2025 Thoughtworks Creation of options is cheaper now 68

    https://itrevolution.com/articles/genai-metrics-of-value-for-developers-option-value-dora/
  39. © 2025 Thoughtworks 69 Pranjal Ranka, Lead UX Designer at

    Thoughtworks Use of AI can easily lead to divergence rather than convergence. I have spent a lot of time revisiting design decision every time a new AI-generated idea comes up
  40. © 2025 Thoughtworks The lure of the waterfall 71 Human

    quality control shifted right? More up-front design? AI can generate beautiful, plausible, over-detailed requirements When everything looks plausible and kind of works, we just push it on to the next step
  41. © 2025 Thoughtworks 73 Who would have thought - once

    more, it comes down to: Resilience and responsiveness Fast and reliable feedback loops Preparedness for uncertainty and fast pace of change
  42. © 2025 Thoughtworks 74 74 But we need to figure

    out as a profession how to use it effectively, sustainably, and holistically across a team. GenAI is in our toolbox now, it is not going away.