Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Rediscover agile values with sociotechnical design

xinyao
September 17, 2024

Rediscover agile values with sociotechnical design

In today’s large and complex organizational spaces there is a high interest in scaling agile. But there is also a huge amount of confusion around it.

And yet, the need to scale agile is real, isn’t it? Oftentimes, a customer value increment requires multiple teams to cocreate and collaborate.

Many companies have tried to address this challenge by adopting a kind of a scaled agile framework. However, sometimes there frameworks become the very center of finger pointing, not only because they have a hard time delivering the promise of scaling agile, but also because they seem to have contributed to dehumanizing agile and taking the very element of agility out of our institutional agile practices.

As a software, agile and organizational change consultant, I feel very sad to see software professionals not feeling empowered by agile, but rather alienated from agile. They feel that the agile processes and frameworks are something being done to them, imposed upon them topdown, rather than something they embrace voluntarily.

In this talk, I wish to share my experiences and reflections upon, how the sociotechnical lens and practice can help us rediscover the value of agile as a collaborative capacity to respond to change, to deliver and validate customer values continuously and iteratively, in an uncertain and turbulent environment.

I’d draw on some concrete examples to show how collaborative modeling and design practices like Domain-Driven Design can help us model and build ourselves as human systems around the software systems, with more intentionality, and with more visual reflective conversations.

I also hope to go beyond the buzzwords of sociotechnical design, so that we together can take a deeper look at how complex human systems are different in their dynamics compared with complicated software systems, and thus call for different design principles and design patterns. For instance, information hiding is a desirable quality attribute in designing software systems. But it could be very detrimental if we, or teams, see each other as pure abstractions.

xinyao

September 17, 2024
Tweet

More Decks by xinyao

Other Decks in Design

Transcript

  1. DDD & architecture consultancy DDD Output + Reflective conversations +

    Collective change capacity + [A little about me] Change Smuggler, through DDD and architecture Xin Yao @settling_mud [email protected] @[email protected] /in/xinxin/ delay + delay Independent consultant delay Perceived software quality + delay + Technical improvement Social improvement DDD
  2. Work as a complex social system with technical parts Agile

    values & Agile reality Probe social patterns in technical context Today's path Rediscover agile values with sociotechnical design Sociotechnical agility
  3. Work as a complex social system with technical parts Agile

    values & Agile reality Today's path Rediscover agile values with sociotechnical design Probe social patterns in technical context Sociotechnical agility
  4. Responding to change Working software Individuals and interactions Customer collaboration

    over over over over Agile values are born social and technical: A collaborative capacity to respond to change Software Aptitude (XP, TDD, CI/CD, iterations, feedback loops, automation) Humane Attitude (Humans talking to humans, autonomy, co-​ creation) TECHNICAL SOCIAL
  5. In 2024, how heavy, or light, do Agile practices feel

    to you? And why do you think it has become so? Before 2001, Agile went by the name of Lightweight Methods
  6. How do we "move a couch" within a scaled agile

    organization? Credit: Gene Kim & Steven Spear Gene Steve
  7. A true "moving the couch" story involving 26 teams, deeply

    nested API call chains & event choreography [Anno 2022]
  8. A true "moving the couch" story involving 26 teams, deeply

    nested API call chains & event choreography [Anno 2022] And this was supposed to be a scaled safe-​ to-​ fail experiment
  9. [Two decades since the manifesto] Legacy organizations struggle with legacy

    systems Software industry matures Every business is a software business Aging companies with aging software Compounding sociotechnical complexity
  10. Has complexity made value increment an x-​ legged race? Otherwise

    teams will move in an uncoordinated way - we can't have that. Surely, the more complex the world is, the more planning (aka. alignment) we need?
  11. Work as a complex social system with technical parts Agile

    values & Agile reality Today's path Rediscover agile values with sociotechnical design Probe social patterns in technical context Sociotechnical agility
  12. Many shades of complexity in software work How do we

    talk about things being complex in different ways?
  13. Complex is not the same as Complicated A B C

    A B C D System properties predictable The whole is greater than the sum of its parts Knowable through analysis ("Sense, Analyze") Many moving parts sum up to the whole Plans & Policies ("Respond") Knowable through interaction ("Probe") System properties emergent, unpredictable Experiments & Patterns ("Sense, Respond") Repeatable, Consistent ("Scale best practice") Unrepeatable ("Hindsight does not lead to foresight") A B C D E x emergent new element disappeared relation emergent relation Cause->Effect A B C Complicated Complex Emergence unintended change in relation Credit: Cynefin, Dave Snowden new element new relation unintended change in element
  14. A B C A B C D Systems properties predictable

    The whole is greater than the sum of its parts Knowable through analysis ("Sense, Analyze") Many moving parts sum up to the whole Plans & Policies ("Respond") Knowable through interaction ("Probe") System properties emergent, unpredictable Experiments & Patterns ("Sense, Respond") Repeatable, Consistent ("Scale past practice") Unrepeatable ("Hindsight does not lead to foresight") A B C D E x emergent new element disappered relation emergent relation Cause->Effect A B C D Complicated Complex Emergence unintended change in relation Credit: Cynefin, Dave Snowden new element new relation unintended change in element Ferrari vs. Brazilian rain forest
  15. Organizations are open, sociotechnical systems Social systems (Complex) Technical systems

    (Complicated/Liminal*) [software] [organization] The environment (Complex) *liminal: in between complex and complicated (credit: Dave Snowden) Work is a complex social system with technical subsystems as parts
  16. (Example: governance process in a corporate change initiative) Our default

    social intervention mode is analytical divide-​ and-​ conquer
  17. The traits of complexity are anxiety inducing. Our human brain

    is hard-​ wired to fear the uncertain, unpredictable, uncontrollable, ambiguous. We don't want to think of our work as a Brazilian rain forest a randomly evolving mess of emergent relations that keep changing
  18. We would rather treat organizations as complicated systems - many

    moving parts and relations, but predictable, plannable, controllable. We wish we could divide-​ and-​ conquer human communication as decomposable software APIs. We wish our organizations were complicated Ferraris
  19. Planning and process - a collective defense against our anxiety

    about uncertainty No one loves big, hairy plans. But, reality gets more complex & uncertain - inducing stress We need plans to break big problems into small parts We cannot step into the future without a plan ... and processes to align the many moving parts, people and tasks Plans & processes make us feel safer, in control, on the same page Credit: Steve Hearsum
  20. We identify with our "roles" and feel alienated playing our

    "part" at the same time The planning roles The executing roles (Example: governance process in a corporate change initiative)
  21. Org Design: can we technicalize the social complexity? Large-​ scale

    Agile practice Sociotechnical mirroring Agile frameworks Inverse Conway Spotify model Learned helplessness Skepticism Unknowability A big divide Pessimism Dehumanizing Lack of agency Reorg Transformation initiative
  22. Wardley Map - technical practice vs. social practice fluency Evolution

    Genesis Custom Product Commodity (+rental) (+utility) 1 2 3 4 Technical innovation Mature technical practice Everything evolves with time Social practice? Sociotech practice? ?
  23. If the ancient Greeks could come back now and walk

    among us, they would not understand much of our technology and our science. It would be very foreign. But they would be quite at home in our social problems - wars, politics, economics, various kinds of difficulties. ~ Jay Forrester We haven't evolved much in our understanding of social systems
  24. Work as a complex social system with technical parts Agile

    values & Agile reality Sociotechnical agility Today's path Rediscover agile values with sociotechnical design See the social system Share the social system Probe social patterns in technical context Change the social system
  25. We need models to help us design the WHOLE work

    Where does my work come from? Where does my work go? What skills, materials and meanings do we share? Credit: Jabe Bloom Event Storming Northstar Framework Value Stream Mapping My place in the story
  26. Credit: Jim Benson See the whole system Tactical info Strategic

    Info Cultural Info what is going on? what needs attention now? Where are we going? Where is my place in the story? How is my team a team? What does good look like? What is meaningful for me? (Agency) Example: 7 Elements of Visual Management Purposeful models My part in the whole Discoveries Decisions Shared Meaning State Triggers Visualized work Direction Narrative Culture Professionalism Identity Emergencies Action Improvement Opportunity Discovery need Shared work Complex work Current WIP Who is working Who is collaborating What is ready for release What is stuck Backlog Strategy Plans Upcoming work options Onboarding Upskilling Team identity Interaction & meetings Human repair Social contracts Improvement Correction Learning Quality Who am I and what are my values? How is work meaningful? How is work developmental? Agency Spheres of influence Affordance Visualizing work as a sociotechnical architecture (Presentation layer) (Business layer) (Infrastructure layer)
  27. Visual thinking & visual models Thinking across The WHOLE sociotechnical

    system is a lot to hold in mind Visual models (sketches, diagrams etc.) create an external memory Visual thinking expands our mental capacity Inspiration: Ruth Malan for social & technical systems [Sociotechnical pattern]
  28. Are we aligned after a townhall or all-​ hands Illustration

    : Jeff Patton with visual models for strategy, plan, org structure?
  29. Having a visualization is no guarantee that everyone has the

    same interpretation of what's visualized.
  30. Org chart A social system's runtime behavior Jesper There have

    been 10+ reorgs in my tenure here. But it's always the same people you need to know to pool knowledge together and get stuff done. That's my knowledge network. "Mainframe specialist in a big bank" (+roadmap, plan, backlog)
  31. A social system is continuously regenerated by recurring relational patterns

    Relational patterns are shaped by local and collective mental models (i.e. habits of thoughts & actions) To share the system, we need to have a way to surface mental models Mental models are the infrastructure layer of social system runtime To change the system, we need to have a way to unfreeze mental models E.g. Knowledge network as a relational pattern E.g. Mental model of my fastest path to knowledge and help
  32. Who work and create value together? Who else do we

    need to align understanding with? DDD Collaborative modeling - make the implicit explicit Credit: Paul Rayner, Eric Evans What software are we building? Why are we building it? How do we build and connect software - for long-​ term changeability? Strategic Design Tactical design Visual Collaborative Modeling (models) (models) Ubiquitous (attention to) Language DDD to "smuggle in" social sensemaking
  33. Collaborative Modeling Reflective Conversations does not necessarily lead to To

    share the system, we need to have a way to surface mental models To change the system, we need to have a way to unfreeze mental models
  34. Let's edit out the uncomfortable elements [Sociotechnical pattern inspired by

    DDD] Make the implicit explicit [technical design pattern] Make the undiscussable discussable [social design pattern] Collaborative Modeling --> Reflective Conversation Shame Guilt Anxiety Fear Resentment Blame
  35. discussion Reflective conversation Credit: David Bohm, Peter Senge, Chris Argyris

    reflective advocacy Here are the data and events I see. I know I don't see the whole picture, how do you see it? This is what they mean to me, and how they make me feel. That's a perspective I haven't considered - tell me more! How do you feel about what's going on right now? I prefer that we do it this way - here is my reasoning. [Reflective]: being self-​ aware [Conversation]: open dialog inquiry advocacy advocacy dialog reflective inquiry Psychological Safety
  36. Language Languaging Emotioning Knowledge transfer Knowledge processing Change the itinerary

    of knowledge from language to languaging (and emotioning) [Sociotechnical pattern from complexity theory] Credit: Humberto Maturana
  37. My worst event storming workshop Workshop retrospective You are too

    in love with your model :-). We don't see the forest, only trees You=Me model=event storming
  38. What is it about this situation, and about me or

    others, that is making open exchange difficult? The questions that got us unstuck What are you most passionate about contributing to in this domain? What is the future we dream of for this domain? Make the undiscussable discussable [social design pattern] Shame Guilt Anxiety Fear Blame Languaging Emotioning Resentment
  39. Conversation is a dance of languaging and emotioning. What I

    say in an open conversation, is an invitation to participate with the other(s) in a domain of experiential coherence. Conversation is a dance of languaging and emotioning
  40. The system changes itself in open, reflective conversations * I

    am contextually informed * I feel seen, heard and understood * I feel connected with others in co-​ creation * I feel powerful making my contributions to the whole Experiential Coherence (Social experience of coherence) (Mental positions become changeable in the moment)
  41. What happens to visions, plans, processes, and org structures (Conventional

    view) A good vision, plan, process design time run time implemented by people in the org Org then becomes what the plan etc. says it will become
  42. Meaning and effect of plan, process, etc. is emergent and

    unpredictable A good vision, plan, process design time run time mixed with competing priorities, localized meanings, actions and interactions Ideally, desirable social patterns emerge, coalesce, and are multiply realized in a system-​ wide architecture with coherent dynamics ? Credit: Humberto Maturana, Alicia Juarrero, Ralph Stacey Mission drift
  43. Systemic interventions require descaled conversations A vision, plan, process etc.

    as probe design time run time mixed with competing priorities, localized meanings, actions and interactions Ideally, coherent social patterns (enabling constraints) are multiply realizable and persisted in a system-​ wide architecture of social dynamics. +Social pattern probes Credit: Humberto Maturana, Alicia Juarrero, Ralph Stacey, Dave Snowden (Experiential coherence is needed for change) Experiential coherence Reflective conversations
  44. Complex Systems scale by decomposition to the lowest consistent level

    of granularity, and recombination, not by aggregation or imitation. -- Dave Snowden The way to scale is to descale Granular discovery Distributed cognition Dis-​ intermediation of data Principles of managing social complexity (Conversational Leadership) (Credit: Dave Snowden, Carolyn Baldwin, David Gurteen)
  45. Daily reflective conversation Credit: Milestone Systems, Systems Architecture Team Team

    daily stand-​ up prompts what is going on? what needs attention now? Where are we going? Where is my place in the story? How is my team a team? What does good look like? What is meaningful for me? (Agency) Example: 7 Elements of Visual Management Purposeful models Software-​ centric design Discoveries Decisions Shared understanding Tactical Cultural Strategic
  46. Work as a complex social system with technical parts Agile

    values & Agile reality Sociotechnical agility Today's path Rediscover agile values with sociotechnical design Probe social patterns in technical context
  47. A cautionary note for people with a passion for modeling

    and models Stay in discovery mode Hold on lightly to your favorite models Be ready to kill your darlings True agility is to detach from fixed mental positions Let go of expecting a fixed outcome
  48. Agile was born a sociotechnical practice SocioTECHNICAL A collaborative capacity

    to respond to change in technical systems A collaborative capacity to respond to change and become the change in social systems 2001 2024 technical SOCIO The transition to higher social awareness
  49. Beware of reducing social complexity to technical complication technical SOCIO

    Reduce social systems to technical structures & processes SocioTECHNICAL A collaborative capacity to respond to change in technical systems A collaborative capacity to respond to change and become the change in social systems 2001 2024 medium.com The Structure and Process Fallacy "If our teams were just organized in the right way, and we adopted the agile process, we'd be so much more efficient." Credit: Nick Tune
  50. Let's not containerize ourselves as repeatable deployment units Let's not

    treat each other as abstractions Monoculture is bad for living systems Let's not forget descaled conversations in the pursuit of scaled processes
  51. Rediscover social agility through our work with software We are

    at an important edge. Our rich and messy work is a challenge but also an opportunity. Complexity means we depend on each other to succeed, and we need to work this out together. We have developed many good habits of learning together in software system design. Time to build our collaborative change capacity, and agility, in the social systems we are part of.
  52. Crafting software can be developmental and reparative Maybe software design

    and modeling is just an excuse to have the reflective conversations, no one has time for otherwise. Maybe software development (in all its complexity and yearning for agility) is just an excuse for humans to find our way back to each other. Working together with complex software in complex organizations, gives us a valid context to rediscover our agility and humanity. [Final reflection]