Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Operating Under Uncertainty

Operating Under Uncertainty

In a changing world, it's important that your platform can adapt to new constraints or requirements.

This content comes from a webinar on designing your infrastructure and operations with uncertainty in mind. Attendees learned how to prepare for and manage change, and keep costs in check.

For a period of time, the webinar video is available to view at https://zoom.us/rec/share/y_w2DPby7kxOAauT1EziX6JwLrn4aaa81SccrKYIxJ9HcBV4HRq_jA-XLf8pIeI
Access Password: L9$*G356

The Scale Factory

April 16, 2020
Tweet

More Decks by The Scale Factory

Other Decks in Technology

Transcript

  1. TODAY’S AGENDA_ What is uncertainty? How can we manage risk:

    Through architecture? Through operations design? Specific risks: COVID-19 Q&A
  2. UNCERTAINTY_ “a state of limited knowledge where it is impossible

    to exactly describe the existing state, a future outcome, or more than one possible outcome”
  3. Visible Invisible Value Chain Evolution Genesis Custom Product Commodity Power

    Customer MySQL Compute Storage Data Centre HA Scripts Monitoring Config Mgmt Networking
  4. VPC (eu-west-1) AZ eu-west-1a AZ eu-west-1b AZ eu-west-1c Public Subnet

    Public Subnet Public Subnet Private Subnet Private Subnet Private Subnet
  5. AVAILABILITY DESIGN_ Clustering / Failover Autoscaling Multi-AZ (and Multi-Region) operation

    Caching Asynchronous processing Backpressure / Circuit breakers
  6. n=1

  7. n=6

  8. n=3

  9. Knowledge Awareness Known Unknowns (known risks) Unknown Unknowns (unknown risks)

    Unknown Knowns (hidden facts) Known Knowns (facts, requirements)
  10. Knowledge Awareness Known Unknowns (known risks) Unknown Unknowns (unknown risks)

    Unknown Knowns (hidden facts) Known Knowns (facts, requirements) Build hypotheses Measure Iterate Brainstorming Group documentation Research Exploration External consultancy
  11. Knowledge Awareness Known Unknowns (known risks) Unknown Unknowns (unknown risks)

    Unknown Knowns (hidden facts) Known Knowns (facts, requirements) Build hypotheses Measure Iterate Brainstorming Group documentation Research Exploration External consultancy Prepared
  12. PLAN FOR FAILURE_ Build a list of potential failure scenarios

    Understand how your platform will react Game days (tabletop) Mitigate / Document Game days (live failure injection)
  13. COST CONSIDERATIONS_ Economic impact: Reduced sales $ exchange rate Take

    action: Right-size workload “pilot light” dev environments
  14. DEMAND CONSIDERATIONS_ Traffic impact: Education, entertainment - up now Travel

    - up later Take action: Load testing Performance tuning
  15. PERSONNEL CONSIDERATIONS_ Impact: Illness / death Availability/focus due to dependents

    Take action Documentation / knowledge share Increase team size Engage third party support
  16. Leading Well-Architected Partner Worldwide >200 Reviews Completed Since April 2018

    Book a Well-Architected review today https:/ /scalefactory.com/services/well-architected/ $5,000 funding available to support improvement work