Upgrade to Pro — share decks privately, control downloads, hide ads and more …

production: an owner's manual

production: an owner's manual

from exec(ut) 2018

Igor Wiedler

April 23, 2018
Tweet

More Decks by Igor Wiedler

Other Decks in Programming

Transcript

  1. !

  2. app

  3. app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber
  4. "

  5. "

  6. "

  7. "

  8. golden signals • latency • traffic • errors • saturation

    0 - 50 [1620]: ∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ (74.55%) 50 - 100 [ 447]: ∎∎∎∎∎∎∎∎∎∎ (20.57%) 100 - 150 [ 49]: ∎ (2.25%) 150 - 200 [ 15]: (0.69%) 200 - 250 [ 15]: (0.69%) 250 - 300 [ 10]: (0.46%) 300 - 350 [ 6]: (0.28%) 350 - 400 [ 1]: (0.05%) 400 - 450 [ 0]: (0.00%) 450 - 500 [ 4]: (0.18%)
  9. app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber
  10. app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber humans
  11. app linux kernel cpu dram disk network power supply switches

    load balancer dns submarine cables routers fiber humans h u m a n s
  12. • a production system serves real users • users like

    things that work and are fast • epic failure is almost always systemic