The Court - 20 Basketball Research Athletes • Pounding Pavement - running at Nike campus • In The Gym - Nike Employee Training Classes • Walking And Working - 150 Employees @tammybütow DEVOPS @ NIKE DAY
build software that helps engineers build resilient systems • We offer 11 ways to inject chaos for your Chaos Engineering experiments @tammybütow DEVOPS @ NIKE DAY
IO & Memory consumption to ensure monitoring is setup to catch problems. Important to catch issues before they turn into high severity incidents (unable to purchase new product!) and downtime for customers. RESOURCE CHAOS
CONTAINERS • Kill self • Kill a container from the host • Use one container to kill another • Use one container to kills several containers • Use several containers to kill several
replication to S3 failed 2.Logs backed up on the primary 3.Alerts fired to engineer but they are ignored 4.Disk fills up on database primary 5.Engineer deletes unarchived WAL files 6.Error in config prevents promotion — Matt Ranney, Uber, 2015