Packing skills to be a DevOps and why that’s a good thing

Gave this talk at ThatConference on August 14th, 2013
Follow me on Twitter: @CodeStars

My current company hired me as a Software Engineer. Their software has organically grown over the past six years and it really looks like what you would expect, when you hear that a software system is that old. There was no real abstraction, no idea of services - nothing fancy.
I realized that if I wanted to change the software I had to start with the system architecture. Thus, I joined the infrastructure team where I learned a lot of new stuff as well as what it meant to be on call.

Transcript

2. Platinum Sponsors Gold Sponsors
3. PACKING SKILLS TO BE A DEVOPS ThatConference - August 14th - Wisconsin Dells (USA)
4. @CodeStars github.com/nesQuick codestars.eu OLE MICHAELIS
5. @CodeStars github.com/nesQuick codestars.eu OLE MICHAELIS
6. “Open Source Rockstar” WORKING @JIMDO
7. “Open Source Rockstar” WORKING @JIMDO
8. “Open Source Rockstar” WORKING @JIMDO
9. MY DEVOPS STORY
14. WHY IS IT GOOD?
15. WHY IS IT GOOD? dedicated technical-debt team
16. WHY IS IT GOOD? dedicated technical-debt team making others faster
17. WHY IS IT GOOD? dedicated technical-debt team making others faster cross-functional
18. WHY IS IT GOOD? dedicated technical-debt team making others faster cross-functional full-stack engineering
19. LET’S TRY TO DEFINE DEVOPS
20. YOU BUILD IT, YOU RUN IT! “The DevOps prime directive”
21. ANTI-PATTERNS “You are doing it wrong!” NO! BECAUSE NO http://i.huffpost.com/gen/1143905/original.jpg
22. ANTI-ANTI-PATTERNS “Ahhh... better!”
23. BECOME A DEVOPS
24. EXTEND YOUR DEV SKILLS
25. S.T.U.P.I.D. S.O.L.I.D.
26. PATTERNS creational behavioral structural
27. TEST-DRIVEN- DEVELOPMENT tests first know “the circle” different tests
28. tests first know “the circle” different tests, are different TEST-DRIVEN- DEVELOPMENT tests first know “the circle” different tests
29. you must walk through hell tests, tests, tests (BDD, Integration tests) branch by abstraction REFACTORING
30. OPEN SOURCE working with upstream do not patch the framework join the community & gather credits
31. SOFTWARE ARCHITECTURE challenge: do it distributed SOA REST
32. KNOW THE PITFALLS wrong expectations “hipster” technologies 2nd system effect
33. GATHER OPS KNOWLEDGE
34. SOME HANDY SHELL KNOWLEDGE you should feel comfy in a terminal #protip: use a terminal in your daily work
35. UPDATE MANAGEMENT version pinning staging systems
36. RISK MANAGEMENT how often does a problem occur? how much is the impact? what is the mean time to repair?
37. PROTOCOLS OF THE WEB HTTP TCP / UDP IP
38. THE 4 BOTTLENECKS
40. 1ns
41. L1 CACHE REFERENCE 1ns
42. L2 CACHE REFERENCE 1ns
43. 1ns MUTEX LOCK/UNLOCK
44. 1ns MAIN MEMORY REF.
45. 1ns MAIN MEMORY REF.
46. 1ns 100ns ~ 0.1μs MAIN MEMORY REF.
47. 1ns 100ns ~ 0.1μs MAIN MEMORY REF.
48. 1ns 100ns ~ 0.1μs SEND 2KB OVER COMMODITY NETWORK
49. 1ns 100ns ~ 0.1μs COMPRESS 1KB/W ZIPPY
50. 1ns 100ns ~ 0.1μs
51. 1ns 100ns ~ 0.1μs
52. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs
53. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs
54. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs READ 1MB SEQ. FROM MEMORY
55. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs READ 1MB SEQ. FROM SSD
56. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs ROUND TRIP IN SAME DATACENTER
57. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs
58. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs
59. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs 1,000,000ns ~ 1ms
60. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs 1,000,000ns ~ 1ms
61. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs 1,000,000ns ~ 1ms READ 1MB SEQ. FROM DISK
62. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs 1,000,000ns ~ 1ms DISK SEEK
63. 1ns 100ns ~ 0.1μs 10,000ns ~ 10μs 1,000,000ns ~ 1ms PACKET ROUNDTRIP CA TO NETHERLANDS
64. http://www.eecs.berkeley.edu/~rcs/research/interactive_latency.html
65. INCIDENT MANAGEMENT what’s the problem? what causes it? how to fix it?
66. BEING ON-CALL keep calm! important things first first in, first out, but...
67. TOPICS YOU MIGHT CARE ABOUT
68. * AS A SERVICE
69. DEPLOYMENT
71. CONTINUOUS DELIVERY Ship when it’s done!
72. CONTINUOUS DEPLOYMENT Shipin’ all the time!
73. PULL DEPLOY Stop pushing, start pulling!
74. STRATEGIES
75. ONE, SOME, MANY
76. ONE, SOME, MANY
77. ONE, SOME, MANY
78. ONE, SOME, MANY
79. GREEN / BLUE
80. METRICS
81. SYSTEM VS. APPLICATION
82. WHAT TO MEASURE?
83. WHAT TO MEASURE? requests
84. WHAT TO MEASURE? requests querys
85. WHAT TO MEASURE? requests querys exceptions
86. WHAT TO MEASURE? requests querys exceptions connections
87. WHAT TO MEASURE? requests querys exceptions connections user
88. WHAT TO MEASURE?
90. MEASURE WHATEVER MAKES FUCKING SENSE!
93. VISUALIZE IT!
94. VISUALIZE IT! #M ONITORINGLOVE
95. AUTOMATION
96. SCALE
97. TOOLS LOVE
98. DATABASES
99. PROGRAMMING LANGUAGES
100. 3RD-PARTY TOOLS
101. QUEUES
103. FAILURE IS GOOD
104. BE AGILE
105. FEEDBACK
106. METHODS
107. KEEP LEARNING
108. THANK YOU! @CodeStars
110. http://nikic.github.io/2011/12/27/Dont-be-STUPID-GRASP-SOLID.html http://en.wikipedia.org/wiki/SOLID_(object-oriented_design) http://www.shutterstock.com http://icomoon.io/app/ http://apievangelist.com/2012/01/12/the-secret-to-amazons-success-internal-apis/ http://en.wikipedia.org/wiki/Structural_pattern http://en.wikipedia.org/wiki/Creational_pattern http://en.wikipedia.org/wiki/Behavioral_pattern http://www.eecs.berkeley.edu/~rcs/research/interactive_latency.html http://bfwa.com/pitfalls/ http://farm9.staticflickr.com/8491/8344781525_5787255ec2_z.jpg http://docs.hostedgraphite.com/_images/sample_dashboard_conc_users_advanced.png http://oss.oetiker.ch/rrdtool/gallery/btdmd8.png http://www.wadsam.com/wp-content/uploads/2012/11/stock-exchagne.jpeg http://s3.amazonaws.com/crunchbase_prod_assets/assets/images/original/0018/2843/182843v2.png http://2.bp.blogspot.com/-t2FW5rx_yn0/TxVwhmqAXgI/AAAAAAAAA7s/DSdFmMZ5ecM/s1600/trading-floor.jpg http://en.wikipedia.org/wiki/Mutual_exclusion Thanks to all the people helped me so much! Elena Ingo Nils Fridel Spring Jimdo! Sources:
111. August 11th – 13th 2014 Same Place, Same Time