DevTools at Etsy

Overview of the DevTools team at Etsy and how we foster collaboration between Dev and Ops. Presented at DevOpsDays Berlin 2013

Transcript

1. DevTools at Etsy Daniel Schauenberg dschauenberg@etsy.com @mrtazz Monday, May 27, 13
2. Monday, May 27, 13
3. Item by FrankelPhotos Monolithic App Monday, May 27, 13
4. 40 deploys/day 150 committers Monday, May 27, 13
5. ~150 Developers/Designers ~15 Ops Engineers Monday, May 27, 13
6. Monday, May 27, 13
7. Item by JustBeckett Monday, May 27, 13
8. Item by XDcreationz Monday, May 27, 13
9. DevTools • Part of the Infrastructure team • 5 Engineers • SysAdmin and Development background • <3 debugging Monday, May 27, 13
10. Monday, May 27, 13
11. Deployinator Monday, May 27, 13
12. Monday, May 27, 13
13. "Devtools makes this stuff so easy it's almost hilarious, so thank you!" Laurie Denness, 2013 Monday, May 27, 13
14. https://github.com/etsy/deployinator Monday, May 27, 13
15. Developer VMs • KVM • Dev version of full Etsy stack • Chef • DevTools Monday, May 27, 13
16. Jenkins Slaves a.k.a. The Bobs • LXC containers on buildtests • Used for CI and Try • Labels for heavy/any execution • One heavy executor per disk Monday, May 27, 13
17. Monday, May 27, 13
18. DevDB Proxy • Access production data in a safe way • Don't test and develop on outdated data • Don't bring the site down by connecting to a production server with a GUI db client Monday, May 27, 13
19. StatsD/Logster/Graphite deploy lines deploy lines Monday, May 27, 13
20. https://github.com/etsy/statsd https://github.com/etsy/logster https://github.com/etsy/dashboard Monday, May 27, 13
21. Supergrep Monday, May 27, 13
22. https://github.com/etsy/supergrep Monday, May 27, 13
23. Schema Changes • Sharded MySQL Master-Master pairs • Config file to control which sides to use • 4 config pushes • Artisanal shell script Monday, May 27, 13
24. Monday, May 27, 13
25. % review -r dschauenberg Monday, May 27, 13
26. automatically assigned automatically assigned Monday, May 27, 13
27. Monday, May 27, 13
28. The “DevOps” Team Monday, May 27, 13
29. NOPE Monday, May 27, 13
30. Monday, May 27, 13
31. export PATH=$PATH:~/development/DevTools Monday, May 27, 13
32. Summary • Fostering collaboration through tooling • Tools can increase but not force collaboration • Caretaker for tooling • Hug it out Monday, May 27, 13
33. codeascraft.etsy.com www.etsy.com/codeascraft/talks etsy.github.com www.etsy.com/careers Monday, May 27, 13
34. Questions? Monday, May 27, 13
35. DevTools at Etsy Daniel Schauenberg dschauenberg@etsy.com @mrtazz Monday, May 27, 13