FOSDEM'14 - Autoscaling Best Practices

Transcript

1. Autoscaling Best Practices FOSDEM’14 Marc Cluet DevOps & Automation Advisory Rackspace http://www.flickr.com/photos/gozalewis/3422530465/
2. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Who am I?! Marc Cluet (@lynxman) More than 16 years of experience as a SysAdmin Founding member of Juju and MAAS while at Canonical Leading a DevOps Engineering Team at Rackspace Likes DevOps, programming and long walks on the beach
3. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Rackspace?! Founded in 1998 in San Antonio, TX by three guys that wanted to create a hosting company Home of Fanatical Support /o/ Second biggest Public Cloud in the world OpenStack Project co-founder
4. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Autoscaling?!
5. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Autoscaling?! WASTED! $$$!
6. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Autoscaling?!
7. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK What is Autoscaling?! The ability to automatically or semi- automatically scale up and down a group of servers based on computing or traffic demand by provisioning new services!
8. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/fischerfotos/7419253200/
9. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns!
10. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns! ON & OFF! Analytics! Banks/Tax Agencies! Test environments!
11. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns! FAST GROWTH! Events! Business Growth! Slashdot Effect!
12. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns! VARIABLE! News & Media! Event Registrations! Rapid fire sales!
13. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Traffic Patterns! CONSISTENT! HR Application! Accounting/Finance! E-mail!
14. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/maximalideal/3356408693/
15. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Methodologies! Time Based! Reactive! Predictive!
16. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! Load Balancer Server Server
17. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! Load Balancer Server Server 9:00am!
18. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! Load Balancer Server Server Nov 1st!
19. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! Load Balancer Server Server Server
20. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Time Based Autoscaling! GOOD FOR! On & Off! Consistent!
21. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 60% Server 60%
22. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 80% Server 80%
23. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 60% Server 60% Server 40%
24. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 30% Server 30% Server 30%
25. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! Load Balancer Server 45% Server 45%
26. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Reactive Autoscaling! GOOD FOR! Fast Growth! Variable!
27. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Predictive Autoscaling! Load Balancer Server Server
28. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Predictive Autoscaling! Load Balancer Server Server Forecasted! Traffic! +30%!
29. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Predictive Autoscaling! Load Balancer Server Server Server
30. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Predictive Autoscaling! GOOD FOR! Fast Growth! Variable!
31. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/samuraislice/3309481048/
32. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools!
33. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Amazon Cloudformation! Based on Scaling Groups! High/Low Watermark! Scheduled Events! Uses base image + CF!
34. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Rackspace Autoscale! Based on Scaling Groups! High/Low Watermark! Scheduled Events! Uses Gold Image!
35. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Rightscale Autoscale! Based on Scaling Groups! High/Low Watermark Quorum! Scheduled Events! Uses Rightscale scripts! $$$!
36. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Heat! Based on Templates! High/Low Watermark! Scheduled Events! Uses Heat Scripts! DSL Compatible with CF!
37. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Scryer! Based on AI! Predictive Fidelity model! Feeds AWS API!
38. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Your own!! Collect your metrics! !collectd, diamond, statsd! Have a good metrics database! !whisper, rrd!
39. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Autoscaling Tools! Your own!! Write your own autoscaling code! !with message queues! :)! !attached to your code! !brain close to the centre of decision!
40. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/68751915@N05/6355318323/
41. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Taking the most of it! Beware of the Kraken!! Autoscaling can be dangerous! Have min-max allocations! http://www.flickr.com/photos/liquidnight/5992114196/
42. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Taking the most of it! Choose the right metrics! Stay with basic metrics! !CPU, mem, I/O disk/net! Review autoscaling strategy with metrics!
43. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Taking the most of it! Choose your strategy! Scale up early! Scale down slowly! Don’t apply the same strategy to all apps!
44. RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK Taking the most of it! Phasing in and Phasing Out! Have in mind time to availability! Have in mind also decommission time! Golden Images can help speed!
45. 45 RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.CO.UK RACKSPACE® HOSTING | 5 MILLINGTON ROAD | HAYES, UNITED KINGDOM UB3 4AZ UK SALES: +44 (0)20 8712 6507 | UK SUPPORT: 0800 988 0300 | WWW.RACKSPACE.CO.UK @lynxman! http://slideshare.net/lynxmanuk/! http://www.rackspace.co.uk/technicalservices/ ! !