Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Ecological Impact of Compute

Seth Vargo
August 19, 2016

The Ecological Impact of Compute

As compute becomes cheaper and more readily available, the costs to our environment cannot go unnoticed. We are increasing energy use at exponential rates by over-provisioning requirements, under-utliizing resources, and clicking buttons in UIs. As a business owner, you want to save costs, but what are the environmental impacts services like AWS and GCE are having on our planet? Tools like Nomad, Kubernetes, and Mesos allow organizations to maximize resource utilization, but can schedulers also be used to help save our planet?

Seth Vargo

August 19, 2016
Tweet

More Decks by Seth Vargo

Other Decks in Technology

Transcript

  1. EVERY 60 SECONDS 15,000 MUSIC DOWNLOADS  350,000 TWITTER TWEETS

     5 MILLION GOOGLE SEARCHES  204 MILLION EMAIL MESSAGES  1.8 MILLION FACEBOOK LIKES  $272,000 AMAZON PURCHASES 
  2. EVERY 60 SECONDS 204 MILLION 5 MILLION 1.8 MILLION 350,000

    $272,000 15,000 EMAIL MESSAGES GOOGLE SEARCHES FACEBOOK LIKES TWITTER TWEETS AMAZON PURCHASES MUSIC DOWNLOADS      
  3. Russia Japan India Germ any Canada France Brazil S. Korea

    UK Italy Spain Taiwan S. Africa Australia M exico Suppresses China and USA
  4. Russia Japan India Germ any Canada France Brazil S. Korea

    UK Italy Spain Taiwan S. Africa Australia M exico Suppresses China and USA 
  5. 1 2 3 4 5 8 9 10 11 12

    7 6 15 16 17 18 19 14 13 22 23 24 25 26 21 20 29 30 28 27 BLACK FRIDAY NEW SERVERS These numbers are fictitious and are not based on statistical evidence; shown for demonstrative purposes only
  6. 1 2 3 4 5 8 9 10 11 12

    7 6 15 16 17 18 19 14 13 22 23 24 25 26 21 20 29 30 28 27 BLACK FRIDAY NEW SERVERS  These numbers are fictitious and are not based on statistical evidence; shown for demonstrative purposes only
  7. 1 2 3 4 5 8 9 10 11 12

    7 6 15 16 17 18 19 14 13 22 23 24 25 26 21 20 29 30 28 27 BLACK FRIDAY NEW SERVERS  – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 These numbers are fictitious and are not based on statistical evidence; shown for demonstrative purposes only
  8. 1 2 3 4 5 8 9 10 11 12

    7 6 15 16 17 18 19 14 13 22 23 24 25 26 21 20 29 30 28 27 BLACK FRIDAY NEW SERVERS  – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 + $10,000 These numbers are fictitious and are not based on statistical evidence; shown for demonstrative purposes only
  9. 1 2 3 4 5 8 9 10 11 12

    7 6 15 16 17 18 19 14 13 22 23 24 25 26 21 20 29 30 28 27 BLACK FRIDAY NEW SERVERS  – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 – $500 + $10,000 – $500 – $500 – $500 – $500 – $500 These numbers are fictitious and are not based on statistical evidence; shown for demonstrative purposes only
  10. An estimated 20-30% of servers in [wholesale] data centers today

    are idle, obsolete, or unused but are still plugged in and consuming energy doing nothing.
  11. IT managers cannot identify owners for 15-30% of the servers,

    but are reluctant to decommission equipment, fearing potential impacts on business or application functions.
  12. WE DON'T GET THE SAME PERFORMANCE ON THE CLOUD MANY

    ORGANIZATIONS DO NOT UNDERSTAND THEIR APPLICATION REQUIREMENTS MYTH FACT
  13. THE CLOUD IS INSECURE – WE HAVE TO BE HIPPA/PCI

    COMPLIANT CLOUD PROVIDERS PAY MILLIONS OF DOLLARS AND HIRE THE MOST EXPERIENCED PROFESSIONALS ON THESE TOPICS. ARE YOU BETTER IF COMPLIANCE IS SOMEONE'S PART-TIME JOB? MYTH FACT
  14. THE CLOUD IS TOO EXPENSIVE FOR MOST USE CASES, IT'S

    PROBABLY CHEAPER AND MORE FLEXIBLE MYTH FACT
  15. WE RUN ON OUR OWN BARE METAL AND ACHIEVE 80%

    UTILIZATION USING A SCHEDULER AND ROUTINELY AUDIT SERVER USAGE USING AN INVENTORY MANAGEMENT SYSTEM. THIS TALK IS NOT FOR YOU, BUT MYTH FACT
  16. I AM ENERGY AND RESOURCE EFFICIENT BECAUSE I AM USING

    A CLOUD PROVIDER YOU ARE IMPOSING LESS OF AN ENVIRONMENTAL IMPACT, BUT YOU MAY NOT BE USING YOUR POOL OF RESOURCES AT BEST CAPACITY MYTH FACT
  17.   Operator Datacenter RUBY PYTHON PYTHON PYTHON GOLANG GOLANG

    GOLANG GOLANG NODE Skywalker Vader Leia Solo
  18.   Operator Datacenter RUBY PYTHON PYTHON PYTHON GOLANG GOLANG

    GOLANG GOLANG NODE Skywalker Vader Leia Solo RUBY VADER LEIA SOLO 192.168.1.4 192.168.1.5 192.168.1.7 192.168.1.253 88:45:13:B6:87:C4 94:CE:4F:C8:54:C3 CA:9A:3D:7F:8B:CB 72:30:9C:0D:1E:74 Randomly kills applications
  19.   Operator Datacenter RUBY PYTHON PYTHON PYTHON GOLANG GOLANG

    GOLANG GOLANG NODE Skywalker Leia Solo RUBY VADER LEIA SOLO 192.168.1.4 192.168.1.5 192.168.1.7 192.168.1.253 88:45:13:B6:87:C4 94:CE:4F:C8:54:C3 CA:9A:3D:7F:8B:CB 72:30:9C:0D:1E:74 Randomly kills applications F F Vader
  20.   Operator Datacenter RUBY PYTHON PYTHON PYTHON GOLANG GOLANG

    GOLANG GOLANG NODE Skywalker Leia Solo RUBY VADER LEIA SOLO 192.168.1.4 192.168.1.5 192.168.1.7 192.168.1.253 88:45:13:B6:87:C4 94:CE:4F:C8:54:C3 CA:9A:3D:7F:8B:CB 72:30:9C:0D:1E:74 Randomly kills applications F F Vader PYTHON PYTHON PYTHON
  21.   Operator Datacenter RUBY GOLANG GOLANG GOLANG GOLANG NODE

    Skywalker Leia Solo RUBY VADER LEIA SOLO 192.168.1.4 192.168.1.5 192.168.1.7 192.168.1.253 88:45:13:B6:87:C4 94:CE:4F:C8:54:C3 CA:9A:3D:7F:8B:CB 72:30:9C:0D:1E:74 Randomly kills applications Vader PYTHON PYTHON PYTHON
  22.   Operator Datacenter RUBY GOLANG GOLANG GOLANG GOLANG NODE

    Skywalker Leia Solo RUBY VADER LEIA SOLO 192.168.1.4 192.168.1.9 192.168.1.7 192.168.1.253 88:45:13:B6:87:C4 94:CE:4F:C8:54:C3 CA:9A:3D:7F:8B:CB 72:30:9C:0D:1E:74 Rebuilt on 04/20/2016 Vader PYTHON PYTHON PYTHON
  23.   Operator Datacenter RUBY GOLANG GOLANG GOLANG GOLANG NODE

    Skywalker Leia Solo RUBY VADER LEIA SOLO 192.168.1.4 192.168.1.9 192.168.1.7 192.168.1.253 88:45:13:B6:87:C4 94:CE:4F:C8:54:C3 CA:9A:3D:7F:8B:CB 72:30:9C:0D:1E:74 Rebuilt on 04/20/2016 Vader PYTHON PYTHON PYTHON
  24. Type Work Resources CPU Scheduler Threads Physical Cores EC2 /

    Nova Virtual Machines Hypervisors Hadoop YARN MapReduce Jobs Client Nodes Cluster Scheduler Applications Machines https://upload.wikimedia.org/wikipedia/commons/a/a0/Cedar_Mtn_Wilderness.jpg
  25. Higher Resource Utilization Decouple Work from Resources Better Quality of

    Service ADVANTAGES https://upload.wikimedia.org/wikipedia/commons/3/38/GiantEagleStowOhio.jpg