Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scaling Machine Learning in the Cloud with Kube...

Scaling Machine Learning in the Cloud with Kubernetes

Building any production-ready machine learning system is complex. You have to manage services and tools that often don’t play nice with each other. And when they do you have to spend time manually tweaking deployments and hand rolling solutions before a single model can be tested. Worse, these hand-rolled solutions are so tied to your production cluster that it’s impossible to run your code locally making it even harder to spot bugs.

In this workshop, you’ll learn how to leverage Kubernetes to deploying complex workloads in the cloud, on bare metal and locally. You’ll learn how Kubernetes provides a fast iteration cycle, flexible scalability, and a lack of boilerplate which makes it ideal for most of the machine learning experiments.

Daniele Polencic

July 06, 2018
Tweet

More Decks by Daniele Polencic

Other Decks in Technology

Transcript

  1. ◻ big data ◻ scale with team and model ◻

    cost for money ◻ quick fix
  2. ❌ big data ◻ scale with team and model ◻

    cost for money ◻ quick fix
  3. ❌ big data ❌ scale with team and model ◻

    cost for money ◻ quick fix
  4. ❌ big data ❌ scale with team and model ❌

    cost for money ◻ quick fix
  5. ❌ big data ❌ scale with team and model ❌

    cost for money ✅ quick fix
  6. Training Data Test Data Model Evaluate Data collection Configuration Feature

    extraction Data verification Machine resource management
  7. Training Data Test Data Model Evaluate Data collection Configuration Feature

    extraction Data verification Serving Infrastructure Machine resource management
  8. Training Data Test Data Model Evaluate Data collection Configuration Feature

    extraction Data verification Serving Infrastructure Monitoring Machine resource management
  9. Training Data Test Data Model Evaluate Data collection Configuration Feature

    extraction Data verification Serving Infrastructure Monitoring Analysis tools Machine resource management
  10. Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation

    v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4
  11. Churn rate v1 Churn rate v2 Churn rate v3 Churn

    rate v4 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4
  12. Churn rate v1 Churn rate v2 Churn rate v3 Churn

    rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Monday
  13. Churn rate v1 Churn rate v2 Churn rate v3 Churn

    rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Monday Tuesday
  14. Churn rate v1 Churn rate v2 Churn rate v3 Churn

    rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Monday Tuesday Wednesday
  15. Churn rate v1 Churn rate v2 Churn rate v3 Churn

    rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Monday Tuesday Wednesday Thursday
  16. Churn rate v1 Churn rate v2 Churn rate v3 Churn

    rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Monday Tuesday Wednesday Thursday Friday
  17. Churn rate v1 Churn rate v2 Churn rate v3 Churn

    rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Monday Tuesday Wednesday Thursday Friday Saturday
  18. Churn rate v1 Churn rate v2 Churn rate v3 Churn

    rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Churn rate v1 Churn rate v2 Churn rate v3 Churn rate v1 Recommendation Antispam Churn rate v1 Recommendation v1 Recommendation v2 Recommendation v3 Recommendation v4 Antispam Antispam v2 Antispam v3 Antispam v4 Monday Tuesday Wednesday Thursday Sunday Friday Saturday
  19. !

  20. ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁

    ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁ ☁
  21. rent fleet of machine by the hour mixed nodes w/

    cpus , gpus , tpus scale with the team
  22. rent fleet of machine by the hour mixed nodes w/

    cpus , gpus , tpus scale with the team
  23. rent fleet of machine by the hour mixed nodes w/

    cpus , gpus , tpus scale with the company
  24. !

  25. 2

  26. 2

  27. 2

  28. 2

  29. 2

  30. https://learnk8s.io/infiniteconf2018 1. test locally 2. create a container 3. deploy

    to the cluster 4. hyperparameters sweeping 5. serve you model
  31. 2. learn k8s · master applications deployment and scaling ·

    ! kubernetes for developers · CKA/CKAD
  32. 3. build a poc · use a cloud provider ·

    research small project · move fast, break things™
  33. events · Workshop taster @ Skills Matter, 23rd of July

    · progNET — Use Kubernetes to Deploy .NET Applications, 13th of Sept · LJC — Autoscaling applications with k8s and Spring Boot, 25th of Sept