Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
KubeflowではじめるML on Kubernetes #1 Kubeflowの概要とセッ...
Search
Keita Watanabe
August 17, 2022
1
420
KubeflowではじめるML on Kubernetes #1 Kubeflowの概要とセットアップ
Keita Watanabe
August 17, 2022
Tweet
Share
More Decks by Keita Watanabe
See All by Keita Watanabe
AWS Summit New York 2024: CMP 301 Demystifying the ML software stack on Amazon EC2 accelerated instances
keitaw
0
85
re:Invent 2023 CMP319 Deploy LLMs with AWS Inferentia & Ray to optimize performance and cost
keitaw
0
10
re:Invent 2023: CMP332 De-mystifying ML software stack on Amazon EC2 accelerated instances
keitaw
0
37
AWS における LLM・GenAI 大規模学習への取り組み / Large scale GenAI・LLM training on AWS
keitaw
1
470
Amazon EC2 シリコン革命 / Amazon EC2 Silicon Innovation
keitaw
0
150
Introduction to Kserve
keitaw
0
360
ML on Kubernetes with Kubeflow #4 Kubeflow Pipelines: Part2
keitaw
0
1.1k
Practical guide on PyTorch inference using AWS Inferentia
keitaw
0
180
ML on Kubernetes with Kubeflow #3 Kubeflow Pipelines: Part1
keitaw
0
1k
Featured
See All Featured
Automating Front-end Workflow
addyosmani
1365
200k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
227
52k
Bootstrapping a Software Product
garrettdimon
PRO
304
110k
Product Roadmaps are Hard
iamctodd
PRO
48
10k
A Modern Web Designer's Workflow
chriscoyier
691
190k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
278
13k
No one is an island. Learnings from fostering a developers community.
thoeni
18
2.9k
Optimising Largest Contentful Paint
csswizardry
30
2.8k
The World Runs on Bad Software
bkeepers
PRO
64
11k
Building a Scalable Design System with Sketch
lauravandoore
458
32k
Navigating Team Friction
lara
183
13k
A Tale of Four Properties
chriscoyier
155
22k
Transcript
Keita Watanabe Kubernetes Meetup Tokyo # 52 LT KubeflowͰ͡ΊΔ ML
on Kubernetes #1 Kube fl owͷ֓ཁͱηοτΞοϓ
Keita Watanabe Machine Learning Solutions Architect ▶ Self-managedͳMachine LearningͷWorkload Λ୲͍ͯ͠ΔSA
▶ લ৬ͰDatascientist/ML Researcherͱͯ͠ ECαΠτ্ͷը૾ݕࡧػೳͷ։ൃʹैࣄ ▶ Twitter: keitaw09 ▶ Linkedin: keitawatanabe ▶ ݱॴଐ: AWS Japan αϯσΟΤΰͰग़ձͬͨτϦ झຯ
Kubeflowͱ Machine Learning Model-Development Lifecycle (MDLC)ͷ ֤εςοϓʢ+ύΠϓϥΠϯʣΛΧόʔ͢ΔToolͷू·Γ KubeflowΛ࠾༻͢ΔϝϦοτ Composability: ༻్ʹԠͯ͡ඞཁͳComponentsΛΓग़ͯ͠༻͍Δ͜ͱ͕Ͱ͖Δ
Portability: Vendor lock-inΛආ͚Δ͜ͱ͕Ͱ͖Δ Scalability: ෛՙʹԠͯ͡Container/NodeΛεέʔϧ͢Δ͜ͱ͕Ͱ͖Δ
Kubeflow overview Central Dashboard Data Ingestion Data Analysis Data Transform
Data Validation Training AutoML Model eval. and valid. Serving Logging KServe Seldon Kube fl ow Pipelines Kube fl ow Notebooks Katib Training Operators MDLCͷ֤εςοϓ ରԠ͢ΔTool
Kubeflow overview Central Dashboard Data Ingestion Data Analysis Data Transform
Data Validation Training AutoML Model eval. and valid. Serving Logging KServe Seldon Kube fl ow Pipelines Kube fl ow Notebooks Katib Training Operators MDLCͷ֤εςοϓ ରԠ͢ΔTool ࠓΔ͜ͱ: Kube fl owͷηοτΞοϓ
Kubeflow setup Amazon EKS্ͰͷKube fl owڥͷߏங • git • kubectl
• eksctl • kustomize • ࠓճAWS Cloud9্Ͱ࡞ۀ͠·͢ cf. https://www.eksworkshop.com/ 020_prerequisites/workspace/ Prerequisites
Demo
Kubeflow setup
To be
࣍ճ…
ࢀߟࢿྉ • https://www.eksworkshop.com/020_prerequisites/workspace/ • https://www.kube fl ow.org/docs/components/ • https://awslabs.github.io/kube fl
ow-manifests/docs/deployment/vanilla/guide/ • https://www.oreilly.com/library/view/kube fl ow-for-machine/9781492050117/