KubeflowではじめるML on Kubernetes #1 Kubeflowの概要とセットアップ

Transcript

1. Keita Watanabe Kubernetes Meetup Tokyo # 52 LT KubeflowͰ͸͡ΊΔ
 ML on Kubernetes #1 Kube fl owͷ֓ཁͱηοτΞοϓ
2. Keita Watanabe Machine Learning Solutions Architect ▶ Self-managedͳMachine LearningͷWorkload
 Λ୲౰͍ͯ͠ΔSA ▶ લ৬Ͱ͸Datascientist/ML Researcherͱͯ͠
 ECαΠτ্ͷը૾ݕࡧػೳͷ։ൃʹैࣄ ▶ Twitter: keitaw09 ▶ Linkedin: keitawatanabe ▶ ݱॴଐ: AWS Japan αϯσΟΤΰͰग़ձͬͨτϦ झຯ
3. Kubeflowͱ͸ Machine Learning Model-Development Lifecycle (MDLC)ͷ
 ֤εςοϓʢ+ύΠϓϥΠϯʣΛΧόʔ͢ΔToolͷू·Γ KubeflowΛ࠾༻͢ΔϝϦοτ Composability: ༻్ʹԠͯ͡ඞཁͳComponentsΛ੾Γग़ͯ͠༻͍Δ͜ͱ͕Ͱ͖Δ Portability: Vendor lock-inΛආ͚Δ͜ͱ͕Ͱ͖Δ Scalability: ෛՙʹԠͯ͡Container/NodeΛεέʔϧ͢Δ͜ͱ͕Ͱ͖Δ
4. Kubeflow overview Central Dashboard Data Ingestion Data Analysis Data Transform Data Validation Training AutoML Model eval. and valid. Serving Logging KServe Seldon Kube fl ow Pipelines Kube fl ow Notebooks Katib Training Operators MDLCͷ֤εςοϓ ରԠ͢ΔTool
5. Kubeflow overview Central Dashboard Data Ingestion Data Analysis Data Transform Data Validation Training AutoML Model eval. and valid. Serving Logging KServe Seldon Kube fl ow Pipelines Kube fl ow Notebooks Katib Training Operators MDLCͷ֤εςοϓ ରԠ͢ΔTool ࠓ೔΍Δ͜ͱ: Kube fl owͷηοτΞοϓ
6. Kubeflow setup Amazon EKS্ͰͷKube fl ow؀ڥͷߏங • git • kubectl • eksctl • kustomize • ࠓճ͸AWS Cloud9্Ͱ࡞ۀ͠·͢
 cf. https://www.eksworkshop.com/ 020_prerequisites/workspace/ Prerequisites
7. Demo
8. Kubeflow setup
9. To be
10. ࣍ճ͸…
11. ࢀߟࢿྉ • https://www.eksworkshop.com/020_prerequisites/workspace/ • https://www.kube fl ow.org/docs/components/ • https://awslabs.github.io/kube fl ow-manifests/docs/deployment/vanilla/guide/ • https://www.oreilly.com/library/view/kube fl ow-for-machine/9781492050117/