Rancherでkubeflow構築

Rancher Meetup #07 in Osakaでの発表資料です

Transcript

1. RancherͰkubeflowߏங Rancher Meetup #07 in Osaka Masaki-Nakayama
2. ࣗݾ঺հ • Masaki-Nakayama @nakayamam2 • KAGOYA JAPAN • Rancher Meetup, CNJP Kansai
3. kubeflowʁ IUUQTXXXLVCFqPXPSHEPDTBCPVULVCFqPX
4. kubeflow? KubernetesͷͨΊͷػցֶशπʔϧΩοτ
5. kubeflow? ԼهͷํʹΦεεϝ by ެࣜ • TensorFlowϞσϧΛ͞·͟·ͳ؀ڥʢϩʔΧϧɺΦϯϓ ϨɺΫϥ΢υͳͲʣͰτϨʔχϯά/ఏڙ͍ͨ͠ • TensorFlowτϨʔχϯάδϣϒΛ؅ཧ͢ΔͨΊʹJupyter ϊʔτϒοΫΛ࢖͍͍ͨ • TensorFlowΛଞͷϓϩηεͱ૊Έ߹Θ͍ͤͨ
6. kubeflow? kubeflowͷμογϡϘʔυ
7. kubeflow? Լهͷ΋ͷ͕͋Β͔͡Ίೖ͍ͬͯ·͢ • JupyterHub : Jupyter NotebookʹϢʔβʔೝূ௥Ճͯ͠ෳ਺ਓͰ࢖͑ΔΑ ͏ʹͨ͠΋ͷ • TFjob Dashboard: k8sͰTensorFlowτϨʔχϯάδϣϒΛ؅ཧͰ͖Δ • Katib Dashboard: ϋΠύʔύϥϝʔλʔνϡʔχϯάͷπʔϧ https://www.slideshare.net/Oshima0x3fd/katib ͕ৄͦ͠͏
8. ߏங·ͰಓͷΓ͸௕ͦ͏ɾɾɾ
9. ͋Δ೔RancherΧλϩάΛݟ͍ͯΔͱɾɾ
10. ͋ʂ
12. ΋͔ͯ͠͠Chainer΋͙͢࢖͑Δɾɾɾʁ
13. ྲྀΕ 1. GPUΫϥελʔͷߏங on GKE 2. ΫϥελʔΛRancher΁Πϯϙʔτ 3. RancherΧλϩάͰkubeflowσϓϩΠ ※ͪͳΈʹGKEʹೖΕΔ͚ͩͳΒઐ༻ͷϫϯΫϦοΫσϓϩΠ͕༻ҙ͞ΕͯΔͷͰ ͦͪΒΛ࢖͏ํ͕ૣ͍͔΋ https://deploy.kubeflow.cloud/#/
14. GPUΫϥελʔͷߏங on GKE
15. GPUબΜͰ࡞੒ KZVQZUFS
    IVC͕Ϧιʔε Λ৯͏ͷͰεϖοΫ͕͋ Μ·Γ௿͍ͱࢮʹ·͢
16. GPUΫϥελʔ͕Ͱ͖·ͨ͠
17. ΫϥελʔΛ Rancher΁Πϯϙʔτ
19. ࣗݾॺ໊ͳͷͰͪ͜Β Λ࣮ߦ DMVTUFSBENJOΛϢʔβʔ ʹCJOEJOH
20. ΠϯϙʔτͰ͖·ͨ͠
21. RancherΧλϩάͰ kubeflowσϓϩΠ
23. ֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ
24. ֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ
26. 6*
28. Ϣʔβʔ࡞੒͢Δ
29. ΠϝʔδΛࢦఆͯ͠TQBXO
30. ϫʔΫεϖʔε͕࡞੒͞ΕΔ
31. ϫʔΫεϖʔε͕ग़དྷ্͕Δ
32. QZUIPOίʔυΛ͙࣮͢ߦͰ͖Δ
34. UFOTPSqPXͷδϣϒͷ࡞੒͕Ͱ͖Δ
35. > kubectl get crd NAME AGE backendconfigs.cloud.google.com 2h scalingpolicies.scalingpolicy.kope.io 2h studyjobs.kubeflow.org 1h tfjobs.kubeflow.org 1h ͋Εɺchainer operator͕͍ͳ͍ɾɾɾ
37. {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-rbac.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702047111Z"} {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-crd.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702898257Z"} {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-operator.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702904447Z"} RancherαʔόʔͷϩάΛݟΔͱ Ͳ͏΋manifestʹ൓ө͞Ε͍ͯͳ͍Α͏ͩ
38. issueग़͠ͱ͖·ͨ͠ʂ
39. Thanks!