Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Rancherでkubeflow構築

Avatar for nakayamam nakayamam
March 16, 2019
Technology
19k
3

 Rancherでkubeflow構築

Rancher Meetup #07 in Osakaでの発表資料です

Avatar for nakayamam

nakayamam

March 16, 2019

More Decks by nakayamam

See All by nakayamam
rancher/system-toolsを試してみた
Avatar for nakayamam nakayamam
0
400

Other Decks in Technology

See All in Technology
ソフトウェアアーキテクチャ研修【MIXI 26新卒技術研修】
Avatar for MIXI ENGINEERS mixi_engineers
PRO
2
1k
AI研修(Day2)【MIXI 26新卒技術研修】
Avatar for MIXI ENGINEERS mixi_engineers
PRO
2
1.6k
新しい SLO が良い感じにハマっている話
Avatar for kaita z63d
1
1.3k
信頼できるテスティングAIをどう育てるか？
Avatar for odan tomohiro odan611
0
170
害獣害虫を自動判別！ ペストコントロール支援ビジネス成功のヒント【SORACOM Discovery 2026】
Avatar for SORACOM（ソラコム） soracom
PRO
0
130
AIエージェントに財布を渡す日 ― 承認付き"買い物エージェント"を作って実演
Avatar for Yuuki Yamashita yama3133
0
110
コンポーネント名には何を含めるべきなのか？ / what-should-be-included-in-component-names
Avatar for airRnot airrnot1106
0
200
オートマトンと字句解析でRoslynを読む
Avatar for tomokusaba tomokusaba
0
130
reFACToring
Avatar for moznion moznion
1
1k
Retriever と Reranker、結局どうする？
Avatar for hkazuakey kazuaki
1
530
検索技術知識0のエンジニアが広告検索システムを内製化して運用するまで
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
170
基調講演：人とAIをつなぐIoTの今と未来 ー 「フィジカル」と「デジタル」が出会うその先へ【SORACOM Discovery 2026】
Avatar for SORACOM（ソラコム） soracom
PRO
0
360

Featured

See All Featured
BBQ
Avatar for Matthew Crist matthewcrist
89
10k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
3k
Navigating Algorithm Shifts & AI Overviews - #SMXNext
Avatar for Aleyda Solis aleyda
1
1.5k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.9k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
940
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
225
10k
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
230
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
1.4k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
230
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.7k
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
370
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
8
36k

Transcript

  1. RancherͰkubeflowߏங Rancher Meetup #07 in Osaka Masaki-Nakayama

  2. ࣗݾ঺հ • Masaki-Nakayama @nakayamam2 • KAGOYA JAPAN • Rancher Meetup,

    CNJP Kansai

  3. kubeflowʁ IUUQTXXXLVCFqPXPSHEPDTBCPVULVCFqPX

  4. kubeflow? KubernetesͷͨΊͷػցֶशπʔϧΩοτ

  5. kubeflow? ԼهͷํʹΦεεϝ by ެࣜ • TensorFlowϞσϧΛ͞·͟·ͳ؀ڥʢϩʔΧϧɺΦϯϓ ϨɺΫϥ΢υͳͲʣͰτϨʔχϯά/ఏڙ͍ͨ͠ • TensorFlowτϨʔχϯάδϣϒΛ؅ཧ͢ΔͨΊʹJupyter ϊʔτϒοΫΛ࢖͍͍ͨ

    • TensorFlowΛଞͷϓϩηεͱ૊Έ߹Θ͍ͤͨ

  6. kubeflow? kubeflowͷμογϡϘʔυ

  7. kubeflow? Լهͷ΋ͷ͕͋Β͔͡Ίೖ͍ͬͯ·͢ • JupyterHub : Jupyter NotebookʹϢʔβʔೝূ௥Ճͯ͠ෳ਺ਓͰ࢖͑ΔΑ ͏ʹͨ͠΋ͷ • TFjob

    Dashboard: k8sͰTensorFlowτϨʔχϯάδϣϒΛ؅ཧͰ͖Δ • Katib Dashboard: ϋΠύʔύϥϝʔλʔνϡʔχϯάͷπʔϧ https://www.slideshare.net/Oshima0x3fd/katib ͕ৄͦ͠͏

  8. ߏங·ͰಓͷΓ͸௕ͦ͏ɾɾɾ

  9. ͋Δ೔RancherΧλϩάΛݟ͍ͯΔͱɾɾ

  10. ͋ʂ

  11. None

  12. ΋͔ͯ͠͠Chainer΋͙͢࢖͑Δɾɾɾʁ

  13. ྲྀΕ 1. GPUΫϥελʔͷߏங on GKE 2. ΫϥελʔΛRancher΁Πϯϙʔτ 3. RancherΧλϩάͰkubeflowσϓϩΠ ※ͪͳΈʹGKEʹೖΕΔ͚ͩͳΒઐ༻ͷϫϯΫϦοΫσϓϩΠ͕༻ҙ͞ΕͯΔͷͰ

    ͦͪΒΛ࢖͏ํ͕ૣ͍͔΋ https://deploy.kubeflow.cloud/#/

  14. GPUΫϥελʔͷߏங on GKE

  15. GPUબΜͰ࡞੒ KZVQZUFSIVC͕Ϧιʔε Λ৯͏ͷͰεϖοΫ͕͋ Μ·Γ௿͍ͱࢮʹ·͢

  16. GPUΫϥελʔ͕Ͱ͖·ͨ͠

  17. ΫϥελʔΛ Rancher΁Πϯϙʔτ

  18. None

  19. ࣗݾॺ໊ͳͷͰͪ͜Β Λ࣮ߦ DMVTUFSBENJOΛϢʔβʔ ʹCJOEJOH

  20. ΠϯϙʔτͰ͖·ͨ͠

  21. RancherΧλϩάͰ kubeflowσϓϩΠ

  22. None

  23. ֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ

  24. ֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ

  25. None

  26. 6*

  27. None

  28. Ϣʔβʔ࡞੒͢Δ

  29. ΠϝʔδΛࢦఆͯ͠TQBXO

  30. ϫʔΫεϖʔε͕࡞੒͞ΕΔ

  31. ϫʔΫεϖʔε͕ग़དྷ্͕Δ

  32. QZUIPOίʔυΛ͙࣮͢ߦͰ͖Δ

  33. None

  34. UFOTPSqPXͷδϣϒͷ࡞੒͕Ͱ͖Δ

  35. > kubectl get crd NAME AGE backendconfigs.cloud.google.com 2h scalingpolicies.scalingpolicy.kope.io 2h

    studyjobs.kubeflow.org 1h tfjobs.kubeflow.org 1h ͋Εɺchainer operator͕͍ͳ͍ɾɾɾ
  36. None

  37. {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-rbac.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702047111Z"}

    {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-crd.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702898257Z"} {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-operator.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702904447Z"} RancherαʔόʔͷϩάΛݟΔͱ Ͳ͏΋manifestʹ൓ө͞Ε͍ͯͳ͍Α͏ͩ

  38. issueग़͠ͱ͖·ͨ͠ʂ

  39. Thanks!