Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Rancherでkubeflow構築
Search
nakayamam
March 16, 2019
Technology
3
19k
Rancherでkubeflow構築
Rancher Meetup #07 in Osakaでの発表資料です
nakayamam
March 16, 2019
Tweet
Share
More Decks by nakayamam
See All by nakayamam
rancher/system-toolsを試してみた
nakayamam
0
370
Other Decks in Technology
See All in Technology
KubeCon + CloudNativeCon Japan 2025 Recap
donkomura
0
160
Claude Codeは仕様駆動の夢を見ない
gotalab555
11
1.9k
Rubyの国のPerlMonger
anatofuz
3
730
OPENLOGI Company Profile for engineer
hr01
1
37k
【Λ(らむだ)】最近のアプデ情報 / RPALT20250729
lambda
0
230
【新卒研修資料】数理最適化 / Mathematical Optimization
brainpadpr
25
11k
LLMでAI-OCR、実際どうなの? / llm_ai_ocr_layerx_bet_ai_day_lt
sbrf248
0
430
AI コードレビューが面倒すぎるのでテスト駆動開発で解決しようとして読んだら、根本的に俺の勘違いだった
mutsumix
0
160
Amazon Q Developerを活用したアーキテクチャのリファクタリング
k1nakayama
2
180
JAWS AI/ML #30 AI コーディング IDE "Kiro" を触ってみよう
inariku
3
270
2時間で300+テーブルをデータ基盤に連携するためのAI活用 / FukuokaDataEngineer
sansan_randd
0
130
帳票構造化タスクにおけるLLMファインチューニングの性能評価
yosukeyoshida
1
230
Featured
See All Featured
Become a Pro
speakerdeck
PRO
29
5.5k
Why Our Code Smells
bkeepers
PRO
337
57k
Optimising Largest Contentful Paint
csswizardry
37
3.4k
Side Projects
sachag
455
43k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
31
1.3k
How to train your dragon (web standard)
notwaldorf
96
6.1k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.8k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
283
13k
Thoughts on Productivity
jonyablonski
69
4.8k
Gamification - CAS2011
davidbonilla
81
5.4k
The Pragmatic Product Professional
lauravandoore
36
6.8k
The Art of Programming - Codeland 2020
erikaheidi
54
13k
Transcript
RancherͰkubeflowߏங Rancher Meetup #07 in Osaka Masaki-Nakayama
ࣗݾհ • Masaki-Nakayama @nakayamam2 • KAGOYA JAPAN • Rancher Meetup,
CNJP Kansai
kubeflowʁ IUUQTXXXLVCFqPXPSHEPDTBCPVULVCFqPX
kubeflow? KubernetesͷͨΊͷػցֶशπʔϧΩοτ
kubeflow? ԼهͷํʹΦεεϝ by ެࣜ • TensorFlowϞσϧΛ͞·͟·ͳڥʢϩʔΧϧɺΦϯϓ ϨɺΫϥυͳͲʣͰτϨʔχϯά/ఏڙ͍ͨ͠ • TensorFlowτϨʔχϯάδϣϒΛཧ͢ΔͨΊʹJupyter ϊʔτϒοΫΛ͍͍ͨ
• TensorFlowΛଞͷϓϩηεͱΈ߹Θ͍ͤͨ
kubeflow? kubeflowͷμογϡϘʔυ
kubeflow? Լهͷͷ͕͋Β͔͡Ίೖ͍ͬͯ·͢ • JupyterHub : Jupyter NotebookʹϢʔβʔೝূՃͯ͠ෳਓͰ͑ΔΑ ͏ʹͨ͠ͷ • TFjob
Dashboard: k8sͰTensorFlowτϨʔχϯάδϣϒΛཧͰ͖Δ • Katib Dashboard: ϋΠύʔύϥϝʔλʔνϡʔχϯάͷπʔϧ https://www.slideshare.net/Oshima0x3fd/katib ͕ৄͦ͠͏
ߏங·ͰಓͷΓͦ͏ɾɾɾ
͋ΔRancherΧλϩάΛݟ͍ͯΔͱɾɾ
͋ʂ
None
͔ͯ͠͠Chainer͙͑͢Δɾɾɾʁ
ྲྀΕ 1. GPUΫϥελʔͷߏங on GKE 2. ΫϥελʔΛRancherΠϯϙʔτ 3. RancherΧλϩάͰkubeflowσϓϩΠ ※ͪͳΈʹGKEʹೖΕΔ͚ͩͳΒઐ༻ͷϫϯΫϦοΫσϓϩΠ͕༻ҙ͞ΕͯΔͷͰ
ͦͪΒΛ͏ํ͕ૣ͍͔ https://deploy.kubeflow.cloud/#/
GPUΫϥελʔͷߏங on GKE
GPUબΜͰ࡞ KZVQZUFSIVC͕Ϧιʔε Λ৯͏ͷͰεϖοΫ͕͋ Μ·Γ͍ͱࢮʹ·͢
GPUΫϥελʔ͕Ͱ͖·ͨ͠
ΫϥελʔΛ RancherΠϯϙʔτ
None
ࣗݾॺ໊ͳͷͰͪ͜Β Λ࣮ߦ DMVTUFSBENJOΛϢʔβʔ ʹCJOEJOH
ΠϯϙʔτͰ͖·ͨ͠
RancherΧλϩάͰ kubeflowσϓϩΠ
None
֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ
֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ
None
6*
None
Ϣʔβʔ࡞͢Δ
ΠϝʔδΛࢦఆͯ͠TQBXO
ϫʔΫεϖʔε͕࡞͞ΕΔ
ϫʔΫεϖʔε͕ग़དྷ্͕Δ
QZUIPOίʔυΛ͙࣮͢ߦͰ͖Δ
None
UFOTPSqPXͷδϣϒͷ࡞͕Ͱ͖Δ
> kubectl get crd NAME AGE backendconfigs.cloud.google.com 2h scalingpolicies.scalingpolicy.kope.io 2h
studyjobs.kubeflow.org 1h tfjobs.kubeflow.org 1h ͋Εɺchainer operator͕͍ͳ͍ɾɾɾ
None
{"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-rbac.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702047111Z"}
{"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-crd.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702898257Z"} {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-operator.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702904447Z"} RancherαʔόʔͷϩάΛݟΔͱ Ͳ͏manifestʹө͞Ε͍ͯͳ͍Α͏ͩ
issueग़͠ͱ͖·ͨ͠ʂ
Thanks!