Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Rancherでkubeflow構築
Search
nakayamam
March 16, 2019
Technology
3
19k
Rancherでkubeflow構築
Rancher Meetup #07 in Osakaでの発表資料です
nakayamam
March 16, 2019
Tweet
Share
More Decks by nakayamam
See All by nakayamam
rancher/system-toolsを試してみた
nakayamam
0
380
Other Decks in Technology
See All in Technology
AIとTDDによるNext.js「隙間ツール」開発の実践
makotot
5
690
[CVPR2025論文読み会] Linguistics-aware Masked Image Modelingfor Self-supervised Scene Text Recognition
s_aiueo32
0
210
microCMS 最新リリース情報(microCMS Meetup 2025)
microcms
0
100
kintone開発チームの紹介
cybozuinsideout
PRO
0
73k
モダンフロントエンド 開発研修
recruitengineers
PRO
2
320
トヨタ生産方式(TPS)入門
recruitengineers
PRO
2
220
認知戦の理解と、市民としての対抗策
hogehuga
0
340
実践アプリケーション設計 ①データモデルとドメインモデル
recruitengineers
PRO
2
240
AIエージェント就活入門 - MCPが履歴書になる未来
eltociear
0
500
知られざるprops命名の慣習 アクション編
uhyo
10
2.5k
新卒(ほぼ)専業Kagglerという選択肢
nocchi1
1
2.3k
TypeScript入門
recruitengineers
PRO
16
4.2k
Featured
See All Featured
Why Our Code Smells
bkeepers
PRO
338
57k
Scaling GitHub
holman
462
140k
Designing for humans not robots
tammielis
253
25k
Large-scale JavaScript Application Architecture
addyosmani
512
110k
Raft: Consensus for Rubyists
vanstee
140
7.1k
The Art of Programming - Codeland 2020
erikaheidi
55
13k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.8k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Automating Front-end Workflow
addyosmani
1370
200k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
36
2.5k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
33
2.4k
Transcript
RancherͰkubeflowߏங Rancher Meetup #07 in Osaka Masaki-Nakayama
ࣗݾհ • Masaki-Nakayama @nakayamam2 • KAGOYA JAPAN • Rancher Meetup,
CNJP Kansai
kubeflowʁ IUUQTXXXLVCFqPXPSHEPDTBCPVULVCFqPX
kubeflow? KubernetesͷͨΊͷػցֶशπʔϧΩοτ
kubeflow? ԼهͷํʹΦεεϝ by ެࣜ • TensorFlowϞσϧΛ͞·͟·ͳڥʢϩʔΧϧɺΦϯϓ ϨɺΫϥυͳͲʣͰτϨʔχϯά/ఏڙ͍ͨ͠ • TensorFlowτϨʔχϯάδϣϒΛཧ͢ΔͨΊʹJupyter ϊʔτϒοΫΛ͍͍ͨ
• TensorFlowΛଞͷϓϩηεͱΈ߹Θ͍ͤͨ
kubeflow? kubeflowͷμογϡϘʔυ
kubeflow? Լهͷͷ͕͋Β͔͡Ίೖ͍ͬͯ·͢ • JupyterHub : Jupyter NotebookʹϢʔβʔೝূՃͯ͠ෳਓͰ͑ΔΑ ͏ʹͨ͠ͷ • TFjob
Dashboard: k8sͰTensorFlowτϨʔχϯάδϣϒΛཧͰ͖Δ • Katib Dashboard: ϋΠύʔύϥϝʔλʔνϡʔχϯάͷπʔϧ https://www.slideshare.net/Oshima0x3fd/katib ͕ৄͦ͠͏
ߏங·ͰಓͷΓͦ͏ɾɾɾ
͋ΔRancherΧλϩάΛݟ͍ͯΔͱɾɾ
͋ʂ
None
͔ͯ͠͠Chainer͙͑͢Δɾɾɾʁ
ྲྀΕ 1. GPUΫϥελʔͷߏங on GKE 2. ΫϥελʔΛRancherΠϯϙʔτ 3. RancherΧλϩάͰkubeflowσϓϩΠ ※ͪͳΈʹGKEʹೖΕΔ͚ͩͳΒઐ༻ͷϫϯΫϦοΫσϓϩΠ͕༻ҙ͞ΕͯΔͷͰ
ͦͪΒΛ͏ํ͕ૣ͍͔ https://deploy.kubeflow.cloud/#/
GPUΫϥελʔͷߏங on GKE
GPUબΜͰ࡞ KZVQZUFSIVC͕Ϧιʔε Λ৯͏ͷͰεϖοΫ͕͋ Μ·Γ͍ͱࢮʹ·͢
GPUΫϥελʔ͕Ͱ͖·ͨ͠
ΫϥελʔΛ RancherΠϯϙʔτ
None
ࣗݾॺ໊ͳͷͰͪ͜Β Λ࣮ߦ DMVTUFSBENJOΛϢʔβʔ ʹCJOEJOH
ΠϯϙʔτͰ͖·ͨ͠
RancherΧλϩάͰ kubeflowσϓϩΠ
None
֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ
֤ػೳͷ0/0''͕Ͱ͖ΔͬΆ͍ʁ
None
6*
None
Ϣʔβʔ࡞͢Δ
ΠϝʔδΛࢦఆͯ͠TQBXO
ϫʔΫεϖʔε͕࡞͞ΕΔ
ϫʔΫεϖʔε͕ग़དྷ্͕Δ
QZUIPOίʔυΛ͙࣮͢ߦͰ͖Δ
None
UFOTPSqPXͷδϣϒͷ࡞͕Ͱ͖Δ
> kubectl get crd NAME AGE backendconfigs.cloud.google.com 2h scalingpolicies.scalingpolicy.kope.io 2h
studyjobs.kubeflow.org 1h tfjobs.kubeflow.org 1h ͋Εɺchainer operator͕͍ͳ͍ɾɾɾ
None
{"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-rbac.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702047111Z"}
{"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-crd.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702898257Z"} {"log":"2019/03/14 17:57:17 info: manifest \"kubeflow/templates/ chainer-operator.yaml\" is empty. Skipping. \n","stream":"stderr","time":"2019-03-14T17:57:17.702904447Z"} RancherαʔόʔͷϩάΛݟΔͱ Ͳ͏manifestʹө͞Ε͍ͯͳ͍Α͏ͩ
issueग़͠ͱ͖·ͨ͠ʂ
Thanks!