Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Shiva 〜Nextremerをscale upする機械学習環境〜
Search
Chanmoro
December 14, 2017
Technology
0
180
Shiva 〜Nextremerをscale upする機械学習環境〜
Nextremer 社内で運用している機械学習環境 Shiva のご紹介
tag: Docker, Mesos, Marathon, Jupyter, ceph,
Chanmoro
December 14, 2017
Tweet
Share
More Decks by Chanmoro
See All by Chanmoro
LAPRAS クローラーの変遷
chanmoro
3
2.4k
クローラーをテストしよう!
chanmoro
2
1.8k
対話AI on Kubernetes
chanmoro
0
81
グラフ解析で社長の脳内さらす!
chanmoro
0
400
Other Decks in Technology
See All in Technology
ソースを読むプロセスの例
sat
PRO
15
9.7k
「REALITY」3Dアバターシステムの7年分の拡張の歴史について
gree_tech
PRO
0
120
AI AgentをLangflowでサクッと作って、1日働かせてみた!
yano13
1
120
Kubernetes self-healing of your workload
hwchiu
0
330
Railsの話をしよう
yahonda
0
170
Copilot Studio ハンズオン - 生成オーケストレーションモード
tomoyasasakimskk
0
190
データ戦略部門 紹介資料
sansan33
PRO
1
3.8k
名刺メーカーDevグループ 紹介資料
sansan33
PRO
0
940
混合雲環境整合異質工作流程工具運行關鍵業務 Job 的經驗分享
yaosiang
0
140
Wasmの気になる最新情報
askua
0
180
物体検出モデルでシイタケの収穫時期を自動判定してみた。 #devio2025
lamaglama39
0
260
FinOps について (ちょっと) 本気出して考えてみた
skmkzyk
0
190
Featured
See All Featured
The Illustrated Children's Guide to Kubernetes
chrisshort
49
51k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
508
140k
GitHub's CSS Performance
jonrohan
1032
470k
Learning to Love Humans: Emotional Interface Design
aarron
274
41k
RailsConf 2023
tenderlove
30
1.3k
A Modern Web Designer's Workflow
chriscoyier
697
190k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
16
1.7k
Building a Modern Day E-commerce SEO Strategy
aleyda
44
7.8k
We Have a Design System, Now What?
morganepeng
53
7.8k
Into the Great Unknown - MozCon
thekraken
40
2.1k
For a Future-Friendly Web
brad_frost
180
10k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
10
880
Transcript
Copyright © Nextremer, inc. All Rights Reserved. 1 Shiva ʙNextremerΛScale
up͢Δػցֶशڥʙ 14th Dec 2017
Copyright © Nextremer, inc. All Rights Reserved. 2 ࣗݾհ ྆֯
ي(ΖͣΈ ͔͖ͣ) גࣜձࣾNextremer ϓϩάϥϚʔ ※ରγεςϜͷݚڀ։ൃΛ͍ͯ͠ΔاۀͰ͢ • ओʹ͍ͬͯΔ͜ͱ • αʔόʔαΠυ։ൃ • ͜͜࠷ۙ৮ٕͬͨज़ • Terraform, Ansible, Packer ← Infrasctucture as Codeʂ • Docker, Kubernetes, Apache Mesos ← ϙʔλϏϦςΟ͍͜͞͏ʂ • Python, Scala, javascript(ES6) ← ؔܕ͏·͔͚͘Δͱؾ͍͍࣋ͪʂ • Finagle, React.js ← ϚΠΫϩαʔϏε͍ͨ͠ʂϦΞΫςΟϒ͍ͨ͠ʂ
Copyright © Nextremer, inc. All Rights Reserved. 3 ࠓ͓͢͠Δ͜ͱ Nextremer
ͷػցֶशڥ Shiva ʹ͍͓ͭͯ͠͠·͢
Copyright © Nextremer, inc. All Rights Reserved. 4 ػցֶशڥ Shiva
1. ΦϑΟεʹ͋ΔGPUϚγϯʹ 2. WebͷμογϡϘʔυ͔Β 3. ઐ༻ͷJupyterΛ্ཱͪ͛ΒΕΔ
Copyright © Nextremer, inc. All Rights Reserved. 5 Shiva͕ղܾ͢Δ՝ ▪
GPUϚγϯΛ͍͍͚ͨͲɾɾɾ • Ϋϥυඅ༻Λؾʹͯ͠ؾܰʹ͑ͳ͍ • ओʹ༧ࢉ͖ͷPJҎ֎ɺτϨʔχϯάͱ͔ɺҋݚڀͱ͔ • GPUϚγϯΛෳϢʔβʔͰڞ༗͢ΔͷΓʹ͍͘ • ϥΠϒϥϦͷڝ߹ɺ୭͕ͬͯΔ͔Θ͔ΒΜ • GPUϚγϯ্Ͱͷڥߏங͕େมͩͬͨΓ • શһ͕ৄ͍͠Θ͚͡Όͳ͍
Copyright © Nextremer, inc. All Rights Reserved. 6 σϞ ※GIFΞχϝʔγϣϯͰ͢
Copyright © Nextremer, inc. All Rights Reserved. 7 Abstract ▪
ϢʔβʔຖͷDockerίϯςφ ▪ શ෦ೖΓڥ & sudoݖݶ ▪ ϗʔϜdirΛશϚγϯͰڞ༗
Copyright © Nextremer, inc. All Rights Reserved. 8 Architecture Overview
Copyright © Nextremer, inc. All Rights Reserved. 9 Architecture Overview
μογϡϘʔυ͔ΒAPIܦ༝Ͱૢ࡞ ɹɾϦιʔεར༻ঢ়گΛऔಘ ɹɾίϯςφͷىಈɾআ
Copyright © Nextremer, inc. All Rights Reserved. 10 Architecture Overview
શͰϗʔϜσΟϨΫτϦΛڞ༗ ɹɾࢄετϨʔδΛߏங ɹɾίϯςφىಈ࣌ʹϚϯτ
Copyright © Nextremer, inc. All Rights Reserved. 11 Architecture Overview
▪ ϢʔβʔͱϙʔτͷϚοϐϯά • http://host/user/kazuki.morozumi • Jupyter͕Ϧεϯ͢ΔϙʔτϥϯμϜ ▪ ίϯςφՔಇঢ়گΛެ։͢ΔAPI ▪ tmpnbΛΧελϚΠζ • https://github.com/jupyter/tmpnb
Copyright © Nextremer, inc. All Rights Reserved. 12 Infrastructure Overview
Copyright © Nextremer, inc. All Rights Reserved. 13 Infrastructure Overview
ίϯςφΦʔέετϨʔγϣϯʹ Mesos + MarathonΛར༻
Copyright © Nextremer, inc. All Rights Reserved. 14 Infrastructure Overview
▪ Mesos+MarathonΛબͨ͠ཧ༝ • ಛఆͷΞϓϦΛσʔϞϯͱͯ͠ಈ͔ͤΕे • αʔϏεσΟεΧόϦͱ͔͍Βͳ͍ • KubernetesΦʔόʔεϖοΫ͗͢Δ • ߏཁૉ͕ଟ͘ෳࡶͰߏஙɺϝϯςφϯε͕େม • ୯७ʹMesos+MarathonΛࢼͯ͠Έ͔ͨͬͨ • ߏங࣌ใ͕͔ͳΓগͳ͔ͬͨ
Copyright © Nextremer, inc. All Rights Reserved. 15 Infrastructure Overview
CPU Intel Core i7-6700K ϝϞϦ 32GB Disk SSD 500GB GPU GTX-1080 ×2ຕ GPUϚγϯεϖοΫ ݟͨେࣄʂ ɹ- ͱΓ͋͑ͣޫΒͤΔ ɹ- ΈΜͳʹݟ͑Δॴʹஔ͘
Copyright © Nextremer, inc. All Rights Reserved. 16 ӡ༻͍ͯͯ͠ىͬͨ͜ ▪
σΟεΫ্ݶ • ֶशσʔλඦGBΛΞοϓϩʔυͨ͠ΒσΟεΫ্ݶʹୡͯ͠ఀࢭ • ίϯςφଆ͔ΒsshfsͰࣗͷPCͷσΟεΫΛϚϯτͯ͠ճආͨ͠ ▪ ίϯςφ͕ͨ࣌͠ͷηʔϑςΟʔωοτ • ։ൃͨ͠ίʔυͷόάͰϗετͷCPUɾϝϞϦΛ৯͍௵͢ • ϏΪφʔͷϢʔβʔ͕͜ͷΑ͏ͳόάΛ࡞Γ͕ͪ • ରԠࡦίϯςφຖʹϦιʔε੍ݶΛ͚ͭΔ • ස͔ͭӨڹͳͷͰಛʹݱঢ়ରԠͤͣ
Copyright © Nextremer, inc. All Rights Reserved. 17 ৄࡉQiitaͷهࣄʂ
Copyright © Nextremer, inc. All Rights Reserved. 18 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ WBC؍ઓઐ༻
Line bot
Copyright © Nextremer, inc. All Rights Reserved. 19 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢
Copyright © Nextremer, inc. All Rights Reserved. 20 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢ ▪
ฐࣾCEO ҪΛίϐʔͨ͠ରγεςϜ • 2017/10 ୈ8ճରγεςϜγϯϙδϜʹͯσϞൃද
Copyright © Nextremer, inc. All Rights Reserved. 21 NextremerͰ͜Μͳ͜ͱΛ͍ͬͯ·͢