Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Search
Naotoshi Seo
February 17, 2017
Technology
4
6.2k
DeNA AIシステム部におけるクラウドを活用した機械学習基盤の構築
Naotoshi Seo
February 17, 2017
Tweet
Share
More Decks by Naotoshi Seo
See All by Naotoshi Seo
ZOZOTOWNリプレイス2020
sonots
5
35k
Red Chainer and Cumo: Practical Deep Learning in Ruby at RubyKaigi 2019
sonots
1
4.4k
Introduction of Cumo, and Integration to Red Chainer
sonots
1
1.1k
Implementation of Cumo, a CUDA-aware version of Ruby/Numo
sonots
1
1.9k
Fast Numerical Computing and Deep Learning in Ruby with Cumo
sonots
0
9.3k
CuPy improvments around memory
sonots
3
1.6k
Triglav - Data Driven Workflow Tool
sonots
1
4.1k
DeNA流データエンジニアリングの極意
sonots
17
13k
BigQuery Schema Migration #bq_sushi
sonots
2
6.1k
Other Decks in Technology
See All in Technology
17年のQA経験が導いたスクラムマスターへの道 / 17 Years in QA to Scrum Master
toma_sm
0
420
一人QA時代が終わり、 QAチームが立ち上がった話
ma_cho29
0
290
Go製のマイグレーションツールの git-schemalex の紹介と運用方法
shinnosuke_kishida
1
420
Enterprise AI in 2025?
pamelafox
0
110
Keynote - KCD Brazil - Platform Engineering on K8s (portuguese)
salaboy
0
130
【5分でわかる】セーフィー エンジニア向け会社紹介
safie_recruit
0
20k
やさしいMCP入門
minorun365
PRO
6
430
バクラクでのSystem Risk Records導入による変化と改善の取り組み/Changes and Improvement Initiatives Resulting from the Implementation of System Risk Records
taddy_919
0
220
3/26 クラウド食堂LT #2 GenU案件を通して学んだ教訓 登壇資料
ymae
1
210
銀行でDevOpsを進める理由と実践例 / 20250317 Masaki Iwama
shift_evolve
1
120
OPENLOGI Company Profile
hr01
0
61k
コンソールで学ぶ!AWS CodePipelineの機能とオプション
umekou
2
120
Featured
See All Featured
Testing 201, or: Great Expectations
jmmastey
42
7.4k
GitHub's CSS Performance
jonrohan
1030
460k
Mobile First: as difficult as doing things right
swwweet
223
9.5k
Scaling GitHub
holman
459
140k
Large-scale JavaScript Application Architecture
addyosmani
511
110k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Building Applications with DynamoDB
mza
94
6.3k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
135
33k
4 Signs Your Business is Dying
shpigford
183
22k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
7
620
The Pragmatic Product Professional
lauravandoore
33
6.5k
Rails Girls Zürich Keynote
gr2m
94
13k
Transcript
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNA AIγεςϜ෦ʹ͓ ͚ΔΫϥυΛ׆༻ͨ͠
ػցֶशج൫ͷߏங #denatechcon 2017 1 Feb 10, 2017 Naotoshi Seo AI System Division DeNA Co., Ltd.
ࣗݾհ 2 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾඌར!TPOPUT
ɾ"*γεςϜ෦ چੳج൫෦ ɾ"OBMZUJDT5PPMTνʔϜ $MPVE*OGSBνʔϜ ϦʔυΤϯδχΞ ݉ ɾ'MVFOUE3VCZίϛολ
ରऀ 3 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨΠϯϑϥ୲ऀ • ΠϯϑϥΘ͔Βͳ͍͚Ͳػցֶशج൫Λ࡞Β ͳ͚Ε͍͚ͳ͘ͳͬͨػցֶशΤϯδχΞ
࣍ 4 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL • ͓·͚"84ͱ($1ͷൺֱ
5 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
6 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͷલʹ
7 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. (16ͷجૅࣝ GPUͷجૅࣝ
8 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • σΟʔϓϥʔχϯά
• (16Λͬͨ΄͏͕͍ • ྫ $16ͩͱˠ(16ͩͱ ͳͥ(16͕ඞཁ͔ GPUͷجૅࣝ
(16ͷಛ 9 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ฒྻॲཧ͕ಘҙ • $16ͩͱίΞͳͲͷΦʔμʔ • (16ͩͱ d ίΞ • ذॲཧۤख • ذ༧ଌɾΞτΦϒΦʔμʔͷ ػೳΛ؆ૉԽ͢Δ͜ͱͰίΞΛ ૿͍ͯ͠Δ • ߦྻԋࢉʹ͍͍ͯΔ GPUͷجૅࣝ
(16 10 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
/7*%*"5FTMB • /7*%*"ͷ)1$͚(16γϦʔζ • /7*%*"(F'PSDF(3*% • Ϋϥυήʔϛϯά͚ • ".%'JSF1SP • ".%ͷ)1$͚γϦʔζ GPUͷجૅࣝ
/7*%*"5FTMB 11 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ੈ • 'FSNJ,FQMFS • .BYXFMM1BTDBM • ྫ LˠLFQMFS • "1* • $6%" /7*%*"ಠࣗ • 0QFO$- • %JSFDU$PNQVUF GPUͷجૅࣝ http://pc.watch.impress.co.jp/img/pcw/docs/755/994/html/Visio- NvidiaGPUComparisonGFLOPSvsMemorybandwidth.png.html
$6%"ͷΞʔΩςΫνϟ 12 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ϗετ $16 ͔ΒσόΠ ε (16 ʹσʔλΛసૹ • (16Ͱॲཧ • ݁ՌΛσόΠε (16 ͔ Βϗετʹసૹ $16 GPUͷجૅࣝ http://www.nvidia.co.jp/docs/IO/51174/ NVIDIA_CUDA_Programming_Guide_1.1_JPN.pdf
13 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳ(16 ५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. DeNAͷΦϯϓϨGPUڥ (2017/02ݱࡏ) 14
CPUɿXeon E5-2630 v3 2.4GHz *2 GPUɿNVIDIA Tesla M40 *2 Memɿ64GB NICɿ10Gb ίΞ MHz GPUϝϞϦ ൃද M40 3072 1114 12GB 2015/11 ५ͳGPU
15 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Γͳ͍ ɾТɾʆ
५ͳGPU
"*Ҋ݅ʹ͓͚Δ(16ར༻ 16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
͋Ε͋Δ͚͍͍ͩͨ • ύϥϝʔλΛগ͠ม͑ͯฒྻͰֶशͤ͞ ͯɺྑ͍ํΛબͿ • ֶश͢Δ࣌ʹ͚ͩ͏ • ऴΘͬͨΒഇغͯ͠ߏΘͳ͍ ५ͳGPU
17 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ५ͳGPU DHΠϯελϯε HΠϯελϯε
QΠϯελϯε چੈ AWSͷGPU
HΠϯελϯε 19 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA GRID K520 1536 * 2 800 2013/5 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞϦ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωο τϫ ʔΫ Ձ֨/࣌ (us- east-1) g2.2xlarge 1 8 15 1,536 4 $0.65 g2.8xlarge 4 32 60 6,144 32 $2.6
QΠϯελϯε Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ౦ژϦʔδϣϯͰ(·ͩ)͑ͳ͍ AWSͷGPU
GPU ίΞ MHz ൃද NVIDIA Tesla K80 2496 * 2 875 2014/11 Πϯελϯε໊ GPU ݸ vCPU ݸ ϝϞ Ϧ (GiB) ฒྻί Ξ GPUϝ ϞϦ (GB) ωοτ ϫʔΫ Ձ֨/࣌ (us- east-1) p2.xlarge 1 4 61 2,496 12 ߴ $0.9 p2.8xlarge 8 32 488 19,968 96 10G $7.2 p2.16xlarge 16 64 732 39,936 192 20G $14.4
%F/"Ͱͷ(16ར༻ 21 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
VTͰQΠϯελϯε L Λ͏ • ֶशͤ͞Δ͚࣌ͩىಈ͠ɺ͋ͱࢭΊΔ • ϋΠύʔύϥϝʔλνϡʔχϯάͳͲͰͨ ͘͞Μฒ࣮ͯߦ͢ΔͷʹΫϥυڥ ༗ར‷ ŋŷŋ و ̑̑ ५ͳGPU
($1ͷ(16 22 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. GCPͷGPU
https://cloud.google.com/gpu/
($1ͷ(16 23 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΞϧϑΝ • ਃ͢ΕL QΠ ϯελϯεͱಉ͡ ͕ ͑Δ • ͦΕҎ֎·ͩμϝͩͬ ͨ ɾТɾʆ • L͕௨ৗΠϯελϯ εʹΞλον͞Εͨܗ GCPͷGPU
($1ͷ(16 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ௨ৗΠϯελϯεۚʹΞλον͚ͩϓϥε GCPΠϯελϯεͷ՝͕ۚ୯Ґ(ͨͩ͠ɺ
࠷Ͱ10औΒΕΔ) GCPͷGPU GPU ݸ ฒྻί Ξ GPUϝ ϞϦ (GB) FP32 (TFLOP S) Ձ֨/࣌ (us) Ϧʔδϣ ϯ Tesla K80x1 1 2,496 12 4.3 $0.7 ౦ژҎ֎ Tesla P100x1 1 3,584 16 10.6 ෆ໌ N/A AMD FirePro S9300 x2 1 8 13.9 ෆ໌ N/A
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 25 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾ ִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ִ͞Εͨڥ 26 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
%F/"ͷ"*Ҋ݅ • ൿಗҊ݅ • ڠۀҊ݅ • ඇؔ༩ࣾһ͕σʔλʹΞΫηεͰ͖ͳ͍Α͏ʹִ ͞ΕͨηΩϡΞͳڥΛ࡞Δඞཁ͕͋Δ • ͨͩ͠ɺڠۀձࣾͷؔ༩ࣾһΞΫηεͰ͖Δ ΫϥυΞΧϯτΛ͚ͯ ผݸͷڥͱִͯ͠ ִ͞Εͨڥ
ωοτϫʔΫߏ 27 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Subnet
service components step DeNA PC Gateway ghe, etc Security Group ssh Security Group ִ͞Εͨڥ • ΦϯϓϨ(BUFXBZ ͔ΒͷΈ౿Έαʔ όʹTTIՄೳ • (BUFXBZͰάϧʔ ϓݖݶཧ • ίʔυHJUIVCF ʹઐ༻PSHΛ࡞ͬ ͯQSJWBUFӡ༻
ࠪϩά 28 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ίϚϯυ࣮ߦϩά • %F/"ͷ(BUFXBZʹ͋ΔΩʔϩΨʔ • Ϋϥυͷૢ࡞ϩά • "84$MPVE5SBJM • ($14UBDL%SJWFS ִ͞Εͨڥ
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 29 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾ ૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ૉૣ͍ߏங 30 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ̍ϲ݄ʹ̑ϓϩδΣΫτ ݄ • ઐ͡Όͳ͍ͷͰɺखؒͳ͘ૉૣ͘ ૉૣ͍ߏங
ࣗಈԽίʔυԽ 31 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
5FSSBGPSNͰΦʔέετϨʔγϣϯͷ ࣗಈԽˍίʔυԽ • "84 ($1྆ํʹରԠ • *UBNBFͰϓϩϏδϣχϯά • ࡞ͷLPOEBUFϥούʔ ૉૣ͍ߏங
ػցֶशڥͷ ϓϩϏδϣχϯά 32 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• VCVOUV$IBJOFSΦεεϝ • OWJEJBESJWFS • DVEBOWJEJBͷDVEBBQUSFQP͔ΒೖΕΔͱOWJEJBESJWFSೖָͬͯ • DVEOOOWJEJBͷNBDIJOFMFBSOJOHBQUSFQP͔ΒೖΕΔͱָ • QZUIPO • DIBJOFS ૉૣ͍ߏங
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 33 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾ ӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ӡ༻ָ͕ 34 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"*Ҋ͕݅ͲΜͲΜ্ཱ͕ͪͬͯ͘Δ • ͲΜͲΜڥ͕૿͑Δ • ઐ͡Όͳ͍ͷͰɺָʹ͠ͳ͍ͱ݉ۀͷ ΞϓϦ։ൃۀ͕Ͱ͖ͳ͍ ӡ༻ָ͕
35 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͦ͏ͩ Ϋϥυͩ
५ͳGPU
ΫϥυͷػೳΛ͏ 36 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Ͱ͖Δ͚ͩΫϥυͷػೳΛ͏ • ࢹπʔϧ • "84$MPVE8BUDI • ($14UBDL%SJWFS • .Z42- "843%4 ($1$MPVE42- • 3FEJT "84&MBTUJDBDIF ͳͲͳͲ ӡ༻ָ͕
ར༻தͷ"84αʔϏε 37 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
&$ • 71$ •  • 3PVUF • 4 • "VSPSBPS3%4 .Z42- • &MBTUJ$BDIF 3FEJT • &MBTUJD-PBE#BMBODJOH • $MPVE'SPOU • &MBTUJD'JMF4ZTUFN /'4 • 4/4 • 4&4 4.51 • &.3 )BEPPQ 4QBSL • $MPVE8BUDI • $MPVE5SBJM ӡ༻ָ͕
ར༻தͷ($1αʔϏε 38 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(PPHMF$PNQVUF&OHJOF ($& • (PPHMF"QQ&OHJOF • (PPHMF-PBE#BMBODJOH • (PPHMF$MPVE$%/ • (PPHMF$MPVE%/4 • (PPHMF$MPVE42- • 4UBDLESJWFS.POJUPSJOH • (PPHMF$MPVE4UPSBHF • (PPHMF#JH2VFSZ • (PPHMF$MPVE%BUBQSPD ӡ༻ָ͕
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 39 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾ ࣗ༝Λߴ͘ ɾϛε͕͓͖ʹ͍͘
ࣗ༝Λߴ͘ 40 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
γε ΤϯδχΞ ʹ̎ύλʔϯ Πϯϑϥ͍͡Γ͍ͨ Πϯϑϥ͓ͤ͠·͢ • ͍͡Γ͍ͨͳΒੋඇͬͯ͘Εʂ ࣗ༝Λߴ͘
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 41 https://suzuri.jp/mizzy/76284/t-shirt/m/navy
͍ͬͯ͡ྑ͍ 42 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
Πϯελϯεͷ্ཱͪ͛ࣗ༝ • ΫϥυαʔϏεͷઃఆ • 5FSSBGPSNʹ13 • ϓϩϏδϣχϯά • ج൫ͱผͷπʔϧͰίʔυԽ0, • खಈηοτΞοϓͯ͠ΠϝʔδʹݻΊ ͯ0, ࣗ༝Λߴ͘
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ 43 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. ɾ५ͳ(16 ɾִ͞Εͨڥ ɾૉૣ͍ߏங ɾӡ༻ָ͕ ɾࣗ༝Λߴ͘ ɾ ϛε͕͓͖ʹ͍͘
ϛε͕͓͖ʹ͍͘ 44 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ࣗ༝Λߴ͘͢Δͱࠓϛε͕͓͖Δ • ͨͱ͑ɺΠϯελϯε࡞ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • λάΛ͚Δ • 3PVUFʹϗετ໊ొ • ࢹೖ ࣗ࡞πʔϧͰ୲อ ϛε͕͓͖ʹ͍͘
FDDSFBUFJOTUBODFT HDFDSFBUFJOTUBODFT 45 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ΠϯελϯεΛ࡞ • 3PMFTλάΛ͚Δ • దͳΠϝʔδΛબ ࣍ʔδ • దͳηΩϡϦςΟάϧʔϓΛ͚Δ • 3PVUFʹϗετ໊ొ • ($1ͷ߹ඪ४Ͱ%/4ొ͞ΕΔͷͰෆཁ • ࢹೖ $ ec2-create-instances -n host --role chainer:dev ϛε͕͓͖ʹ͍͘
FDDSFBUFBNJ HDFDSFBUFTOBQTIPU 46 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ࢦఆͨ͠ϗετΛΠϝʔδԽ • Πϝʔδʹϗετͱಉ͡ϩʔϧΛ͚Δ • ࣍ճFDDSFBUFJOTUBODFT͢Δࡍʹɺ ಉ͡ϩʔϧͷ".*ͷ͏ͪɺ࠷৽ͷͷ͔ΒΠ ϯελϯεΛཱͪ͋͛Δ $ ec2-create-ami -n host ϛε͕͓͖ʹ͍͘
FDMJTUBNJ HDFMJTUTOBQTIPUT 47 Copyright (C) DeNA Co.,Ltd. All Rights
Reserved. • ࢦఆͨ͠ϩʔϧͷ͍ͭͨ".*ͷ͏ͪɺ࠷৽ͷ ͷΛදࣔ͢Δ • FDDSFBUFJOTUBODFT෦తʹ͜Ε Λ ϥΠϒϥϦͱͯ͠ ར༻ͯ͠ɺదͳ".* Λબ͢Δ $ ec2-list-ami --role chainer:dev ami-XXXXXXXX 2017-02-04T03:53:10+09:00 chainer:dev ϛε͕͓͖ʹ͍͘
FDIPTU HDFIPTU 48 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• &$Πϯελϯεʹ 3PMFTλάΛ͚ͯɺϩʔ ϧͰཧɺݕࡧ • ($&ͷ߹ NFUBEBUBΛར༻ • *UBNBFͷϩʔϧࢦఆ࣌ ʹར༻ $ ec2-host --role chainer:dev asaa5002 ϛε͕͓͖ʹ͍͘
࣍ 49 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ɾػցֶशج൫ʹٻΊΒΕΔ
ͨ ͷ ɾ(16αʔόͷΦϯσϚϯυΦʔτεέʔϧ ɾ"1*αʔό αʔϏεఏڙڥ ɾ'VUVSF8PSL ɾ͓·͚"84ͱ($1ͷൺֱ
(16αʔόͷ ΦϯσϚϯυΦʔτεέʔϧ 50 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• ฒྻͰֶशΛΒ͍ͤͨ • (16ΠϯελϯεΛඞཁͳ͚ͩࣗಈ Ͱ্ཱͪ͛ͯཉ͍͠ • ֶश͕ऴΘͬͨΒࣗಈͰམͱͯ͠΄͍͠ • མͱ͠Ε͕ͪʼʻ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
... Chainer Cluster create ssh terminate ... XXX Cluster FDTDBMFSVO
51 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. • ֶशͤ͞Δͱ͖ʹΠϯελϯεΛ ্ཱͪ͛ͯίϚϯυ࣮ߦ • ͢Ͱʹ্ཱ͕͍ͪͬͯͯΘΕͯ ͍ͳ͍Πϯελϯε͕͍Εੵۃ తʹར༻͢Δ • "84̍࣌ؒ՝ۚͳͷͰ͙͢ʹ ࡴ͞ͳ͍ • ىಈ࣌ؒNJONJO ͰΘΕ͍ͯͳ͍Πϯελϯε͕ ͍Εམͱ͢ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ $ ec2-scale-run -c config.yml [<‘Some shell code'> | <filename [args ...]>
52 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. མͱ͠Εͳ͠ ‷
ŋŷŋ و ̑̑
%PDLFSରԠ 53 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. TDBMFSVOͷதͰOWJEJBEPDLFSSVO
ྫ $IBJOFS5FOTPS'MPXίϯςφ "84($1Ͱखݩͱಉ͡ίϯςφΛ͑ͯศར 2&$4Θͳ͍ͷʁ "ࠓͷͱ͜Ζͬͯ·ͤΜ ཧ༝(16Λ͑ΔΑ͏ʹ͢Δઃఆ͕ ৭ʑΊΜͲ͏ͩͬͨ ཧ༝(,&ͱͷΠϯλʔϑΣʔεҧ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
Copyright (C) DeNA Co.,Ltd. All Rights Reserved. https://suzuri.jp/chiastolite/90304/t-shirt/s/royalblue GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
ิOWJEJBEPDLFS 55 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
EPDLFSDMJͷബ͍ϥούʔ • %PDLFSίϯςφ͔Βϗετͷ(16 Λ͏ͱ͖ʹศར • OWJEJBEPDLFSQMVHJO͔Β ใΛಘͯɺEPDLFSίϚϯυʹΦ ϓγϣϯΛ৭ʑͯ͠ྑ͍͕໘ $ nvidia-docker run nvidia/cuda nvidia-smi GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
/'4Ϛϯτ 56 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεΛ্ཱͪ͛ ͯམͱ͢ͷͰɺ • ڞ༗ετϨʔδ͕ඞཁ • ֶशݩσʔλ • தؒεφοϓγϣοτ NFS • "NB[PO&'4ΛϚϯτ • ༰ྔࣗಈ֦ு • ஈ͓ߴΊ (#݄ • ౦ژϦʔδϣϯͰ͑ͳ͍ GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
εϙοτΠϯελϯεͷ׆༻ 57 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ೖࡳՁ֨ࢢ εϙοτ Ձ֨ͳΒɺࢢՁ֨ ͰΠϯελϯε্ཱ͕͕ͪΔ • ࢢՁ͕͕֨͋ͬͨΒɺՁ͕֨มΘΔ • ࢢՁ֨ೖࡳՁ֨ʹٯసͨ͠ΒɺΠϯελϯ ε͕མͱ͞ΕΔ εϙοτΠϯελϯε <࣮> QYMBSHFIˠI 0'' GPUαʔόͷΦϯσϚϯυΦʔτεέʔϧ
58 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "1*αʔό αʔϏεఏڙڥ
"1*αʔό 59 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶश̎ͭͷϑΣʔζ • ֶशϑΣʔζ • ༧ଌϑΣʔζ • ֶशϑΣʔζ։ൃڥͰ (16ར༻ • ༧ଌϑΣʔζϓϩμΫγϣϯ $16ར༻ • )551"1*ͱͯͯ͠͠αʔϏεʹఏڙ APIαʔό
࣮ྫ 60 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. Elastic
Load Balancing ... API Server (Blue) ... API Server (Green) • $IBJOFSͷ༧ଌϑΣʔ ζΛ͏ͷͰ1ZUIPO ΞϓϦέʔγϣϯ • %KBOHP • ϩʔΧϧ+VCBUVT • #MVF(SFFO %FQMPZNFOU APIαʔό ap-northeast-1 (cpu)
61 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. 'VUVSF8PSL
'VUVSF8PSL 62 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
"1*αʔόΛ("& (PPMHF"QQ&OHJOF Ͱӡ༻ָ͍ͯͨ͠͠ • ("&QZUIPO • 4UBOEBSE&OWJSPONFOU੍͕ݫ͠ ͗͢ΔͷͰ'MFYJCMF&OWJSPONFOU͔ • શࣗಈϋΠύʔύϥϝʔλνϡʔχϯά͞Μ Future Work
'VUVSF8PSL 63 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ཧ(16Ϛγϯཉ͍͠ ɾТɾʆ • τϥΠΞϯυΤϥʔͳ։ൃ༻్ • खݩͰ։ൃ͍ͨ͠ • େྔʹฒྻͰֶश͍ͤͨ͞߹Ϋϥυ • ࠷Ͱ̍ਓ̍ߪೖ༧ఆ‷ ŋŷŋ و ̑̑ Future Work
64 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. ͓·͚
65 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. "84ͱ($1 ͷൺֱ
Πϯελϯεྉۚ 66 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
(16Πϯελϯεͷஈ͋·ΓมΘΒͳ͍ • ($&Πϯελϯεͷ՝ۚ̍͝ͱ • ͨͩ͠ɺ࠷ͰऔΒΕΔ • ($&Πϯελϯε͕̍ϲ݄࣮ؒߦ͞ΕΔ ͱɺྉ͕ۚࣗಈͰׂΓҾ͔ΕΔ • &$ͷϦβʔϒυΠϯελϯεͱҧ͍ɺ৽͍͠Π ϯελϯελΠϓ͕ग़ͨ࣌ʹҾͬӽ͍͢͠ҹ AWSͱGCPͷൺֱ
($1ͷϩʔυόϥϯα͕ڧ͍ 67 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΥʔϜΞοϓෆཁ • ࣄલεέʔϧΞτਃෆཁ • ϚϧνϦʔδϣϯରԠ • ̍άϩʔόϧ*1 *1ΤχʔΩϟετ AWSͱGCPͷൺֱ
($1ͷωοτϫʔΫઃఆ͕ॊೈ 68 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ΠϯελϯεʹλάΛ͚ͯɺλάͰϧʔ ςΟϯάઃఆՄೳ • "84ͷ߹TVCOFUͰϧʔςΟϯάઃఆ AWSͱGCPͷൺֱ
"84ͷ΄͏͕αʔϏεॆ࣮ 69 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
($1ʹ"84&MBTUJ$BDIF 3FEJT .FNDBDIFE ૬͕ͳ͍ • &'4 /'4 ૬͕ͳ͍ • 4.51αʔϏε͕ͳ͍ • SEQBSUZͱఏܞ • Γͳ͍ͱ͜Ζ͕ͪ´ • 4UBDL%SJWFSʹࢹొ"1*͕·ͩͳ͍ AWSͱGCPͷൺֱ
·ͱΊ 70 Copyright (C) DeNA Co.,Ltd. All Rights Reserved. •
ػցֶशج൫ʹٻΊΒΕΔ ͨ ͷ • ५ͳ(16 • ִ͞Εͨڥ • ૉૣ͍ߏங • ӡ༻ָ͕ • ࣗ༝Λߴ͘ • ϛε͕͓͖ʹ͍͘ • (16αʔόͷΦϯσϚϯυΦʔτεέʔϧ • "1*αʔό αʔϏεఏڙڥ • 'VUVSF8PSL ("& શࣗಈύϥϝʔλνϡʔχϯά ˠͦΕΫϥυͰ
4QFDJBM5IBOLT ॱෆಉ 71 Copyright (C) DeNA Co.,Ltd. All Rights Reserved.
• OIBZBTIJ • LB[VLJGVKJLBXB • GVLVEBNB 1'/ • DJWJUBTQP • NB[HJ