Upgrade to Pro — share decks privately, control downloads, hide ads and more …

How we use GPUs in Cookpad

Avatar for Yuichiro Someya Yuichiro Someya
November 06, 2017
Programming
210
0

How we use GPUs in Cookpad

@Tokyo Machine Learning Kitchen
https://tokyo-ml.github.io/

Avatar for Yuichiro Someya

Yuichiro Someya

November 06, 2017

More Decks by Yuichiro Someya

See All by Yuichiro Someya
にんげんがさき 基盤はあと / Developers over ML platform
Avatar for Yuichiro Someya ayemos
0
15k
機械学習をスモールスタートさせる方法 / small machine learning
Avatar for Yuichiro Someya ayemos
3
2.1k
アットホームな分析基盤の作り方 / Homemade Machine Learning Toolkits
Avatar for Yuichiro Someya ayemos
1
1k
サービス開発、機械学習、クラウド / the trinity of machine learning
Avatar for Yuichiro Someya ayemos
0
3.7k
成長を止めない機械学習のやり方 / Don't stop 'til you get enough (data).
Avatar for Yuichiro Someya ayemos
15
5.3k
AWS で加速する機械学習 / Accelerate Machine Learning with AWS
Avatar for Yuichiro Someya ayemos
1
370
クックパッドの機械学習基盤 2018 / Machine Learning Platform at Cookpad ~ 2018 ~
Avatar for Yuichiro Someya ayemos
15
21k
PyTorchとCaffe2とONNXと深層学習モデルのデプロイについて
Avatar for Yuichiro Someya ayemos
1
3.1k
クックパッドにおけるAWS GPUインスタンスの利用事例 / Powering by AWS GPU Instances in Cookpad Inc
Avatar for Yuichiro Someya ayemos
0
460

Other Decks in Programming

See All in Programming
わからない話を追いかけたら、プログラミング言語を作る側にいた
Avatar for ydah ydah
3
480
【やさしく解説 設計編・中級 #6】良いアーキテクチャとは ～ 一本の登り道の、行き先 ～
Avatar for HideyukiKitao panda728
PRO
0
210
型も通る、synthも通る、それでも危ない 〜AIのCDKの権限とコストを機械で検証する〜 / It Passes Type Checks, It Passes Synth Checks, but It’s Still Risky — Automatically Verifying Permissions and Costs in AI’s CDK —
Avatar for shiro seike seike460
PRO
1
540
自動化したのに回らないテスト運用の壁ーAI時代の品質責任と生産性
Avatar for Masahiko Funaki(舟木 将彦) mfunaki
0
130
AI時代に設計が 最大の生産性レバーになる 意図駆動開発とデータを消さない設計｜Don't Delete Your Data or Your Intent — Design as the Deepest Lever in the AI Era
Avatar for Tomohisa Takaoka tomohisa
1
740
今さら聞けない .NET CLI
Avatar for tkym htkym
0
180
PHP に部分適用が来るぞ！……ところで何それ？おいしいの？ #phpcon / phpcon-2026
Avatar for shogogg shogogg
0
600
作るコストが小さくなった時代 幸せに働くために改めて考えたいこと 〜エンジニアとして価値を出し続けるために注視している二分野〜
Avatar for YuppeEng yuppeeng
0
190
jsmini JavaScript Engine を作ってみた話
Avatar for Yosuke Furukawa yosuke_furukawa
PRO
0
300
【やさしく解説 設計編・中級 #1】一つの車に、運転手は一人　～ある倉庫システムの事例から～
Avatar for HideyukiKitao panda728
PRO
0
210
AI時代、エンジニアはどう育つのか -未経験エンジニアの成長を間近で見て考えたこと-
Avatar for ta-hasunuma thasu0123
0
220
プロポーザルを書いてもらう
Avatar for pvcresin pvcresin
0
290

Featured

See All Featured
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
1
480
Between Models and Reality
Avatar for mayunak mayunak
4
390
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
Avatar for Aleyda Solis aleyda
1
1.3k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
273
27k
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.7k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
35k
Sam Torres - BigQuery for SEOs
Avatar for Tech SEO Connect techseoconnect
PRO
0
460
How GitHub (no longer) Works
Avatar for Zach Holman holman
316
150k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.9k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
Avatar for Aleyda Solis aleyda
1
2.1k

Transcript

  1. )PXXFVTF(16TJO$PPLQBE :VJDIJSP4PNFZB!$PPLQBE*OD3%

  2. ‣ Yuichiro Someya (ayemos) ‣ github.com/ayemos ‣ Machine Learning Enginner

    @ Cookpad Inc. # 2016(new grads) ~ Current
  3. None

  4. ‣ 0VS(16FOWJSPONFOU  )PXXFVUJMJ[F"84T(16JOTUBODFT  )PXXFLFFQPVSTDBMBCJMJUZPGUFBNTJO3% 

  5. 

  6.  /7*%*"7

  7.  All-in on AWS since 2011

  8.  All-in on AWS since 2011 Amazon RDS (Relational Data)

    Amazon Redshift (Data Warehouse)

  9.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse)

  10.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) 7JSUVBM1SJWBUF$MPVE

  11. 7JSUVBM1SJWBUF$MPVE  All-in on AWS since 2011 Amazon S3 (Object

    Storage) Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) Amazon EC2 (Computation)

  12.  ‣ $6%" ‣ DV%//

  13.  ‣ $6%" ‣ DV%// (Snapshot)

  14.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

  15.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  16.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  17. 5FNQMBUF  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 5FNQMBUF KTPO

    QBDLFSCVJME

  18.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  19.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    IUUQTBXTBNB[PODPNBNB[POBJBNJT CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  20.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  21.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  22.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)

  23.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)

  24. ‣ 0OEFNBOE(16XPSLCFODIFT  6UJMJ[F".*UPNVMUJQMFXPSLCFODIFOWJSPONFOUT  1BDLFSNBLFTJUFBTJFSUPVQEBUFBOENPSFTUBCMF  0QFSBUFWJB$IBUCPU  8SBQVQ