Upgrade to Pro — share decks privately, control downloads, hide ads and more …

How we use GPUs in Cookpad

Avatar for Yuichiro Someya Yuichiro Someya
November 06, 2017
Programming
0
180

How we use GPUs in Cookpad

@Tokyo Machine Learning Kitchen
https://tokyo-ml.github.io/

Avatar for Yuichiro Someya

Yuichiro Someya

November 06, 2017
Tweet

More Decks by Yuichiro Someya

See All by Yuichiro Someya
にんげんがさき 基盤はあと / Developers over ML platform
Avatar for Yuichiro Someya ayemos
0
15k
機械学習をスモールスタートさせる方法 / small machine learning
Avatar for Yuichiro Someya ayemos
3
2.1k
アットホームな分析基盤の作り方 / Homemade Machine Learning Toolkits
Avatar for Yuichiro Someya ayemos
1
1k
サービス開発、機械学習、クラウド / the trinity of machine learning
Avatar for Yuichiro Someya ayemos
0
3.6k
成長を止めない機械学習のやり方 / Don't stop 'til you get enough (data).
Avatar for Yuichiro Someya ayemos
15
5.3k
AWS で加速する機械学習 / Accelerate Machine Learning with AWS
Avatar for Yuichiro Someya ayemos
1
350
クックパッドの機械学習基盤 2018 / Machine Learning Platform at Cookpad ~ 2018 ~
Avatar for Yuichiro Someya ayemos
15
21k
PyTorchとCaffe2とONNXと深層学習モデルのデプロイについて
Avatar for Yuichiro Someya ayemos
1
3k
クックパッドにおけるAWS GPUインスタンスの利用事例 / Powering by AWS GPU Instances in Cookpad Inc
Avatar for Yuichiro Someya ayemos
0
440

Other Decks in Programming

See All in Programming
責任感のあるCloudWatchアラームを設計しよう
Avatar for アキキー akihisaikeda
3
190
izumin5210のプロポーザルのネタ探し #tskaigi_msup
Avatar for izumin5210 izumin5210
1
320
JPUG勉強会 OSSデータベースの内部構造を理解しよう
Avatar for Atsushi Ogawa oga5
2
190
NOT A HOTEL - 建築や人と融合し、自由を創り出すソフトウェア
Avatar for Hokuto Shimokawa not_a_hokuts
2
370
atmaCup #23でAIコーディングを活用した話
Avatar for ML_Bear ml_bear
3
590
Claude Codeと2つの巻き戻し戦略 / Two Rewind Strategies with Claude Code
Avatar for 果物リン fruitriin
0
180
Metaprogramming isn't real, it can't hurt you
Avatar for Masafumi Okura okuramasafumi
0
120
humanlayerのブログから学ぶ、良いCLAUDE.mdの書き方
Avatar for Yuto tsukamoto1783
0
200
並行開発のためのコードレビュー
Avatar for Miyuki miyukiw
2
1.8k
CSC307 Lecture 09
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
1
850
今更考える「単一責任原則」 / Thinking about the Single Responsibility Principle
Avatar for philomagi tooppoo
0
430
AIによる高速開発をどう制御するか？ ガードレール設置で開発速度と品質を両立させたチームの事例
Avatar for tonkotsuboy_com tonkotsuboy_com
7
2.5k

Featured

See All Featured
What’s in a name? Adding method to the madness
Avatar for The Alliance productmarketing
PRO
24
3.9k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
40k
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
Avatar for Greg Gifford greggifford
PRO
0
90
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
Leading Effective Engineering Teams in the AI Era
Avatar for Addy Osmani addyosmani
9
1.6k
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
5
910
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
57
14k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
231
22k
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
1.6k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
140

Transcript

  1. )PXXFVTF(16TJO$PPLQBE :VJDIJSP4PNFZB!$PPLQBE*OD3%

  2. ‣ Yuichiro Someya (ayemos) ‣ github.com/ayemos ‣ Machine Learning Enginner

    @ Cookpad Inc. # 2016(new grads) ~ Current
  3. None

  4. ‣ 0VS(16FOWJSPONFOU  )PXXFVUJMJ[F"84T(16JOTUBODFT  )PXXFLFFQPVSTDBMBCJMJUZPGUFBNTJO3% 

  5. 

  6.  /7*%*"7

  7.  All-in on AWS since 2011

  8.  All-in on AWS since 2011 Amazon RDS (Relational Data)

    Amazon Redshift (Data Warehouse)

  9.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse)

  10.  All-in on AWS since 2011 Amazon S3 (Object Storage)

    Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) 7JSUVBM1SJWBUF$MPVE

  11. 7JSUVBM1SJWBUF$MPVE  All-in on AWS since 2011 Amazon S3 (Object

    Storage) Amazon RDS (Relational Data) Amazon Redshift (Data Warehouse) Amazon EC2 (Computation)

  12.  ‣ $6%" ‣ DV%//

  13.  ‣ $6%" ‣ DV%// (Snapshot)

  14.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

  15.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  16.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  17. 5FNQMBUF  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 5FNQMBUF KTPO

    QBDLFSCVJME

  18.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  19.  ‣ $6%" ‣ DV%// (Snapshot) ‣ $6%" ‣ DV%//

    IUUQTBXTBNB[PODPNBNB[POBJBNJT CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6

  20.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  21.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

  22.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)

  23.  CUDA9 cuDNN7 CUDA8 cuDNN7 CUDA8 cuDNN6 ... `ssh` ...

    AWS Lambda (Function) Stop! Idle? (Hourly)

  24. ‣ 0OEFNBOE(16XPSLCFODIFT  6UJMJ[F".*UPNVMUJQMFXPSLCFODIFOWJSPONFOUT  1BDLFSNBLFTJUFBTJFSUPVQEBUFBOENPSFTUBCMF  0QFSBUFWJB$IBUCPU  8SBQVQ