Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeepRacerで始める機械学習
Search
tandfy
October 11, 2019
Programming
1
1.7k
DeepRacerで始める機械学習
tandfy
October 11, 2019
Tweet
Share
More Decks by tandfy
See All by tandfy
アプリから集まるイベントデータのリアルタイム処理入門
tandfy
0
1.6k
Amazon SageMakerの最新アップデートの紹介
tandfy
1
900
Amazon Personalizeではじめるレコメンドサービス
tandfy
0
1.1k
DeepRacerで学ぶ機械学習 1.1
tandfy
0
1k
DeepRacerでまなぶ強化学習
tandfy
1
1.4k
Amazon SageMakerではじめる物体検出
tandfy
1
1.1k
Other Decks in Programming
See All in Programming
CSC305 Lecture 01
javiergs
PRO
1
380
iOSアプリの信頼性を向上させる取り組み/ios-app-improve-reliability
shino8rayu9
0
140
Swift Concurrency - 状態監視の罠
objectiveaudio
2
440
CSC509 Lecture 01
javiergs
PRO
1
430
XP, Testing and ninja testing ZOZ5
m_seki
2
240
Advance Your Career with Open Source
ivargrimstad
0
270
階層構造を表現するデータ構造とリファクタリング 〜1年で10倍成長したプロダクトの変化と課題〜
yuhisatoxxx
3
870
なぜGoのジェネリクスはこの形なのか? Featherweight Goが明かす設計の核心
ryotaros
7
1k
Introducing ReActionView: A new ActionView-Compatible ERB Engine @ Kaigi on Rails 2025, Tokyo, Japan
marcoroth
3
880
WebエンジニアがSwiftをブラウザで動かすプレイグラウンドを作ってみた
ohmori_yusuke
0
170
SpecKitでどこまでできる? コストはどれくらい?
leveragestech
0
440
なぜあの開発者はDevRelに伴走し続けるのか / Why Does That Developer Keep Running Alongside DevRel?
nrslib
2
360
Featured
See All Featured
BBQ
matthewcrist
89
9.8k
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
How to Think Like a Performance Engineer
csswizardry
27
2k
How to train your dragon (web standard)
notwaldorf
96
6.3k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
36
2.5k
Gamification - CAS2011
davidbonilla
81
5.5k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
30
2.9k
4 Signs Your Business is Dying
shpigford
185
22k
Bash Introduction
62gerente
615
210k
The Art of Programming - Codeland 2020
erikaheidi
56
14k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
19
1.2k
Designing Experiences People Love
moore
142
24k
Transcript
%FFQ3BDFSͰ࢝ΊΔػցֶश σʔλΞφϦςΟΫεࣄۀຊ෦ΠϯςάϨʔγϣϯ෦ େᖒ༐ే
ࣗݾհ େᖒ༐ే σʔλΞφϦςΟΫεࣄۀຊ෦ΠϯςάϨʔγϣϯ෦ ػցֶशνʔϜΤϯδχΞ ݄ೖࣾ ݄ҭٳ ݱࡏɺࣾձ෮ؼத
ࠓ͢͜ͱ w"84%FFQ3BDFSͱ wػցֶशͷ֓ཁ w"84ʹ͓͚ΔػցֶशαʔϏε w"84%FFQ3BDFSͰԿΛͲ͏ֶΔͷ͔ w"84%FFQ3BDFSΛ࣮ࡍʹͬͯΈΔ όʔνϟϧϦʔάฤ
εϥΠυޙͰೖख͢Δ͜ͱ͕ग़དྷ·͢ͷͰ ൃදதͷ༰ΛϝϞ͢Δඞཁ͋Γ·ͤΜɻ ࣸਅࡱӨΛ͢Δ߹ ϑϥογϡɾγϟολʔԻ͕ग़ͳ͍Α͏ʹྀ͍ͩ͘͝͞ Attention
"84%FFQ3BDFS
https://aws.amazon.com/jp/deepracer/
"84%FFQ3BDFS "84্ͰϞσϧΛֶशͤͯ͞ɺϥδίϯͰࣗಈӡస wϚωδϝϯτίϯιʔϧ͔ΒϞσϧΛֶश wεέʔϧͷϥδίϯʹϞσϧΛࡌͤΔ͜ͱͰࣗಈӡస wόʔνϟϧϦʔάʹϞσϧΛαϒϛοτ͠ɺϥοϓλΠϜΛڝ͏ w"84SF*OWFOU"844VNNJUͰͷ%FFQSBDFS-FBHVFͰ࣮ࡍ ʹΒͤͯϥοϓλΠϜΛڝ͏
https://aws.amazon.com/jp/deepracer/
Ϛωδϝϯτίϯιʔϧ
"84%FFQ3BDFS-FBHVF
Ϟσϧͷֶश
γϛϡϨʔγϣϯ ֶशॳظ
γϛϡϨʔγϣϯ ͋Δఔֶशͨ͠ஈ֊
ػցֶश
ػցֶश֓ཁ ͬ͘͟Γݴ͏ͱنଇੑΛֶशͤ͞Δ͜ͱɻ wڭࢣ͋Γֶश͑Λ༩͑ͯೖྗͱ͑ͷنଇੑΛֶशͤ͞Δ wڭࢣͳֶ͠शɿ͑Λ༩͑ͣʹೖྗͷنଇੑΛֶशͤ͞Δ wڭࢣ͋Γֶशɿجຊతʹ͑Λ༩͑ͣʹೖྗͷنଇੑΛֶशͤ͞ Δ͕ɺ෦తʹ͑Λ༩͑ͯิॿ͢Δ wڧԽֶशɿ͋ΔڥͰใु͕࠷େԽ͢ΔߦಈબͷنଇੑΛֶशͤ͞Δ ͳͲ
χϡʔϥϧωοτϫʔΫ֓ཁ ϑΟʔυϑΥϫʔυ χϡʔϥϧωοτϫʔΫ wೖྗ wόονσʔληοτ͔ΒϥϯμϜʹநग़ wΤϙοΫಉ͡σʔληοτΛ͏ճ wग़ྗ wೖྗ͕//Λ௨ͬͯग़͖ͯͨͷ wྫ
dͷ࣮ͳͲ
ػցֶशྫ ҟৗݕग़
ػցֶशྫ ୯ޠͷຒΊࠐΈ
ػցֶशྫ ΫϥελϦϯά
ڧԽֶश֓ཁ ڥ͔ΒΤʔδΣϯτʹঢ়ଶ ΤʔδΣϯτ͕ঢ়ଶʹج͍ͮͯ ߦಈ ڥ͕ߦಈ݁Ռʹج͍ͮͨใु ΛΤʔδΣϯτ
dΛ܁Γฦ͢ ظతʹ࠷େใु͕Β͑ΔߦಈΛબͿΑ͏ʹֶश͢Δ
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html ը૾͔ΒಛΛऔΓग़ͯ͠ ߦಈఆܨ͕ΔมΛͯ͠ ֤ߦಈͷ֬Λग़ྗ͢Δ
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html PPOͷޣຯ/৽نੑత͕ؔ…
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html PPOͷޣຯ/৽نੑత͕ؔ… ͱ͍͏ײ͡Ͱਂ۷Γ͢Ε৭ʑग़ͯ͘ΔͷͰ ڵຯ͕͋ΔํͥͻௐͯΈ͍ͯͩ͘͞
"84ʹ͓͚Δػցֶश
"84ʹ͓͚Δػցֶश
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ Ϟσϧͷֶश
"NB[PO4BHF.BLFS ػցֶशͷϑϧϚωʔδυαʔϏε w+VQZUFSϊʔτϒοΫͷϗεςΟϯά wػցֶशϞσϧͷֶश wػցֶशϞσϧͷϗεςΟϯά wϥϕϧ͚ͮ Ξϊςʔγϣϯ ͷཧ ͳͲ
DeepRacerͰ༻
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ AWS RoboMaker Ϟσϧͷֶश γϛϡϨʔγϣϯ
"843PCP.BLFS ϩϘοτΞϓϦέʔγϣϯͷ։ൃΛαϙʔτ͢ΔαʔϏε wϑϧϚωʔδυͳγϛϡϨʔγϣϯαʔϏε w$MPVEͱ࿈ܞͨ͠։ൃڥ w304ͷΫϥυ֦ு wϑϦʔτϚωδϝϯτ ͳͲ DeepRacerͰ༻
"84%FFQ3BDFS վΊͯ
"84%FFQ3BDFS RoboMakerͰͷγϛϡϨʔγϣϯͱ SageMakerͰͷϞσϧͷֶशΛ܁Γฦ͢
ϞσϧΛֶशͤͯ͞ https://console.aws.amazon.com/deepracer/home?region=us-east-1#welcome
"84%FFQ3BDFS-FBHVFʹग़ͯ https://console.aws.amazon.com/deepracer/home?region=us-east-1#leaderboards
ϥϯΧʔʜ
%FFQ3BDFSͰ ԿΛͲ͏ֶΔͷ͔
ػցֶशλεΫͷઃܭϞσϧͷվળʹ͍ͭͯମݧ&ֶΔ
ԿΛֶΔͷ͔ʜ wػցֶशλεΫͷઃܭ wϞσϧͷվળ wϋΠύʔύϥϝʔλͷௐ ͳͲ
ػցֶशλεΫͷઃܭ wػցֶशΛͬͨͷղ͖ํͷམͱ͠ࠐΈ wใुؔͷઃܭ wୡ͢Δͷ͕͍͠తΛؒతʹୡͰ͖ΔΑ͏ͳαϒλεΫͷઃఆ ͳͲʹྨࣅ wϥοϓλΠϜ͕͘͢ΔͨΊʹͲ͏ΒͤΕɺͲ͏ֶशͤ͞Εʜ
ใुؔ
ߦಈύλʔϯ
Ϟσϧͷվળ wγϛϡϨʔγϣϯϩάΛͬͨϞσϧͷಛੳ wҙਤͨ͠௨Γʹֶशͯ͠Δ͔ɺͬͯΔ͔Λ֬ೝ͠ɺվળʹ ͭͳ͛Δ w࣮ݧͷ܁Γฦ͠
ใु
Τϯτϩϐʔ
ϋΠύʔύϥϝʔλͷௐ wϞσϧͷֶशͷਐΊํΛௐ͢Δ wχϡʔϥϧωοτϫʔΫޯ߱Լ๏ɺ110ͳͲͷಛੑʹԠ ͨ͡࠷దԽ
%FFQ3BDFSʹ͓͚ΔϋΠύʔύϥϝʔλ
ԿΛֶΔͷ͔ʜ wػցֶशλεΫͷઃܭ wػցֶशΛͬͨͷղ͖ํͷམͱ͠ࠐΈ w͍ϥοϓλΠϜ͕ग़͍ͨ͠Ͳ͏ΒͤΕɺͲ͏ֶशͤ͞Ε͍͍ͷ͔ʜ wϞσϧͷվળ wγϛϡϨʔγϣϯϩάΛͬͨϞσϧͷಛੳ wҙਤͨ͠௨Γʹֶशͯ͠Δ͔ɺͬͯΔ͔֬ೝ͠ɺվળʹͭͳ͛Δ wϋΠύʔύϥϝʔλͷௐ wϞσϧͷֶशͷਐΊํΛௐ͢Δ
%FFQ3BDFSΛͬͯΈΔ
Ϛωδϝϯτίϯιʔϧ
ϞσϧҰཡ
Ϟσϧ࡞
Ϧιʔεͷ࡞
Ϟσϧ໊
ίʔεબ
ߦಈઃఆ
ߦಈύλʔϯ
ใुؔ
ใुؔͷαϯϓϧ
ϋΠύʔύϥϝʔλ
ֶश࣌ؒ
ֶश։࢝
ϞσϧҰཡ
ֶशը໘
3PCP.BLFSͷγϛϡϨʔγϣϯπʔϧ
(B[FCPͰͷγϛϡϨʔγϣϯը໘
ֶशྃ
όʔνϟϧϦʔά
όʔνϟϧϦʔά
όʔνϟϧϦʔάʹొ͢Δ
ԾϦʔάʹొ͢Δ
ԾϦʔάʹొ͢Δ
Ϟσϧαϒϛοτޙ
ϞσϧධՁத
ϞσϧධՁྃ ͤͣ…
ϦʔμʔϘʔυ
·ͱΊ
·ͱΊ w%FFQ3BDFSͰػցֶशɺڧԽֶशʹ৮ΕΔ͜ͱ͕Ͱ͖Δ wࣄલࣝ΄ͱΜͲඞཁͳ͘ɺखܰʹ࢝ΊΒΕΔ wແྉ͋ΔͨΊɺͱΓ͋͑ͣͬͯΈΔͷ͕͓͢͢Ί wͨͩ͠ɺແྉΛ͑Δͱ҆͘ͳ͍ͷͰɺΓ͗͢ҙ ڵຯΛ࣋ͬͨ༰ΛͲΜͲΜ۷ΓԼ͍͛ͯͬͯ Ώ͘Ώ͘ػցֶशڧऀʜ
͋Γ͕ͱ͏͍͟͝·ͨ͠