Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeepRacerで始める機械学習
Search
tandfy
October 11, 2019
Programming
1
1.6k
DeepRacerで始める機械学習
tandfy
October 11, 2019
Tweet
Share
More Decks by tandfy
See All by tandfy
アプリから集まるイベントデータのリアルタイム処理入門
tandfy
0
1.4k
Amazon SageMakerの最新アップデートの紹介
tandfy
1
860
Amazon Personalizeではじめるレコメンドサービス
tandfy
0
1k
DeepRacerで学ぶ機械学習 1.1
tandfy
0
940
DeepRacerでまなぶ強化学習
tandfy
1
1.3k
Amazon SageMakerではじめる物体検出
tandfy
1
990
Other Decks in Programming
See All in Programming
Contemporary Test Cases
maaretp
0
140
型付き API リクエストを実現するいくつかの手法とその選択 / Typed API Request
euxn23
8
2.2k
リアーキテクチャxDDD 1年間の取り組みと進化
hsawaji
1
220
Quine, Polyglot, 良いコード
qnighy
4
650
エンジニアとして関わる要件と仕様(公開用)
murabayashi
0
300
ヤプリ新卒SREの オンボーディング
masaki12
0
130
Figma Dev Modeで変わる!Flutterの開発体験
watanave
0
140
Macとオーディオ再生 2024/11/02
yusukeito
0
370
Kaigi on Rails 2024 〜運営の裏側〜
krpk1900
1
230
とにかくAWS GameDay!AWSは世界の共通言語! / Anyway, AWS GameDay! AWS is the world's lingua franca!
seike460
PRO
1
900
Nurturing OpenJDK distribution: Eclipse Temurin Success History and plan
ivargrimstad
0
960
Jakarta EE meets AI
ivargrimstad
0
220
Featured
See All Featured
How to Ace a Technical Interview
jacobian
276
23k
What’s in a name? Adding method to the madness
productmarketing
PRO
22
3.1k
A Philosophy of Restraint
colly
203
16k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
26
2.1k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.3k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
8
900
The Illustrated Children's Guide to Kubernetes
chrisshort
48
48k
5 minutes of I Can Smell Your CMS
philhawksworth
202
19k
Optimizing for Happiness
mojombo
376
70k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
0
100
How STYLIGHT went responsive
nonsquared
95
5.2k
A Modern Web Designer's Workflow
chriscoyier
693
190k
Transcript
%FFQ3BDFSͰ࢝ΊΔػցֶश σʔλΞφϦςΟΫεࣄۀຊ෦ΠϯςάϨʔγϣϯ෦ େᖒ༐ే
ࣗݾհ େᖒ༐ే σʔλΞφϦςΟΫεࣄۀຊ෦ΠϯςάϨʔγϣϯ෦ ػցֶशνʔϜΤϯδχΞ ݄ೖࣾ ݄ҭٳ ݱࡏɺࣾձ෮ؼத
ࠓ͢͜ͱ w"84%FFQ3BDFSͱ wػցֶशͷ֓ཁ w"84ʹ͓͚ΔػցֶशαʔϏε w"84%FFQ3BDFSͰԿΛͲ͏ֶΔͷ͔ w"84%FFQ3BDFSΛ࣮ࡍʹͬͯΈΔ όʔνϟϧϦʔάฤ
εϥΠυޙͰೖख͢Δ͜ͱ͕ग़དྷ·͢ͷͰ ൃදதͷ༰ΛϝϞ͢Δඞཁ͋Γ·ͤΜɻ ࣸਅࡱӨΛ͢Δ߹ ϑϥογϡɾγϟολʔԻ͕ग़ͳ͍Α͏ʹྀ͍ͩ͘͝͞ Attention
"84%FFQ3BDFS
https://aws.amazon.com/jp/deepracer/
"84%FFQ3BDFS "84্ͰϞσϧΛֶशͤͯ͞ɺϥδίϯͰࣗಈӡస wϚωδϝϯτίϯιʔϧ͔ΒϞσϧΛֶश wεέʔϧͷϥδίϯʹϞσϧΛࡌͤΔ͜ͱͰࣗಈӡస wόʔνϟϧϦʔάʹϞσϧΛαϒϛοτ͠ɺϥοϓλΠϜΛڝ͏ w"84SF*OWFOU"844VNNJUͰͷ%FFQSBDFS-FBHVFͰ࣮ࡍ ʹΒͤͯϥοϓλΠϜΛڝ͏
https://aws.amazon.com/jp/deepracer/
Ϛωδϝϯτίϯιʔϧ
"84%FFQ3BDFS-FBHVF
Ϟσϧͷֶश
γϛϡϨʔγϣϯ ֶशॳظ
γϛϡϨʔγϣϯ ͋Δఔֶशͨ͠ஈ֊
ػցֶश
ػցֶश֓ཁ ͬ͘͟Γݴ͏ͱنଇੑΛֶशͤ͞Δ͜ͱɻ wڭࢣ͋Γֶश͑Λ༩͑ͯೖྗͱ͑ͷنଇੑΛֶशͤ͞Δ wڭࢣͳֶ͠शɿ͑Λ༩͑ͣʹೖྗͷنଇੑΛֶशͤ͞Δ wڭࢣ͋Γֶशɿجຊతʹ͑Λ༩͑ͣʹೖྗͷنଇੑΛֶशͤ͞ Δ͕ɺ෦తʹ͑Λ༩͑ͯิॿ͢Δ wڧԽֶशɿ͋ΔڥͰใु͕࠷େԽ͢ΔߦಈબͷنଇੑΛֶशͤ͞Δ ͳͲ
χϡʔϥϧωοτϫʔΫ֓ཁ ϑΟʔυϑΥϫʔυ χϡʔϥϧωοτϫʔΫ wೖྗ wόονσʔληοτ͔ΒϥϯμϜʹநग़ wΤϙοΫಉ͡σʔληοτΛ͏ճ wग़ྗ wೖྗ͕//Λ௨ͬͯग़͖ͯͨͷ wྫ
dͷ࣮ͳͲ
ػցֶशྫ ҟৗݕग़
ػցֶशྫ ୯ޠͷຒΊࠐΈ
ػցֶशྫ ΫϥελϦϯά
ڧԽֶश֓ཁ ڥ͔ΒΤʔδΣϯτʹঢ়ଶ ΤʔδΣϯτ͕ঢ়ଶʹج͍ͮͯ ߦಈ ڥ͕ߦಈ݁Ռʹج͍ͮͨใु ΛΤʔδΣϯτ
dΛ܁Γฦ͢ ظతʹ࠷େใु͕Β͑ΔߦಈΛબͿΑ͏ʹֶश͢Δ
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html ը૾͔ΒಛΛऔΓग़ͯ͠ ߦಈఆܨ͕ΔมΛͯ͠ ֤ߦಈͷ֬Λग़ྗ͢Δ
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html PPOͷޣຯ/৽نੑత͕ؔ…
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html PPOͷޣຯ/৽نੑత͕ؔ… ͱ͍͏ײ͡Ͱਂ۷Γ͢Ε৭ʑग़ͯ͘ΔͷͰ ڵຯ͕͋ΔํͥͻௐͯΈ͍ͯͩ͘͞
"84ʹ͓͚Δػցֶश
"84ʹ͓͚Δػցֶश
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ Ϟσϧͷֶश
"NB[PO4BHF.BLFS ػցֶशͷϑϧϚωʔδυαʔϏε w+VQZUFSϊʔτϒοΫͷϗεςΟϯά wػցֶशϞσϧͷֶश wػցֶशϞσϧͷϗεςΟϯά wϥϕϧ͚ͮ Ξϊςʔγϣϯ ͷཧ ͳͲ
DeepRacerͰ༻
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ AWS RoboMaker Ϟσϧͷֶश γϛϡϨʔγϣϯ
"843PCP.BLFS ϩϘοτΞϓϦέʔγϣϯͷ։ൃΛαϙʔτ͢ΔαʔϏε wϑϧϚωʔδυͳγϛϡϨʔγϣϯαʔϏε w$MPVEͱ࿈ܞͨ͠։ൃڥ w304ͷΫϥυ֦ு wϑϦʔτϚωδϝϯτ ͳͲ DeepRacerͰ༻
"84%FFQ3BDFS վΊͯ
"84%FFQ3BDFS RoboMakerͰͷγϛϡϨʔγϣϯͱ SageMakerͰͷϞσϧͷֶशΛ܁Γฦ͢
ϞσϧΛֶशͤͯ͞ https://console.aws.amazon.com/deepracer/home?region=us-east-1#welcome
"84%FFQ3BDFS-FBHVFʹग़ͯ https://console.aws.amazon.com/deepracer/home?region=us-east-1#leaderboards
ϥϯΧʔʜ
%FFQ3BDFSͰ ԿΛͲ͏ֶΔͷ͔
ػցֶशλεΫͷઃܭϞσϧͷվળʹ͍ͭͯମݧ&ֶΔ
ԿΛֶΔͷ͔ʜ wػցֶशλεΫͷઃܭ wϞσϧͷվળ wϋΠύʔύϥϝʔλͷௐ ͳͲ
ػցֶशλεΫͷઃܭ wػցֶशΛͬͨͷղ͖ํͷམͱ͠ࠐΈ wใुؔͷઃܭ wୡ͢Δͷ͕͍͠తΛؒతʹୡͰ͖ΔΑ͏ͳαϒλεΫͷઃఆ ͳͲʹྨࣅ wϥοϓλΠϜ͕͘͢ΔͨΊʹͲ͏ΒͤΕɺͲ͏ֶशͤ͞Εʜ
ใुؔ
ߦಈύλʔϯ
Ϟσϧͷվળ wγϛϡϨʔγϣϯϩάΛͬͨϞσϧͷಛੳ wҙਤͨ͠௨Γʹֶशͯ͠Δ͔ɺͬͯΔ͔Λ֬ೝ͠ɺվળʹ ͭͳ͛Δ w࣮ݧͷ܁Γฦ͠
ใु
Τϯτϩϐʔ
ϋΠύʔύϥϝʔλͷௐ wϞσϧͷֶशͷਐΊํΛௐ͢Δ wχϡʔϥϧωοτϫʔΫޯ߱Լ๏ɺ110ͳͲͷಛੑʹԠ ͨ͡࠷దԽ
%FFQ3BDFSʹ͓͚ΔϋΠύʔύϥϝʔλ
ԿΛֶΔͷ͔ʜ wػցֶशλεΫͷઃܭ wػցֶशΛͬͨͷղ͖ํͷམͱ͠ࠐΈ w͍ϥοϓλΠϜ͕ग़͍ͨ͠Ͳ͏ΒͤΕɺͲ͏ֶशͤ͞Ε͍͍ͷ͔ʜ wϞσϧͷվળ wγϛϡϨʔγϣϯϩάΛͬͨϞσϧͷಛੳ wҙਤͨ͠௨Γʹֶशͯ͠Δ͔ɺͬͯΔ͔֬ೝ͠ɺվળʹͭͳ͛Δ wϋΠύʔύϥϝʔλͷௐ wϞσϧͷֶशͷਐΊํΛௐ͢Δ
%FFQ3BDFSΛͬͯΈΔ
Ϛωδϝϯτίϯιʔϧ
ϞσϧҰཡ
Ϟσϧ࡞
Ϧιʔεͷ࡞
Ϟσϧ໊
ίʔεબ
ߦಈઃఆ
ߦಈύλʔϯ
ใुؔ
ใुؔͷαϯϓϧ
ϋΠύʔύϥϝʔλ
ֶश࣌ؒ
ֶश։࢝
ϞσϧҰཡ
ֶशը໘
3PCP.BLFSͷγϛϡϨʔγϣϯπʔϧ
(B[FCPͰͷγϛϡϨʔγϣϯը໘
ֶशྃ
όʔνϟϧϦʔά
όʔνϟϧϦʔά
όʔνϟϧϦʔάʹొ͢Δ
ԾϦʔάʹొ͢Δ
ԾϦʔάʹొ͢Δ
Ϟσϧαϒϛοτޙ
ϞσϧධՁத
ϞσϧධՁྃ ͤͣ…
ϦʔμʔϘʔυ
·ͱΊ
·ͱΊ w%FFQ3BDFSͰػցֶशɺڧԽֶशʹ৮ΕΔ͜ͱ͕Ͱ͖Δ wࣄલࣝ΄ͱΜͲඞཁͳ͘ɺखܰʹ࢝ΊΒΕΔ wແྉ͋ΔͨΊɺͱΓ͋͑ͣͬͯΈΔͷ͕͓͢͢Ί wͨͩ͠ɺແྉΛ͑Δͱ҆͘ͳ͍ͷͰɺΓ͗͢ҙ ڵຯΛ࣋ͬͨ༰ΛͲΜͲΜ۷ΓԼ͍͛ͯͬͯ Ώ͘Ώ͘ػցֶशڧऀʜ
͋Γ͕ͱ͏͍͟͝·ͨ͠