Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeepRacer for learning RL
Search
貞松政史
April 06, 2019
Technology
0
1.2k
DeepRacer for learning RL
2019.4.6 Developers.IO at OKAYAMA.
貞松政史
April 06, 2019
Tweet
Share
More Decks by 貞松政史
See All by 貞松政史
予知保全利用を目指した外観検査AIの開発 〜画像処理AIを用いた外観画像に対する異常検知〜
sadynitro
0
200
20230904_GoogleCloudNext23_Recap_AI_ML
sadynitro
0
630
Foundation Model全盛時代を生きるAI/MLエンジニアの生存戦略
sadynitro
0
730
Amazon SageMakerが存在しない世界線 のAWS上で実現する機械学習基盤
sadynitro
0
120
Amazon SageMakerが存在しない世界線のAWS上で実現する機械学習基盤
sadynitro
0
1.2k
みんな大好き強化学習
sadynitro
0
880
機械学習エンジニアはMLOpsの夢を見るか?
sadynitro
0
1.1k
AWSのAIサービスインテグレーション - AIの仕組みを活用した課題解決
sadynitro
0
920
実践Amazon SageMaker - 全体像からユースケースまで
sadynitro
0
2.3k
Other Decks in Technology
See All in Technology
テストコードの観点から見たSansanのアーキテクチャ変遷
sansantech
PRO
2
180
MAUIでMapの表示
nakasho
0
110
作りすぎない技術 - API時代の開発努力の在り方について考える / Thinking about the state of development efforts in the API era
yokawasa
10
6.2k
RAG構築におけるKendraとPineconeの使い分け
sonoda_mj
2
250
タクシーアプリ『GO』におけるプラットフォームエンジニアリングの実践
mot_techtalk
12
6.1k
生成AIを使った業務効率化〜実践的なプロンプトと活用例の紹介〜
yoshi8__
0
380
アジャイルの灯火を絶やさない! 社内アジャイルコミュニティ運営
hacomono
PRO
1
140
RAGだけじゃない! 古くて新しいベクトル検索の世界 | DevelopersIO 2024 福岡
quiver
1
620
爆速開発文化を支えるProduct Engineerの 開発生産性向上の取り組み
shnjtk
7
3.1k
スクラムエッセンス導入3ヶ月のチームに起きた変化
hacomono
PRO
1
140
[ABC2024Summer]Flutter UX Improvements + α
korodroid
0
240
Startale_Culture_Deck_2024.pdf
startale
0
150
Featured
See All Featured
Writing Fast Ruby
sferik
623
60k
Ruby is Unlike a Banana
tanoku
96
10k
Building Your Own Lightsaber
phodgson
101
5.8k
Designing for humans not robots
tammielis
247
25k
Art, The Web, and Tiny UX
lynnandtonic
290
19k
GitHub's CSS Performance
jonrohan
1025
450k
VelocityConf: Rendering Performance Case Studies
addyosmani
321
23k
How to name files
jennybc
66
95k
Happy Clients
brianwarren
93
6.5k
Git: the NoSQL Database
bkeepers
PRO
423
64k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
128
32k
Embracing the Ebb and Flow
colly
80
4.3k
Transcript
4 D 29 26 1 . 0 I 1
& .-* (2 ,0'/4"# 51 83;7 +)
!&%$9( 6: Attention
3 #cmdevio2019
4 os t m ( L @S g E b
i _d L rMI D @ E ( ( ( ) ( e a n k AWS E
5 DeepRacer
6 D
7 ) (
8 …
9 DeepRacer 4 D 26 9 01 .
10 DeepRacer A A A
11
1 2 3
12 DeepRacer
13
14 DeepRacer 1/18
3D AWS DeepRacer League
15 DeepRacer https://aws.amazon.com/jp/deepracer/
16 DeepRacer ! &%$ +)*2 1 '/*2
(#-, 0. "
17 3D AWS RoboMaker Robot Operating System (ROS) Gazebo rqt
18 AWS DeepRacer League ⁻ 0 1 : 9 A
⁻ 9 2 R ⁻ ⁻ D I ⁻ 1 2 ⁻ https://aws.amazon.com/jp/deepracer/league/
19
20 (Artificial Intelligence, AI) (Machine Learning, ML)
NeuralNetwork DeepLearning
21
22 = 1 (
) ( (
23 L N - ) ( - D Q
24 DeepRacer Cliped PPO PPO (Proximal
Policy Optimization) OpenAI2017
25 ( ( )
)
26 1
27 ) () (
28 DeepRacer
29 DeepRacer + + +
30 DeepRacer
31 DeepRacer …
32 DeepRacer
33 orz
34 DeepRacer + + +
35 DeepRacer D A D
36 $ ' + (# &!
%"
37 ( ) ) https://docs.aws.amazon.com/ja_jp /deepracer/latest/developerguide/ deepracer-train-models-define- reward-function.html
38
39 ⁻ 10 ⁻
:
40 SageMaker RL + RoboMaker
41 SageMeker RLRoboMakerGA
42 SageMaker “RL” ⁻ ⁻ M ⁻ M M
⁻ M ⁻ ⁻ ⁻ J M S
43 DeepRacer ) D ( ) ) ( )
44 SageMaker
https://dev.classmethod.jp/machine -learning/sagemaker-robomaker- deepracer-sample/
45 $# "
! https://github.com/awslabs/amazon-sagemaker-examples
46 Jupyter !
47 ( ( )
48
49 2 1
50 2 2
51 (. ( )(
52 $2# " /1(+ $2#,- ! https://docs.aws.amazon.com/ja_jp/deepracer/latest/developerguide/deepracer -iteratively-enhance-reward-functions.html *
$2%) '.0& )
53 Best Practices when training with PPO
(Unity Technologies) https://github.com/Unity-Technologies/ml-agents/blob/master/docs/Training-PPO.md
54 DeepRacer "% ! "%
$# ! !
55 DeepRacer
56 DeepRacer
57 DeepRacer
58 DeepRacer
59 DeepRacer
60
61 • g • + + • M D c
• R S D a k • b • LL e
62 DeepRacer
None