Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
第3回ソーイAI勉強会:深層学習基礎 最終回
Search
sewii
May 30, 2025
0
61
第3回ソーイAI勉強会:深層学習基礎 最終回
sewii
May 30, 2025
Tweet
Share
More Decks by sewii
See All by sewii
第4回ソーイAI勉強会:自然言語処理
sewiiinc
0
6
第1回ソーイAI勉強会:機械学習と深層学習
sewiiinc
0
53
ソーイAI勉強会 第2回:深層学習の計算
sewiiinc
0
44
Featured
See All Featured
The Cost Of JavaScript in 2023
addyosmani
51
8.5k
Raft: Consensus for Rubyists
vanstee
140
7k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
50k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Code Reviewing Like a Champion
maltzj
524
40k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
Rails Girls Zürich Keynote
gr2m
94
14k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
48
5.4k
Designing for Performance
lara
609
69k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3.1k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Transcript
ୈճɿਂֶशجૅ࠷ऴճ
લճ·Ͱͷ෮श ਫ਼Λ্͛ΔֶशςΫχοΫʢਖ਼ଇԽɿ%SPQPVUʣ ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣͱʁ
લճ·Ͱͷ෮श
ਂֶशͰͲ͏ݴͬͨ͜ͱΛ͍ͯ͘͠ͷ͔ʁ ਓؒͷΛߟ͑Δ ਆܦࡉ๔ʢχϡʔϩϯʣͷܨ͕Γ ΛཧϞσϧԽ
ೖྗ தؒʢӅΕʣ ग़ྗ தؒͷ͕ଟ͍ˠਂֶशͱݺͿ
ͰதؒͰͲͷΑ͏ͳܭࢉΛߦ͏ͷ͔ʁ
Y Y C X X B
χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽʢΑΓৄࡉʹʣ Zͱͯ͠ग़ྗ Z I B ׆ੑԽؔ
ଛࣦؔʢϩεؔʣΛ༻͍Δ ਂֶशͰɺ
ޯ๏ͱɺ ͜ͷଛࣦؔΛখ͍ͯ͘͘͞͠ख๏Λࢦ͢
ॏΈʢXʣ ଛࣦؔʢ&ʣ ϶X ޯෛ ߋ৽લ ߋ৽ޙ ͲͷΑ͏ʹॏΈ͕ߋ৽͞ΕΔͷ͔ʁ wnew = wold
− η × ∂E ∂w ʢྫʣޯ͕ෛ ˠ"ਖ਼ ˠߋ৽લͷXʹ"͕͞ΕΔ ˠXӈʹҠಈʢߋ৽ʣ "ͱ͢Δ
wnew = wold − η × ∂E ∂w ˣˣˣॏΈͷܭࢉɺԼͷࣜͰٻΊ͍͚͍͍ͯ X
X X ॏΈͷมԽΛΈΑ͏ʂ ˠXΛಈ͔ͯ͠ΈΔ ˠXΛΛม͑Δͱͦͷ͋ͱશͯʹӨڹ ˠܭࢉ͕େมʂʂ ॱ
ޡࠩٯ๏ɿ ॏΈύϥϝʔλʹΑΔޯͷܭࢉΛޮྑ͘ߦͳ͏ํ๏ɻ ˞ॏΈͷߋ৽ˠޯ ▶︎ ͳʹ͕ٯͳͷ͔ʁ ग़ྗΛελʔτͱͯ͠ɺॏΈͷ ߋ৽Λߟ͑Δ ٯ
ޡࠩٯ๏ͰޯΛٻΊΔͷܭࢉ͕͍͠ͷͰলུ͢Δ͕ɺ ޡࠩٯ๏Λ͏ͱ ʮग़ྗͰͷਖ਼ղϥϕϧͱͷޡࠩʯ͕Θ͔Ε શͯͷޯ͕Θ͔Δɻ
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷֶशํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ͦͷζϨΛͬͯҰؾʹޯ Λܭࢉ ֶशΛ͔͚ͯॏΈΛम wnew = wold
− η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷਪํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ͦͷζϨΛͬͯҰؾʹޯ Λܭࢉ ֶशΛ͔͚ͯॏΈΛम wnew = wold
− η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
ਫ਼Λ্͛ΔֶशςΫχοΫ
աֶशɿֶशʹΘΕͨσʔλʹաʹͯ·ͬͯ͠·͏͜ͱɻ
IUUQTRJJUBDPNDFWBQPSBUPSJUFNTGCFFFGD
ਖ਼ଇԽͱԿ͔ʁ
ਖ਼ଇԽˠաֶशΛ͙ํ๏ ਂֶशͰ༻͍ΒΕΔਖ਼ଇԽͱͯ͠ɺ8FJHIU %FDBZͱ%SPQPVUͳͲ͕͋Δɻ ˠ%SPQPVUʹ͍ͭͯઆ໌͢Δ
%SPQPVUʹ͍ͭͯ IUUQTEBUBBOBMZUJDTGVOVOEFSTUBOEJOHESPQPVU χϡʔϩϯΛϥϯμϜʹফڈֶͯ͠श͢Δํ๏
ʲಛʳ ಛఆͷχϡʔϩϯͷґଘΛݮ Β͢͜ͱͰΦʔόʔϑΟοςΟϯ άΛݮΒ͢ɻ
ʲಛ̎ʳ ෳͷϞσϧΛߏங֤͠Ϟσϧͷ༧ଌΛฏۉ͢Δͱɺଟ͘ͷ ߹Ͱ༧ଌਫ਼্͕͕ΔʢDGΞϯαϯϒϧֶशʣ
ˠόονਖ਼نԽɿޯফࣦɾޯരൃΛ͙ํ๏ %SPQPVUҎ֎ʹਂֶशͰޯരൃɺޯফࣦɺաֶश Λղܾ͢ΔͨΊʹ͍͔ͭ͘ͷํ๏͕औΒΕ͍ͯΔɻ ˠॏΈͷॳظʢখ͘͢͞ΔʣɿաֶशΛ͑Δ ˠ--ਖ਼ଇԽɿաֶशΛ͑Δ
ิ ʢཧ༝ʣॏΈ͕େ͖ա͗Δͱೖྗ৴߸͕աେʹͳͬͯ͠·͏ ೖྗͷ߹ܭ ग़ྗ ೖྗ͕େ͖ա͗Δͱ ग़ྗͷදݱྗ͕গͳ͘ͳΔ
Y Y C X X B
χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽʢΑΓৄࡉʹʣ Zͱͯ͠ग़ྗ Z I B ׆ੑԽؔ
·ͱΊ ޯരൃɺޯফࣦɺաֶशͱ͍ͬͨ՝Λղܾ͢ΔͨΊʹ ͨ͘͞Μͷํ๏͕औΒΕ͍ͯΔɻ ਖ਼ଇԽաֶशΛ͑ΔͨΊʹ༻͍Δख๏ %SPQPVUਖ਼ଇԽͷҰͭͰχϡʔϩϯΛϥϯμϜʹফڈͯ͠ ֶश͢Δํ๏
ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣͱʁ
͜Ε·Ͱֶशͨ͠ਂֶशͰ ʮը૾ʯΛͲͷΑ͏ʹදݱ͍ͯͨ͠ͷ͔ʁ IUUQT[FSPPOFKQMFBSOJOHCMPHDOOGPSCFHJOOFST ύϥϝʔλͷΛݮΒ͢͜ͱͰܭࢉྔΛԼ͛Δɻ
̎࣍ݩ͔Β̍࣍ݩʹ͢Δ࣌ʹը૾ͷॏཁͳҐஔใ͕ࣦΘΕͯ͠·͏ɻ
̏࣍ݩͷใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏங͍ͨ͠ʂʂ ը૾σʔλ3(#ͷΛؚΊͯ̏࣍ݩ ͷσʔλʹͳ͍ͬͯΔɻ
̏࣍ݩͷใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏங͍ͨ͠ʂʂ ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣ ը૾σʔλ3(#ͷΛؚΊͯ̏࣍ݩ ͷσʔλʹͳ͍ͬͯΔɻ
$//ͷߏ
$//ͷߏ ΈࠐΈ ׆ੑԽؔ ϓʔϦϯά
ΈࠐΈ
͜Ε·ͰೖྗͷॏཁੑΛ ॏΈʢόΠΞεʣʹΑͬͯཧ͍ͯͨ͠ɻ ˞ॏΈˠೖྗͷॏཁੑ
$//ͰɺॏΈͰͳ͘ϑΟϧλΛ༻͍Δ IUUQT[FSPPOFKQBJXPSEDPOWPMVUJPO ˞ΈࠐΈͰͷग़ྗσʔλΛಛϚοϓͱ͍͏
IUUQTRJJUBDPNOWUPNPJUFNTBGGE ff BCF ΈࠐΈԋࢉͷํ๏ ۙ͘ͷใΛҡ࣋ͨ͠·· ಛྔΛநग़Ͱ͖ͨʂʂ
ΈࠐΈͷϙΠϯτ ΈࠐΈͰɹಛྔͷநग़͕͍ͪΜͷత ը૾ʹ͓͚ΔҐஔใΛอ࣋ͨ͠··ಛΛநग़Ͱ͖Δ
ϓʔϦϯά
நग़͞Εͨಛʹରͯ͠ ʮϩόετੑʢ҆ఆੑʣʯΛ༩͑Δ IUUQTBJTNJMFZDPKQBJ@OFXTDOO ˞ҰͭҰͭͷΈࠐΈԋࢉΛߦͳͬͨޙɺ׆ੑԽؔΛ௨ͯ͠ग़ ྗ͞Εͨಛͷڧ͞Λද͢ɻ
ಛ͕ը૾ͷͲ͜ʹ͋Δ͔ʹࠨӈ͞ΕͣʹॲཧͰ͖ΔΑ͏ʹ͢Δ ը૾̍ ը૾̎
ˠ͜ͷ߹ɺʮ͕͋Δ͔Ͳ͏͔ʯ͕େࣄʂʂ
ಛྔͷ࠷େฏۉΛऔΔ͜ͱͰ ಛྔͷҠಈʢͣΕʣʹڧ͘ͳΔʂʂ ϓʔϦϯάͷϙΠϯτ
$//ͷ·ͱΊ ̏࣍ݩͷใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏஙͰ͖Δ
࣮ࡍͰ$//ͲͷΑ͏ͳߏͰ༻͍ΒΕΔ͔ʁ
IUUQTYUFDIOJLLFJDPNBUDMMFBSOJOHMFDUVSF ʮΈࠐΈ ϓʔϦϯάʯΛԿॏͶɺ ࠷ޙʹશ݁߹ͰଛࣦؔΛग़ྗ
$//ը૾ೝࣝԻೝࣝͰݱࡏͰඇৗʹ׆ൃʹར༻͞Ε͍ͯΔɻ IUUQTOFXUFDIOPMPHZMJGFTUZMFOFUZPMPEBSLOF IUUQTDWNMFYQFSUHVJEFOFUDBUFHPSZUFSNTEMIVNBOQPTFFTUJBNUJPO IUUQTXXXTLJMMVQBJDPNCMPHUFDITFHNFOUBUJPO ηάϝϯςʔγϣϯ ࢟ਪఆ ମݕग़ ը૾தͷͯ͢ͷϐΫηϧʹҙຯʢΫϥεʣΛׂΓͯΔ ྫ
ˠं ˠೣ
࣍ճͷ༧ఆ
ࣗવݴޠॲཧ