Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
第3回ソーイAI勉強会:深層学習基礎 最終回
Search
sewii
May 30, 2025
0
71
第3回ソーイAI勉強会:深層学習基礎 最終回
sewii
May 30, 2025
Tweet
Share
More Decks by sewii
See All by sewii
第5回ソーイAI勉強会:自然言語処理 Part2
sewiiinc
0
35
第4回ソーイAI勉強会:自然言語処理
sewiiinc
0
26
第1回ソーイAI勉強会:機械学習と深層学習
sewiiinc
0
63
ソーイAI勉強会 第2回:深層学習の計算
sewiiinc
0
53
Featured
See All Featured
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
Adopting Sorbet at Scale
ufuk
77
9.5k
Mobile First: as difficult as doing things right
swwweet
223
9.7k
Scaling GitHub
holman
461
140k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
8
720
Why Our Code Smells
bkeepers
PRO
337
57k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.8k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
760
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
45
7.5k
Building Applications with DynamoDB
mza
95
6.5k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Making the Leap to Tech Lead
cromwellryan
134
9.4k
Transcript
ୈճɿਂֶशجૅ࠷ऴճ
લճ·Ͱͷ෮श ਫ਼Λ্͛ΔֶशςΫχοΫʢਖ਼ଇԽɿ%SPQPVUʣ ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣͱʁ
લճ·Ͱͷ෮श
ਂֶशͰͲ͏ݴͬͨ͜ͱΛ͍ͯ͘͠ͷ͔ʁ ਓؒͷΛߟ͑Δ ਆܦࡉ๔ʢχϡʔϩϯʣͷܨ͕Γ ΛཧϞσϧԽ
ೖྗ தؒʢӅΕʣ ग़ྗ தؒͷ͕ଟ͍ˠਂֶशͱݺͿ
ͰதؒͰͲͷΑ͏ͳܭࢉΛߦ͏ͷ͔ʁ
Y Y C X X B
χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽʢΑΓৄࡉʹʣ Zͱͯ͠ग़ྗ Z I B ׆ੑԽؔ
ଛࣦؔʢϩεؔʣΛ༻͍Δ ਂֶशͰɺ
ޯ๏ͱɺ ͜ͷଛࣦؔΛখ͍ͯ͘͘͞͠ख๏Λࢦ͢
ॏΈʢXʣ ଛࣦؔʢ&ʣ ϶X ޯෛ ߋ৽લ ߋ৽ޙ ͲͷΑ͏ʹॏΈ͕ߋ৽͞ΕΔͷ͔ʁ wnew = wold
− η × ∂E ∂w ʢྫʣޯ͕ෛ ˠ"ਖ਼ ˠߋ৽લͷXʹ"͕͞ΕΔ ˠXӈʹҠಈʢߋ৽ʣ "ͱ͢Δ
wnew = wold − η × ∂E ∂w ˣˣˣॏΈͷܭࢉɺԼͷࣜͰٻΊ͍͚͍͍ͯ X
X X ॏΈͷมԽΛΈΑ͏ʂ ˠXΛಈ͔ͯ͠ΈΔ ˠXΛΛม͑Δͱͦͷ͋ͱશͯʹӨڹ ˠܭࢉ͕େมʂʂ ॱ
ޡࠩٯ๏ɿ ॏΈύϥϝʔλʹΑΔޯͷܭࢉΛޮྑ͘ߦͳ͏ํ๏ɻ ˞ॏΈͷߋ৽ˠޯ ▶︎ ͳʹ͕ٯͳͷ͔ʁ ग़ྗΛελʔτͱͯ͠ɺॏΈͷ ߋ৽Λߟ͑Δ ٯ
ޡࠩٯ๏ͰޯΛٻΊΔͷܭࢉ͕͍͠ͷͰলུ͢Δ͕ɺ ޡࠩٯ๏Λ͏ͱ ʮग़ྗͰͷਖ਼ղϥϕϧͱͷޡࠩʯ͕Θ͔Ε શͯͷޯ͕Θ͔Δɻ
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷֶशํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ͦͷζϨΛͬͯҰؾʹޯ Λܭࢉ ֶशΛ͔͚ͯॏΈΛम wnew = wold
− η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷਪํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ͦͷζϨΛͬͯҰؾʹޯ Λܭࢉ ֶशΛ͔͚ͯॏΈΛम wnew = wold
− η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
ਫ਼Λ্͛ΔֶशςΫχοΫ
աֶशɿֶशʹΘΕͨσʔλʹաʹͯ·ͬͯ͠·͏͜ͱɻ
IUUQTRJJUBDPNDFWBQPSBUPSJUFNTGCFFFGD
ਖ਼ଇԽͱԿ͔ʁ
ਖ਼ଇԽˠաֶशΛ͙ํ๏ ਂֶशͰ༻͍ΒΕΔਖ਼ଇԽͱͯ͠ɺ8FJHIU %FDBZͱ%SPQPVUͳͲ͕͋Δɻ ˠ%SPQPVUʹ͍ͭͯઆ໌͢Δ
%SPQPVUʹ͍ͭͯ IUUQTEBUBBOBMZUJDTGVOVOEFSTUBOEJOHESPQPVU χϡʔϩϯΛϥϯμϜʹফڈֶͯ͠श͢Δํ๏
ʲಛʳ ಛఆͷχϡʔϩϯͷґଘΛݮ Β͢͜ͱͰΦʔόʔϑΟοςΟϯ άΛݮΒ͢ɻ
ʲಛ̎ʳ ෳͷϞσϧΛߏங֤͠Ϟσϧͷ༧ଌΛฏۉ͢Δͱɺଟ͘ͷ ߹Ͱ༧ଌਫ਼্͕͕ΔʢDGΞϯαϯϒϧֶशʣ
ˠόονਖ਼نԽɿޯফࣦɾޯരൃΛ͙ํ๏ %SPQPVUҎ֎ʹਂֶशͰޯരൃɺޯফࣦɺաֶश Λղܾ͢ΔͨΊʹ͍͔ͭ͘ͷํ๏͕औΒΕ͍ͯΔɻ ˠॏΈͷॳظʢখ͘͢͞ΔʣɿաֶशΛ͑Δ ˠ--ਖ਼ଇԽɿաֶशΛ͑Δ
ิ ʢཧ༝ʣॏΈ͕େ͖ա͗Δͱೖྗ৴߸͕աେʹͳͬͯ͠·͏ ೖྗͷ߹ܭ ग़ྗ ೖྗ͕େ͖ա͗Δͱ ग़ྗͷදݱྗ͕গͳ͘ͳΔ
Y Y C X X B
χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽʢΑΓৄࡉʹʣ Zͱͯ͠ग़ྗ Z I B ׆ੑԽؔ
·ͱΊ ޯരൃɺޯফࣦɺաֶशͱ͍ͬͨ՝Λղܾ͢ΔͨΊʹ ͨ͘͞Μͷํ๏͕औΒΕ͍ͯΔɻ ਖ਼ଇԽաֶशΛ͑ΔͨΊʹ༻͍Δख๏ %SPQPVUਖ਼ଇԽͷҰͭͰχϡʔϩϯΛϥϯμϜʹফڈͯ͠ ֶश͢Δํ๏
ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣͱʁ
͜Ε·Ͱֶशͨ͠ਂֶशͰ ʮը૾ʯΛͲͷΑ͏ʹදݱ͍ͯͨ͠ͷ͔ʁ IUUQT[FSPPOFKQMFBSOJOHCMPHDOOGPSCFHJOOFST ύϥϝʔλͷΛݮΒ͢͜ͱͰܭࢉྔΛԼ͛Δɻ
̎࣍ݩ͔Β̍࣍ݩʹ͢Δ࣌ʹը૾ͷॏཁͳҐஔใ͕ࣦΘΕͯ͠·͏ɻ
̏࣍ݩͷใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏங͍ͨ͠ʂʂ ը૾σʔλ3(#ͷΛؚΊͯ̏࣍ݩ ͷσʔλʹͳ͍ͬͯΔɻ
̏࣍ݩͷใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏங͍ͨ͠ʂʂ ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣ ը૾σʔλ3(#ͷΛؚΊͯ̏࣍ݩ ͷσʔλʹͳ͍ͬͯΔɻ
$//ͷߏ
$//ͷߏ ΈࠐΈ ׆ੑԽؔ ϓʔϦϯά
ΈࠐΈ
͜Ε·ͰೖྗͷॏཁੑΛ ॏΈʢόΠΞεʣʹΑͬͯཧ͍ͯͨ͠ɻ ˞ॏΈˠೖྗͷॏཁੑ
$//ͰɺॏΈͰͳ͘ϑΟϧλΛ༻͍Δ IUUQT[FSPPOFKQBJXPSEDPOWPMVUJPO ˞ΈࠐΈͰͷग़ྗσʔλΛಛϚοϓͱ͍͏
IUUQTRJJUBDPNOWUPNPJUFNTBGGE ff BCF ΈࠐΈԋࢉͷํ๏ ۙ͘ͷใΛҡ࣋ͨ͠·· ಛྔΛநग़Ͱ͖ͨʂʂ
ΈࠐΈͷϙΠϯτ ΈࠐΈͰɹಛྔͷநग़͕͍ͪΜͷత ը૾ʹ͓͚ΔҐஔใΛอ࣋ͨ͠··ಛΛநग़Ͱ͖Δ
ϓʔϦϯά
நग़͞Εͨಛʹରͯ͠ ʮϩόετੑʢ҆ఆੑʣʯΛ༩͑Δ IUUQTBJTNJMFZDPKQBJ@OFXTDOO ˞ҰͭҰͭͷΈࠐΈԋࢉΛߦͳͬͨޙɺ׆ੑԽؔΛ௨ͯ͠ग़ ྗ͞Εͨಛͷڧ͞Λද͢ɻ
ಛ͕ը૾ͷͲ͜ʹ͋Δ͔ʹࠨӈ͞ΕͣʹॲཧͰ͖ΔΑ͏ʹ͢Δ ը૾̍ ը૾̎
ˠ͜ͷ߹ɺʮ͕͋Δ͔Ͳ͏͔ʯ͕େࣄʂʂ
ಛྔͷ࠷େฏۉΛऔΔ͜ͱͰ ಛྔͷҠಈʢͣΕʣʹڧ͘ͳΔʂʂ ϓʔϦϯάͷϙΠϯτ
$//ͷ·ͱΊ ̏࣍ݩͷใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏஙͰ͖Δ
࣮ࡍͰ$//ͲͷΑ͏ͳߏͰ༻͍ΒΕΔ͔ʁ
IUUQTYUFDIOJLLFJDPNBUDMMFBSOJOHMFDUVSF ʮΈࠐΈ ϓʔϦϯάʯΛԿॏͶɺ ࠷ޙʹશ݁߹ͰଛࣦؔΛग़ྗ
$//ը૾ೝࣝԻೝࣝͰݱࡏͰඇৗʹ׆ൃʹར༻͞Ε͍ͯΔɻ IUUQTOFXUFDIOPMPHZMJGFTUZMFOFUZPMPEBSLOF IUUQTDWNMFYQFSUHVJEFOFUDBUFHPSZUFSNTEMIVNBOQPTFFTUJBNUJPO IUUQTXXXTLJMMVQBJDPNCMPHUFDITFHNFOUBUJPO ηάϝϯςʔγϣϯ ࢟ਪఆ ମݕग़ ը૾தͷͯ͢ͷϐΫηϧʹҙຯʢΫϥεʣΛׂΓͯΔ ྫ
ˠं ˠೣ
࣍ճͷ༧ఆ
ࣗવݴޠॲཧ