第3回ソーイAI勉強会：深層学習基礎 最終回

Transcript

1. ୈճɿਂ૚ֶशجૅ
   ࠷ऴճ
2. 
   લճ·Ͱͷ෮श 
   ਫ਼౓Λ্͛ΔֶशςΫχοΫʢਖ਼ଇԽɿ%SPQPVUʣ 
   ৞ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣͱ͸ʁ
3. લճ·Ͱͷ෮श
4. ਂ૚ֶशͰ͸Ͳ͏ݴͬͨ͜ͱΛ͍ͯ͘͠ͷ͔ʁ ਓؒͷ೴Λߟ͑Δ ਆܦࡉ๔ʢχϡʔϩϯʣͷܨ͕Γ Λ਺ཧϞσϧԽ
5. ೖྗ૚ தؒ૚ʢӅΕ૚ʣ ग़ྗ૚ தؒ૚ͷ਺͕ଟ͍
   ˠ
   ਂ૚ֶशͱݺͿ
6. Ͱ͸தؒ૚ͰͲͷΑ͏ͳܭࢉΛߦ͏ͷ͔ʁ
7. Y Y    C X X B   χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽʢΑΓৄࡉʹʣ Zͱͯ͠ग़ྗ Z I
   
   B
   ׆ੑԽؔ਺
8. ଛࣦؔ਺ʢϩεؔ਺ʣΛ༻͍Δ ਂ૚ֶशͰ͸ɺ
9. ޯ഑๏ͱ͸ɺ
   ͜ͷଛࣦؔ਺Λখ͍ͯ͘͘͞͠ख๏Λࢦ͢
10. ॏΈʢXʣ ଛࣦؔ਺ʢ&ʣ ϶X ޯ഑͸ෛ ߋ৽લ ߋ৽ޙ ͲͷΑ͏ʹॏΈ͕ߋ৽͞ΕΔͷ͔ʁ wnew = wold − η × ∂E ∂w ʢྫʣޯ഑͕ෛ
    
    ˠ
    "͸ਖ਼
    
    ˠ
    ߋ৽લͷXʹ"͕଍͞ΕΔ
    ˠ
    X͸ӈʹҠಈʢߋ৽ʣ "ͱ͢Δ
11. wnew = wold − η × ∂E ∂w ˣˣˣॏΈͷܭࢉ͸ɺԼͷࣜͰٻΊ͍͚ͯ͹͍͍ X X X ॏΈͷมԽΛΈΑ͏ʂ
    ˠ
    XΛಈ͔ͯ͠ΈΔ
    ˠ
    XΛΛม͑Δͱͦͷ͋ͱશͯʹӨڹ
    ˠ
    ܭࢉ͕େมʂʂ ॱ఻೻
12. ޡࠩٯ఻೻๏ɿ
    ॏΈύϥϝʔλʹΑΔޯ഑ͷܭࢉΛޮ཰ྑ͘ߦͳ͏ํ๏ɻ ˞
    ॏΈͷߋ৽
    ˠ
    ޯ഑ ▶︎
    ͳʹ͕ٯͳͷ͔ʁ ग़ྗ૚Λελʔτͱͯ͠ɺॏΈͷ ߋ৽Λߟ͑Δ ٯ఻೻
13. ޡࠩٯ఻೻๏Ͱޯ഑ΛٻΊΔͷ͸ܭࢉ͕೉͍͠ͷͰলུ͢Δ͕ɺ ޡࠩٯ఻೻๏Λ࢖͏ͱ
    ʮग़ྗ૚Ͱͷਖ਼ղϥϕϧͱͷޡࠩʯ͕Θ͔Ε͹ શͯͷޯ഑͕Θ͔Δɻ
14. ॱ఻೻ʹΑΓ༧ଌ஋Λग़ྗ ਂ૚ֶशͷֶशํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ ਺஋Խ ͦͷζϨΛ࢖ͬͯҰؾʹޯ഑ Λܭࢉ ֶश཰Λ͔͚ͯॏΈΛम੔ wnew = wold − η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
15. ॱ఻೻ʹΑΓ༧ଌ஋Λग़ྗ ਂ૚ֶशͷਪ࿦ํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ ਺஋Խ ͦͷζϨΛ࢖ͬͯҰؾʹޯ഑ Λܭࢉ ֶश཰Λ͔͚ͯॏΈΛम੔ wnew = wold − η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
16. ਫ਼౓Λ্͛ΔֶशςΫχοΫ
17. աֶशɿֶशʹ࢖ΘΕͨσʔλʹա౓ʹ౰ͯ͸·ͬͯ͠·͏͜ͱɻ
18. IUUQTRJJUBDPNDFWBQPSBUPSJUFNTGCFFFGD
19. ਖ਼ଇԽͱ͸Կ͔ʁ
20. ਖ਼ଇԽ
    ˠ
    աֶशΛ๷͙ํ๏ ਂ૚ֶशͰ༻͍ΒΕΔਖ਼ଇԽͱͯ͠ɺ8FJHIU
    %FDBZͱ%SPQPVUͳͲ͕͋Δɻ ˠ
    
    %SPQPVUʹ͍ͭͯઆ໌͢Δ
21. %SPQPVUʹ͍ͭͯ IUUQTEBUBBOBMZUJDTGVOVOEFSTUBOEJOHESPQPVU χϡʔϩϯΛϥϯμϜʹফڈֶͯ͠श͢Δํ๏
22. ʲಛ௃ʳ
    ಛఆͷχϡʔϩϯ΁ͷґଘ౓Λݮ Β͢͜ͱͰΦʔόʔϑΟοςΟϯ άΛݮΒ͢ɻ
23. ʲಛ௃̎ʳ
    ෳ਺ͷϞσϧΛߏங֤͠Ϟσϧͷ༧ଌΛฏۉ͢Δͱɺଟ͘ͷ ৔߹Ͱ༧ଌਫ਼౓্͕͕ΔʢDG
    Ξϯαϯϒϧֶशʣ
24. ˠ
    όονਖ਼نԽ
    ɿ
    ޯ഑ফࣦɾޯ഑രൃΛ๷͙ํ๏ %SPQPVUҎ֎ʹ΋ਂ૚ֶशͰ͸ޯ഑രൃɺޯ഑ফࣦɺաֶश Λղܾ͢ΔͨΊʹ͍͔ͭ͘ͷํ๏͕औΒΕ͍ͯΔɻ ˠ
    ॏΈͷॳظ஋ʢখ͘͢͞Δʣɿ
    աֶशΛ཈͑Δ ˠ
    -
    -
    ਖ਼ଇԽɿ
    աֶशΛ཈͑Δ
25. ิ଍ ʢཧ༝ʣॏΈ͕େ͖ա͗Δͱೖྗ৴߸͕աେʹͳͬͯ͠·͏ ೖྗ஋ͷ߹ܭ ग़ྗ஋ ೖྗ஋͕େ͖ա͗Δͱ
    ग़ྗ஋ͷදݱྗ͕গͳ͘ͳΔ
26. Y Y    C X X B   χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽʢΑΓৄࡉʹʣ Zͱͯ͠ग़ྗ Z I
    
    B
    ׆ੑԽؔ਺
27. ·ͱΊ ޯ഑രൃɺޯ഑ফࣦɺաֶशͱ͍ͬͨ՝୊Λղܾ͢ΔͨΊʹ ͨ͘͞Μͷํ๏͕औΒΕ͍ͯΔɻ ਖ਼ଇԽ͸աֶशΛ཈͑ΔͨΊʹ༻͍Δख๏ %SPQPVU͸ਖ਼ଇԽͷҰͭͰχϡʔϩϯΛϥϯμϜʹফڈͯ͠ ֶश͢Δํ๏
28. ৞ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣͱ͸ʁ
29. ͜Ε·Ͱֶशͨ͠ਂ૚ֶशͰ͸
    ʮը૾ʯΛͲͷΑ͏ʹදݱ͍ͯͨ͠ͷ͔ʁ IUUQT[FSPPOFKQMFBSOJOHCMPHDOOGPSCFHJOOFST ύϥϝʔλͷ਺ΛݮΒ͢͜ͱͰܭࢉྔΛԼ͛Δɻ
30. ̎࣍ݩ͔Β̍࣍ݩʹ͢Δ࣌ʹը૾ͷॏཁͳҐஔ৘ใ͕ࣦΘΕͯ͠·͏ɻ
31. ̏࣍ݩͷ৘ใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏங͍ͨ͠ʂʂ ը૾σʔλ͸3(#ͷ૚ΛؚΊͯ̏࣍ݩ ͷσʔλʹͳ͍ͬͯΔɻ
32. ̏࣍ݩͷ৘ใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏங͍ͨ͠ʂʂ ৞ΈࠐΈχϡʔϥϧωοτϫʔΫʢ$//ʣ ը૾σʔλ͸3(#ͷ૚ΛؚΊͯ̏࣍ݩ ͷσʔλʹͳ͍ͬͯΔɻ
33. $//ͷߏ੒
34. $//ͷߏ੒ ৞ΈࠐΈ૚ ׆ੑԽؔ਺ ϓʔϦϯά૚
35. ৞ΈࠐΈ૚
36. ͜Ε·Ͱ͸ೖྗ஋ͷॏཁੑΛ
    ॏΈʢόΠΞεʣʹΑͬͯ؅ཧ͍ͯͨ͠ɻ ˞ॏΈˠೖྗ஋ͷॏཁੑ
37. $//Ͱ͸ɺॏΈͰ͸ͳ͘ϑΟϧλΛ༻͍Δ IUUQT[FSPPOFKQBJXPSEDPOWPMVUJPO ˞৞ΈࠐΈ૚Ͱͷग़ྗσʔλΛಛ௃Ϛοϓͱ͍͏
38. IUUQTRJJUBDPNOWUPNPJUFNTBGGE ff BCF ৞ΈࠐΈԋࢉͷํ๏ ۙ͘ͷ৘ใΛҡ࣋ͨ͠··
    ಛ௃ྔΛநग़Ͱ͖ͨʂʂ
39. ৞ΈࠐΈ૚ͷϙΠϯτ ৞ΈࠐΈ૚Ͱ͸ɹಛ௃ྔͷநग़͕͍ͪ͹Μͷ໨త ը૾ʹ͓͚ΔҐஔ৘ใΛอ࣋ͨ͠··ಛ௃Λநग़Ͱ͖Δ
40. ϓʔϦϯά૚
41. நग़͞Εͨಛ௃ʹରͯ͠
    ʮϩόετੑʢ҆ఆੑʣʯΛ༩͑Δ IUUQTBJTNJMFZDPKQBJ@OFXTDOO ˞ҰͭҰͭͷ਺஋͸৞ΈࠐΈԋࢉΛߦͳͬͨޙɺ׆ੑԽؔ਺Λ௨ͯ͠ग़ ྗ͞Εͨಛ௃ͷڧ͞Λද͢ɻ
42. ಛ௃͕ը૾಺ͷͲ͜ʹ͋Δ͔ʹࠨӈ͞ΕͣʹॲཧͰ͖ΔΑ͏ʹ͢Δ ը૾̍ ը૾̎         ˠ
    
    ͜ͷ৔߹ɺʮ໨͕͋Δ͔Ͳ͏͔ʯ͕େࣄʂʂ
43. ಛ௃ྔͷ࠷େ஋΍ฏۉ஋ΛऔΔ͜ͱͰ
    ಛ௃ྔͷҠಈʢͣΕʣʹڧ͘ͳΔʂʂ ϓʔϦϯά૚ͷϙΠϯτ
44. $//ͷ·ͱΊ ̏࣍ݩͷ৘ใΛࣦΘͣʹχϡʔϥϧωοτϫʔΫΛߏஙͰ͖Δ
45. ࣮ࡍͰ͸$//͸ͲͷΑ͏ͳߏ੒Ͱ༻͍ΒΕΔ͔ʁ
46. IUUQTYUFDIOJLLFJDPNBUDMMFBSOJOHMFDUVSF ʮ৞ΈࠐΈ૚
    
    ϓʔϦϯά૚ʯΛԿ૚΋ॏͶɺ
    ࠷ޙʹશ݁߹૚Ͱଛࣦؔ਺Λग़ྗ
47. $//͸ը૾ೝࣝ΍Ի੠ೝࣝͰݱࡏͰ΋ඇৗʹ׆ൃʹར༻͞Ε͍ͯΔɻ IUUQTOFXUFDIOPMPHZMJGFTUZMFOFUZPMPEBSLOF IUUQTDWNMFYQFSUHVJEFOFUDBUFHPSZUFSNTEMIVNBOQPTFFTUJBNUJPO IUUQTXXXTLJMMVQBJDPNCMPHUFDITFHNFOUBUJPO ηάϝϯςʔγϣϯ ࢟੎ਪఆ ෺ମݕग़ ը૾தͷ͢΂ͯͷϐΫηϧʹҙຯʢΫϥεʣΛׂΓ౰ͯΔ
    ྫ
    
    
    
    ˠ
    ं
    
    
    ˠ
    ೣ
48. ࣍ճͷ༧ఆ
49. ࣗવݴޠॲཧ