Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ソーイAI勉強会 第2回:深層学習の計算
Search
sewii
May 30, 2025
0
59
ソーイAI勉強会 第2回:深層学習の計算
sewii
May 30, 2025
Tweet
Share
More Decks by sewii
See All by sewii
第5回ソーイAI勉強会:自然言語処理 Part2
sewiiinc
0
110
第4回ソーイAI勉強会:自然言語処理
sewiiinc
0
56
第3回ソーイAI勉強会:深層学習基礎 最終回
sewiiinc
0
88
第1回ソーイAI勉強会:機械学習と深層学習
sewiiinc
0
74
Featured
See All Featured
Imperfection Machines: The Place of Print at Facebook
scottboms
269
13k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3.1k
jQuery: Nuts, Bolts and Bling
dougneiner
65
7.9k
Making the Leap to Tech Lead
cromwellryan
135
9.6k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
1.2k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
140
34k
How GitHub (no longer) Works
holman
315
140k
Music & Morning Musume
bryan
46
6.9k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
130k
Code Reviewing Like a Champion
maltzj
526
40k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Build The Right Thing And Hit Your Dates
maggiecrowley
38
2.9k
Transcript
ୈճɿਂֶशͷܭࢉ
ਂֶशͷ෮श
ਂֶशͰͲ͏ݴͬͨ͜ͱΛ͍ͯ͘͠ͷ͔ʁ ਓؒͷΛߟ͑Δ ਆܦࡉ๔ʢχϡʔϩϯʣͷܨ͕Γ ΛཧϞσϧԽ
ೖྗ தؒʢӅΕʣ ग़ྗ
ೖྗ தؒʢӅΕʣ ग़ྗ தؒͷ͕ଟ͍ˠਂֶशͱݺͿ
ͰதؒͰͲͷΑ͏ͳܭࢉΛߦ͏ͷ͔ʁ ࠓͷϝΠϯʂ
׆ੑԽؔͱԿ͔ʁ
தؒͰͷܭࢉͷྲྀΕ ॏΈͷֻ͚ࢉ χϡʔϩϯͷ͠ࢉ ׆ੑԽؔͷม
தؒͰͷܭࢉͷྲྀΕ ॏΈͷֻ͚ࢉ χϡʔϩϯͷ͠ࢉ ׆ੑԽؔͷม ೖྗͷॏཁੑΛԽͨ͠ͷɻ ॏΈΛௐ͢Δ͜ͱͰɺਖ਼֬ͳ༧ଌΛՄೳʹ͢Δɻ
YX YXB ˞ॏΈҎԼͷΑ͏ʹ͏ X XɿॏΈ Y
Yɿೖྗ ྫʣ͠Yͷೖྗ͕ॏཁͰͳͯ͘ɺYͷೖྗ͕ॏཁͩͬͨ߹ Y YB ͷΑ͏ʹ͏ɻ ˠೖྗ৴߸ͷBʹ͍ͨͯ͠ɺΑΓYͷ͕ө͞Ε͍ͯΔɻ
தؒͰͷܭࢉͷྲྀΕ ॏΈͷֻ͚ࢉ χϡʔϩϯͷ͠ࢉ ׆ੑԽؔͷม ೖྗ৴߸͔Βͷใ͕શͯඞཁͳΘ͚Ͱͳ͍ɻ ׆ੑԽؔΛ௨͢͜ͱͰʮͲͷΑ͏ͳใΛ͑Δͷ͔ʯΛܾΊΔɻ ೖྗͷॏཁੑΛԽͨ͠ͷ
Y Y C X X Z
ɿॏΈ X X CɿόΠΞε Yɿೖྗ৴߸ Zɿग़ྗ৴߸ χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽ χϡʔϩϯͷ͠ࢉΛ ʮZʹมʯͯ͠ग़ྗ
Y Y C X X Z
ɿॏΈ X X CɿόΠΞε χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽ ग़ྗ ॏΈ͚ͩͰදݱͰ͖ͳ͍෦ ΛόΠΞεͰิڧɻ
BɿZʹૹΒΕͯ͘Δೖྗ৴߸ͷ૯ C YX YXB ॏΈͷֻ͚ࢉ χϡʔϩϯͷ͠ࢉ
ZI B
BɿZʹૹΒΕͯ͘Δೖྗ৴߸ͷ૯ C YX YXB ZI B
׆ੑԽؔͷม ೖྗ৴߸ ೖʂʂ ग़ྗ৴߸ ͜ͷIΛ׆ੑԽؔͱ͍͏ ೖྗΛग़ྗʹมʂʂ
Y Y C X X B
χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽʢΑΓৄࡉʹʣ Zͱͯ͠ग़ྗ Z I B
׆ੑԽؔͷछྨ γάϞΠυؔ ߃ؔ εςοϓؔ 3FMVؔ ਂֶशͰ ΘΕͳ͍ ݱࡏͰΘ Ε͍ͯΔ ݱࡏओྲྀ
ೖྗΛͦͷ· ·ฦ͢ʢճؼ Ͱ༻ʣ
ޯ๏ͱԿ͔ʁ
ػցֶशͷྲྀΕʢ͓͞Β͍ʣ ֶशʢ܇࿅ʣɿ σʔλΛ͏·͘આ໌Ͱ͖ͦ͏ͳϞσϧΛબͼɺͦͷϞσϧ Λσʔλʹ߹͏Α͏ʹௐ͢Δ͜ͱɻ ਪɿ ֶशͨ͠ϞσϧΛ͔ͭͬͯɺະͷσʔλΛ༧͢Δ͜ͱɻ ˞ʮֶशʹ͓͚Δਖ਼ʯͱʮਪʹ͓͚Δਖ਼ʯ͕͍ۙͱ͖ɺ ֶश͕͏·͍͍ͬͯ͘Δɻ
ਂֶशͰɺ ͲͷΑ͏ʹਖ਼Λ্͍͛ͯ͘ͷ͔ʁ
ଛࣦؔʢϩεؔʣΛ༻͍Δ ਂֶशͰɺ
ଛࣦʢϩεʣؔɿ ʮͲΕ͘Β͍ਖ਼ղσʔλͱҟͳΔ͔ʯΛදؔ͢ ଛࣦؔͱ ͭ·Γਖ਼Λ্͛Δʹɺଛࣦؔখ͍͞ํ͕͍͍ʂʂ
ޯ๏ͱɺ ͜ͷଛࣦؔΛখ͍ͯ͘͘͞͠ख๏Λࢦ͢
ͦͦޯͱʁ ଛࣦؔʹର͢ΔॏΈͷඍ ∂E ∂w = [ ∂E ∂w1 ⋯ ∂E
∂wn ] Ͱද͞ΕΔ XʢॏΈʣΛม͑ͨ࣌ʹɺ&ʢଛࣦؔʣ͕ͲΕ͘Β͍มΘΔ͔
ʮޯ๏ʯͷΠϝʔδ ॏΈ ଛࣦؔ ଛࣦ͕ؔݮগ͢Δํʹ ύϥϝʔλʢॏΈʣΛߋ৽ ˠଛࣦؔΛͰ͖Δ͚ͩখ͘͢͞Δɻ
ʮޯ๏ʯͷࣜ wnew = wold − η × ∂E ∂w ʢߋ৽ޙͷॏΈʣʢߋ৽લͷॏΈʣʢֶशʣºʢޯʣ
˞ֶशʢБʣɿճͷֶशͰͲΕ͘Β͍ύϥϝʔλΛߋ৽͢Δ͔ ޯํʹҠಈ͢Δྔ
ʮޯ๏ʯͷࣜͳʹΛද͍ͯ͠Δͷ͔ʁ ॏΈʢXʣ ଛࣦؔʢ&ʣ ϶X ޯෛ ߋ৽લ ߋ৽ޙ ͲͷΑ͏ʹॏΈ͕ߋ৽͞ΕΔͷ͔ʁ wnew =
wold − η × ∂E ∂w ʢྫʣޯ͕ෛ ˠ"ਖ਼ ˠߋ৽લͷXʹ"͕͞ΕΔ ˠXӈʹҠಈʢߋ৽ʣ "ͱ͢Δ
ɾޯ๏ͱଛࣦؔΛখ͘͢͞ΔͨΊʹɺॏΈΛߋ৽͍ͯ͘͜͠ͱɻ ޯ๏·ͱΊ ɾޯͱ ʮXʢॏΈʣΛม͑ͨ࣌ʹɺ&ʢଛࣦؔʣ͕ͲΕ͘Β͍มΘΔ͔ʯ Λද͢ɻ ɾ ʹΑͬͯॏΈͷߋ৽Λߦ͏ wnew = wold
− η × ∂E ∂w
ޡࠩٯ๏ͱԿ͔ʁ
wnew = wold − η × ∂E ∂w ˣˣˣॏΈͷܭࢉɺԼͷࣜͰٻΊ͍͚͍͍ͯ X
X X ॏΈͷมԽΛΈΑ͏ʂ ˠXΛಈ͔ͯ͠ΈΔ ˠXΛΛม͑Δͱͦͷ͋ͱશͯʹӨڹ ˠܭࢉ͕େมʂʂ ॱ
ޡࠩٯ๏ɿ ॏΈύϥϝʔλʹΑΔޯͷܭࢉΛޮྑ͘ߦͳ͏ํ๏ɻ
ޡࠩٯ๏ɿ ॏΈύϥϝʔλʹΑΔޯͷܭࢉΛޮྑ͘ߦͳ͏ํ๏ɻ ▶︎ ͳʹ͕ٯͳͷ͔ʁ
ޡࠩٯ๏ɿ ॏΈύϥϝʔλʹΑΔޯͷܭࢉΛޮྑ͘ߦͳ͏ํ๏ɻ ˞ॏΈͷߋ৽ˠޯ ▶︎ ͳʹ͕ٯͳͷ͔ʁ ग़ྗΛελʔτͱͯ͠ɺॏΈͷ ߋ৽Λߟ͑Δ ٯ
ޡࠩٯ๏ͰޯΛٻΊΔͷܭࢉ͕͍͠ͷͰলུ͢Δ͕ɺ ޡࠩٯ๏Λ͏ͱ ʮग़ྗͰͷਖ਼ղϥϕϧͱͷޡࠩʯ͕Θ͔Ε શͯͷޯ͕Θ͔Δɻ
ɾॱ༧ଌΛग़ྗ͢ΔͨΊʹ༻͍Δɻ ޡࠩٯ๏·ͱΊ ɾॱͰޯ๏Λܭࢉ͢ΔͱɺͰ͖ͳ͍͜ͱͳ͍͕ɺܭࢉ ίετ͕ߴ͗͢Δɻ ɾޡࠩٯํΛ༻͍Δ͜ͱͰɺ ʮग़ྗͰͷਖ਼ղϥϕϧͱͷޡࠩʯ͕Θ͔Εશͯͷޯ͕Θ͔Δɻ
ਂֶशͷֶशͱਪ·ͱΊ
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷֶशํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ͦͷζϨΛͬͯҰؾʹޯ Λܭࢉ ֶशΛ͔͚ͯॏΈΛम wnew = wold
− η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
ਪͲͷΑ͏ʹߦͳ͏ͷ͔ʁ ώϯτɿਪͰະͷσʔλΛ༧ଌ͠ɺϞσϧͷධՁΛߦ͏
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷਪํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ͦͷζϨΛͬͯҰؾʹޯ Λܭࢉ ֶशΛ͔͚ͯॏΈΛम wnew = wold
− η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷਪํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ▶︎ ˒ਪͰॱ͔͠ߦΘͳ͍ʂʂ
࣍ճͷ༧ఆ
ਖ਼ଇԽ ΈࠐΈχϡʔϥϧωοτϫʔΫ ࣗવݴޠॲཧಋೖ