Share
Embed
Transcript
54 slides
-
10 • Ͳ͏ͬͯ࠷খΛͱΔYΛ୳ࡧ͢Δ͔ʁ • ࠷جຊతͳख๏ɼ͖Λͬͯ୳ࡧ͢Δख๏ • ͱ͋Δʹ͓͚Δޯͷٯํ ʹਐΉͱ࠷খʹ͔͏ •
ӈਤͰ͍͏ͱɼͷઓͷ͖ϚΠφεʢԾʹͱ͢Δʣ • XΛ ͷํͣΒ͢ʢX X ʣ • ͢Δͱ࠷খΛͱΔXʹۙͮ͘ • ඍΛ͖ͯ͠ʢޯʣΛऔಘ͢Δ͜ͱ͕࠷దԽʹඞਢ ࠷దԽʹඞཁͳޯ લఏࣝ -
11 • ̎࣍ؔͷΑ͏ͳ؆୯ͳؔͳΒී௨ʹඍͯ͠ྑ͍͕ɼ࣮ࡍͷͰѻ͏ํఔࣜͬͱෳࡶ • Ұൠతʹɼ͜Ε·Ͱ̏ͭͷख๏͕ଟ͔ͬͨ • खܭࢉ • ඍ •
γϯϘϦοΫඍ • ۙɼػցֶशʢಛʹ/FVSBM/FUXPSLʣʹ͓͚Δ όοΫϓϩύήʔγϣϯͷ࣮ʹද͞ΕΔࣗಈඍ͕ ྲྀߦ Ͳ͏ͬͯඍʢޯʣΛܭࢉ͢Δ͔ʁ લఏࣝ "Automatic Differentiation in Machine Learning: a Survey" (2018) https://jmlr.org/papers/v18/17-468.html -
12 • ΊͬͪΌΊͪΌࡶʹݴ͏ͱʮඍΛϓϩάϥϜͰ؆୯ʹͬͯ͘ΕΔͭʯ • ܭࢉաఔΛϓϩάϥϜʹ͢Δͱ͍͏͜ͱɼԼਤͷΑ͏ʹجຊతͳܭࢉͷΈ߹ΘͤͰ࣮͢Δ͜ͱ • ̍ͭ̍ͭͷܭࢉ୯७ͳͷͰɼ̍ͭ̍ͭͷඍܭࢉ͍͢͠ • ͜ͷ̍ͭ̍ͭͷඍΛͬͯɼతؔͷඍʢޯʣΛܭࢉ͢Δ •
େࣄͳ͜ͱɼ࣮Ͱ͖Εඍ͕ՄೳʹͳΔʹޯ͕ٻΊΒΕΔͱ͍͏͜ͱ • ʔʼ࠷దԽʹ͑Δʂʂʂ ࣗಈඍͬͯͳΜͰ͔͢ʁ લఏࣝ -
18 • ͳΜΒ͔ͷύλʔϯПΛ4-.ʹදࣔ͢Δͱɼ݁Ռ ͕ಘΒΕΔ • ͜ΕΛඪͱͷ͕ࠩ࠷খ͘͞ͳΔΑ͏ʹʢ ʣ͢Δͷ͕ຊจͰͷ࠷దԽ • ࠷దԽͷߋ৽ʹ͋ͨͬͯɼࣗಈඍʹΑͬͯٻΊΒΕΔޯΛ׆༻ ̂
f(ϕ) ̂ f(ϕ) − Atarget = 0 ຊจʹ͓͚ΔͷఆࣜԽ ຊจʹ͓͚Δ࠷దԽ ೖྗɿП ඍՄೳ γϛϡϨʔγϣϯ ̂ f ग़ྗɿ ̂ f(ϕ) -
22 • ࣗಈඍʹରԠͨ͠ి࣓ܭࢉʢ'%'%๏ʣΛ࣮͠ɼܗঢ়࠷దԽʹద༻ͨ͠ • ԼਤޫͷʹԠͯ͡ܦ࿏ΛΓସ͑Δܗঢ়࠷దԽ • ࠷దԽରʢೖྗมʣɿփ৭ྖҬͷܗঢ় • ඍՄೳγϛϡϨʔγϣϯɿ'%'% •
࠷దԽɿܗঢ়Λೖྗͱͯ͠'%'%γϛϡϨʔγϣϯΛ࣮ߦɽ࣮ߦ݁Ռ͔ΒࣗಈඍͰޯΛಋग़͠ɼܗঢ়Λߋ৽ɽ ࣗಈඍʢඍՄೳγϛϡϨʔγϣϯʣͷࡢࠓ ۩ମྫ̍ɿ'PSXBSE.PEF%JGGFSFOUJBUJPOPG.BYXFMM`T&RVBUJPOT ॳظܗঢ় ࠷దԽܗঢ় ೖྗɿ ܗঢ় ඍՄೳ γϛϡϨʔγϣϯɿ '%5%๏ ग़ྗɿ ޫͷൖܦ࿏ ʢൃද࣌লུʣ -
23 • ෳͷϏϡʔϙΠϯτը૾͔Βɼ͋ΒΏΔํͷϏϡʔϙΠϯτը૾ΛੜͰ͖ΔΑ͏ʹ͢Δݚڀ • //ೖྗɿY Z [ В П •
//ग़ྗɿ3(#М • ඍՄೳγϛϡϨʔγϣϯɿ7PMVNF3FOEFSJOH • ࠷దԽɿ3FOEFSJOH݁ՌʹΑΔ-PTT͔ΒඍͰ୧͍ͬͯͬͯ//Λߋ৽ ࣗಈඍʢඍՄೳγϛϡϨʔγϣϯʣͷࡢࠓ ۩ମྫ̎ɿ/F3'3FQSFTFOUJOH4DFOFTBT/FVSBM3BEJBODF'JFMETGPS7JFX4ZOUIFTJT ೖྗɿ ࠲ඪɾํ ඍՄೳԋࢉɿ /FVSBM/FUXPSL 7PMVNF3FOEFSJOH ग़ྗɿ ϏϡʔϙΠϯτը૾ ʢൃද࣌লུʣ -
26 • ίϯτϦϏϡʔγϣϯ̍ͰɼγϛϡϨʔγϣϯ্ͷؔ ʹରͯ͠࠷దԽΛ ߦ͍ͬͯͨʢӈ্ࣜʣ • ͜Εͱಉ͡Α͏ʹ࣮ࡍͷޫֶܥʹରͯ͠࠷దԽΛߦ͍͍͕ͨɼ ࣮ࡍͷޫֶܥͷൖॲཧΛඍ͢Δ͜ͱͰ͖ͳ͍ ̂ f
Ͳ͏࣮ͬͯޫֶܥʹ࠷దԽॲཧΛΈࠐΉ͔ʁ ίϯτϦϏϡʔγϣϯ̎ ͜ΕඍͰ͖ͳ͍ γϛϡϨʔγϣϯ্ͷൖؔɿ ࣮ࡍͷޫֶܥͰͷൖؔɿ ̂ f f -
27 • ͔͠͠ɼγϛϡϨʔγϣϯϞσϧͱ࣮ޫֶܥ΄΅Ұக͍ͯ͠Δͱݟͳ͢͜ͱͰ͖Δ ˠඍύʔτ͚ͩγϛϡϨʔγϣϯϕʔεʹஔ͖͑ͯ͠·͓͏ʂ Ͳ͏࣮ͬͯޫֶܥʹ࠷దԽॲཧΛΈࠐΉ͔ʁ ίϯτϦϏϡʔγϣϯ̎ ࣮ޫֶܥͷ ൖɿG ग़ྗɿG П
ඍՄೳγϛϡϨʔγϣϯ Ͱ ஔ͖͑ͯඍ ̂ f ೖྗɿП ೖྗПΛ࠷దԽ ஔ͖͑ ஔ͖͑ -
• ΧϝϥͰ࣮ࡍʹࡱӨͨ͠ϗϩάϥϜͷ݁ՌΛͬͯ࠷దԽ͠Α͏ • ΧϝϥͰࡱӨͨ͠ը૾ΛMPTTؔʹΈࠐΉ ͭ·ΓɼΧϝϥը૾ͱඪը૾ͷࠩΛMPTTͱఆٛ͢Δ • ޯγϛϡϨʔγϣϯϞσϧΛ׆༻ͯ͠ɼҐ૬Λߋ৽͠Α͏ ίϯτϦϏϡʔγϣϯ̎ Ͳ͏࣮ͬͯޫֶܥʹ࠷దԽॲཧΛΈࠐΉ͔ʁ Captured
Image: f(ϕk−1) SLM Phase: ϕk−1 Propagation Function: f ࣮ޫֶܥͷࡱӨ݁ՌΛΈࠐΜͩߋ৽ࣜ Χϝϥͱඪը૾ͷࠩ ஔ͖͑ඍܭࢉ 28 -
30 • දࣔը૾̍ຕ̍ຕʹରͯ͠࠷దԽΛ͢Δඞཁ͕ൃੜ͍ͯ͠Δʢ͔͔࣌ؒΓ͗͢ʣ • ޫֶܥͷಛੑΛֶशͯ͠ɼͲΜͳදࣔը૾ʹରͯ͠ରԠͰ͖ΔϞσϧΛֶशͰ͖ͳ͍͔ʁ • ˠ$BNFSBJOUIFMPPQ.PEFM5SBJOJOH • ࢥ͍ͭ͘؆ܿͳख๏ $POWPMVUJPOBM
/FVSBM/FUXPSLΛ׆༻ͨ͠ख๏ • ͨͩ/FVSBM/FUXPSLʹ͢ΔͱͲ͏͍ͬͨཁૉ͕ىҼ͍ͯ͠Δ͔ͷੳ͕ࠔ • ˠຊจͰɼ1IZTJDBMMZ#BTFE.PEFMΛߏங ୯७ͳ$BNFSBJOUIFMPPQͷ ίϯτϦϏϡʔγϣϯ̎ γϛϡϨʔγϣϯ ࠷దԽҐ૬ɿϕ /FVSBM/FUXPSL *OQVU 0VUQVU ϕ ϕ′ ࣮ޫֶܥͰͷ ग़ྗɿf(ϕ′ ) NNΛֶश -
31 • 1IZTJDBMMZ#BTFE.PEFM̐ཁૉ͔ΒΔʢӈԼࣜʹʣ • $POUFOU*OEFQFOEFOU4PVSDFBOE5BSHFU'JFME7BSJBUJPO • .PEFMJOH0QUJDBM1SPQBHBUJPOXJUI"CFSSBUJPOT • .PEFMJOH1IBTF/POMJOFBSJUJFT •
$POUFOUEFQFOEFOU6OEJSFDUFE-JHIU • શύϥϝʔλΛ͋ΘͤͯВͱఆٛ͠ɼͦΕΛֶश ίϯτϦϏϡʔγϣϯ̎ $BNFSBJOUIFMPPQ.PEFM5SBJOJOH มԽ ඍՄೳ γϛϡϨʔγϣϯ ̂ fθ ೖྗɿ ࠷దԽҐ૬ ϞσϧύϥϝʔλВ ϕ ࣮ޫֶܥͰͷ ग़ྗɿfθ (ϕ′ ) ௨ৗͷൖࣜ ϊΠζཁૉ͕ύϥϝλϥΠζ͞ΕͯΈࠐ·Εͨൖࣜ -
33 • ਓؒΛඍ͢Δ͜ͱͰ͖ͳ͍ͷͰɼਓؒΛ͋ΔϞσϧʹஔ͖͑ͯʢ#MBDLCPYγεςϜͱͯ͠औΓѻͬͯʣ ࠷దԽʹΈࠐΉΑ͏ͳ͕͋Δ • ྫɿ)VNBOJOUIFMPPQΛ׆༻ͨ͠ਓؒ("/ %JSFDUMZ*OGFBTJCMFϞσϧͷ࠷దԽ ඍͰ͖ͳ͍ྫɿਓؒ BΛೖྗͱͯ͠
ར༻ ਓ͕ؒஅ %JTDSJNJOBUPS ग़ྗC ඍՄೳͳϞσϧͰ ਓؒΛஔ͖͑ɼ ޯܭࢉʹ׆༻ //͕ੜ (FOFSBUPS ɿB NNΛֶश ʢൃද࣌লུʣ -
36 • ͱ͍ͬͨඍՄೳͳཧԋࢉΛؚΊͯMPTTܭࢉʹ׆༻͢ΔωοτϫʔΫΞʔΩςΫνϟͷΈํ͕ಛతʁ ʢ࠷ۙ૿͍͑ͯΔؾ͢Δʣ ̂ f −1 ̂ fθ
ωοτϫʔΫΞʔΩςΫνϟ ίϯτϦϏϡʔγϣϯ̏ ֶशର ֶशର ඍՄೳԋࢉ ඍՄೳԋࢉ -
39 • ίϯτϦϏϡʔγϣϯ̍ɿࣗಈඍͱඍՄೳγϛϡϨʔλͱ࠷దԽ • ࣗಈඍʹରԠͨ͠ඍՄೳγϛϡϨʔγϣϯʹΑΔ࠷దԽ͕࠷ྑ͍݁ՌΛ࣮ݱ • ඍՄೳγϛϡϨʔγϣϯΛ׆༻ͨ͠࠷దԽࠓޙ৭ʑͳͰొ͢ΔͩΖ͏ • ίϯτϦϏϡʔγϣϯ̎ɿ%JSFDUMZ*OGFBTJCMFϞσϧͷ࠷దԽ •
࣮ޫֶܥͷΑ͏ʹܭࢉػͰѻ͑ͳ͍ͷͰ͋ͬͯɼஔ͖͑ͰඍՄೳʹ͢Δ͜ͱͰ࠷దԽॲཧͷதʹ ΈࠐΉ͜ͱ͕Ͱ͖Δ • ϋʔυΣΞͷΈͳΒͣɼਓؒͷΑ͏ͳੜରͱͳΓ͏Δߟ͑ํͰ͋Ζ͏ • ίϯτϦϏϡʔγϣϯ̏ɿ/FVSBM/FUXPSLʹΑΔߴԽ • ඍՄೳͳԋࢉͰ͋Εɼ//ͷܗΛऔΒͳͯ͘MPTTؔʹΈࠐΜͰɼֶशʹ׆༻Ͱ͖Δ • ͷࢪ͞Εͨ//"SDIJUFDUVSFࠓޙӹʑ૿͑ΔͩΖ͏ ૯ׅ -
41 • ޫֶܥͷಛੑΛֶशͯ͠ɼͲΜͳදࣔը૾ʹରͯ͠ରԠͰ͖ΔϞσϧΛֶशͰ͖ͳ͍͔ʁ • ࢥ͍ͭ͘؆ܿͳख๏ $POWPMVUJPOBM /FVSBM/FUXPSLΛ׆༻ͨ͠ख๏ //Λ༻͍ͨղܾํ๏ /FVSBM)PMPHSBQIZʹ͓͚ΔఏҊ γϛϡϨʔγϣϯ
࠷దԽҐ૬ɿϕ /FVSBM/FUXPSL *OQVU 0VUQVU ϕ ϕ′ ࣮ޫֶܥͰͷ ग़ྗɿf(ϕ′ ) NNΛֶश -
42 • ຊจͷఏҊख๏ͷύΠϓϥΠϯԼਤ • ᶃҐ૬ 4-.໘ ͔Βൖܭࢉɹᶄൖܭࢉ͞Εͨཧతͳը૾Λݱ࣮ͱಉ͡ϊΠζ࠶ݱΛͰ͖Δ//ͰΞτϓοτ ᶅϊΠζ࠶ݱ͞Εͨը૾ͱλʔήοτը૾ͷࠩ MPTT ͔ΒɼೖྗҐ૬Їʹର͢ΔޯܭࢉɹᶆҐ૬ߋ৽
࠷దԽ ΞΠσΞࣗମ͔ͳΓ͍ۙʢҙࣝҰॹʹͲ͏ͬͯޫֶϊΠζΛແ͔͘͢ʣ -FBSOFE)BSEXBSFJOUIFMPPQͰͷ࣮ -
48 • ಠࣗͷબੑΛߟྀͨ͠ϑϦʔϑΥʔϜ)0&ͷ࠷దԽख๏ • )0&༻ͷμΠϠϞϯυટʹΑΔϑϦʔϑΥʔϜද໘ɾͭͷ໘มௐΞʔϜΛඋ͑ͨϗϩάϥϑΟοΫϓϦϯλʔ ͷ༻ͱ͍ͬͨɼ̎छྨͷϑϦʔϑΥʔϜ)0&ख๏ • ྆ํͷΞϓϩʔνʹ߹Θͤͯௐ͞Εͨݎ࿚ͳ໘ղΞϧΰϦζϜ • "3ΠϝʔδίϯόΠφʔɾϔουΞοϓσΟεϓϨΠɾϨϯζΞϨΠͳͲͷ
σΟεϓϨΠ͓ΑͼΠϝʔδϯάΞϓϦέʔγϣϯͷྫ • ϑϧΧϥʔ$BVTUJDTӨ)0&ͷσϞ ຊจͷߩݙ $POUSJCVUJPOT -
52 3FTVMUT "QQMJDBUJPOT ඇٿ໘ϨϯζHOE (a,b,c) HUDϨϯζHOE (d,e,f) Printed HUDϨϯζHOE (g,h)
ϨϯζΞϨΠHOE (i) Caustic HOE (j,k,l)