Share
Embed
Transcript
50 slides
-
w "EWFSTBSJBM"UUBDLɿఢରత߈ܸ ೖྗը૾ʹมԽΛՃ͑ͯ$//ͷޡྨΛ༠ൃ ਓ͕ਖ਼͘͠ྨͰ͖ΔΑ͏ͳαϯϓϧͰ$//Λ߈ܸ͍ͨ͠ w "EWFSTBSJBM%FGFOTFɿఢରతޚ $//Λ"EWFSTBSJBMBUUBDLͷ֎త߈ܸ͔Βޚ
͋ΒΏΔ߈ܸ͔Β$//ΛकΓ͍ͨ "EWFSTBSJBM"UUBDLWT%FGFOTF 2 %FGFOEFS "UUBDLFS $// $POWPMVUJPOBM/FVSBM/FUXPSLT -
"EWFSTBSJBM"UUBDL%FGFOTFͷ 3 %FGFOTF "UUBDL "5(*' <$$IFO BS9JW`> *"5 <"-BNC "*4FD`>
.5-"5 <"-BVHSPT &$$7`> %"5 <:8BOH *$.-`> 'FBUVSFTDBUUFS <);IBOHBOE+8BOH /FVS*14`> $"5 <2;$BJ *+$"*`> 6OJWFSTBM"5 <"4IBGBIJ """*`> "7NJYVQ <4-FF $713`> ("5 <(4SJSBNBOBO /FVS*14`> ("*3"5 <+;IBOH *$-3`> ."*- <28BOH /FVS*14`> 8..3 <);FOH """*`> #J-"8 <$)PMU[ 0QFO3FWJFX`> -#("5 <+$VJ *$$7`> #("5 <+$VJ *$$7`> 1$-$ <9-J """*`> 1$MPTT <".VTUBGB *$$7`> $//X3#'LFSOFM <4"5BHIBOBLJ $713`> "-1 <),BOOBO BS9JW`> ."35 <:8BOH *$-3`> ..-%" <51BOH *$.-`> ..$ <51BOH *$-3`> -#'(4 <$4[FHFEZ *$-3`> '(4. <*(PPEGFMMPX *$-3`> $8 </$BSMJOJBOE%8BHOFS 41`> 1(% <".BESZ *$-3`> #*. *-$. ઁಈͷ࠷దԽ .VMUJQMFUBSHFUFE <4(PXBM BS9JW`> 6OJWFSTBM"&T <4..PPTBWJ%F[GPPMJ $713`> "VUP"UUBDL <'$SPDFBOE.)FJO *$.-`> '"# <'$SPDFBOE.)FJO *$.-`> 4RVBSF"UUBDL <""OESJVTIDIFOLP &$$7`> "VUP1(% "VUP1(%%-3 4"*'(. <9%POH $713`> ("." <(4SJSBNBOBO /FVS*14`> .VMUJεςοϓͷ࣌ <",VSBLJO *$-38`> ܭࢉίετͷݮ ࣄޙ֬ͷਖ਼ଇԽ 4UBOEBSE"5 <*(PPEGFMMPX *$-3`> "5XJUI1(% <".BESZ *$-3`> ˢ /BUVSBMͱ"&Tͷ༻ 1(%BUUBDLͷ"&TΛར༻ ˢ "&TͷΈ μΠφϛοΫͳ εςοϓαΠζͷಋೖ 0VUFSNJOJNJ[BUJPOͷଛࣦܭࢉ .." <(8%JOH *$-3`> 53"%&4 <);IBOH *$.-`> '"5 <+;IBOH *$.-`> )"5 <33BEF *$.-8`> -
w ඍখઁಈΛ༩ͨ͠αϯϓϧ "&T"EWFSTBSJBMFYBNQMFT Λ༻͍ͨ߈ܸ ਓ͕֮ࠔͳมԽ ߴ͍֬Ͱ$//ͷޡྨΛ༠ൃՄೳ w ߈ܸରͷঢ়ଶʹΑͬͯઁಈ࡞ํ๏͕ҟͳΔ
Ϟσϧͷใ͕ط 8IJUFCPY ɿϞσϧͷޯΛར༻ Ϟσϧͷใ͕ະ #MBDLCPY ɿผͷϞσϧ͔ΒసҠɼೖग़ྗͷؔੑ͔Βಋग़ "EWFSTBSJBM"UUBDL 4 ඍখͳઁಈ "&T /BUVSBMαϯϓϧ -
w ઁಈΛεςοϓͰಋग़͢Δख๏ ޯͷූ߸Λར༻ͯ͠ೖྗը૾ʹมԽΛՃ͑Δ 'BTU(SBEJFOU4JHO.FUIPE '(4. <*(PPEGFMMPX BS9JW > 5
*(PPEGFMMPX et al. l&YQMBJOJOHBOE)BSOFTTJOH"EWFSTBSJBM&YBNQMFTz BS9JW ˜ xi = xi + ϵ ⋅ sign (∇x′  i L (f(x′  i ; θ), yi)) ޡࠩΛ࠷େʹ͢Δํʹ Λ ͚ͩҠಈ xi ϵ x′  i = xi + r s . t . r ∼ U[−ϵ, ϵ] Λ CBMMͷϥϯμϜͳҐஔʹҠಈ xi ϵ ϵ OPSN ℓ2 ϵ OPSN ℓ∞ σʔλू߹ ͔ΒαϯϓϦϯάͨ͠σʔλ (xi , yi ) ∼ D D Λத৺ͱͨ͠ CBMMͷܘ ϵ xi ϵ x′  i x ˜ xi x′  i x ˜ xi -
w Λ༻͍ͯҙͷճ෮ͯ͠߈ܸ͢Δ͜ͱͰ'(4.ΑΓڧ͍ઁಈΛ֫ಘ ͷൣғ֎ͷઁಈӨؔ ʹΑͬͯҾ͖͢ α ≤ ϵ [−ϵ, ϵ]
Π ϵ OPSN ℓ∞ 1SPKFDUFE(SBEJFOU%FTDFOU 1(% <".BESZ *$-3 > 6 ".BESZ et al. l5PXBSET%FFQ-FBSOJOH.PEFMT3FTJTUBOUUP"EWFSTBSJBM"UUBDLz *$-3 ˜ x1 i = Π (˜ x0 i + α ⋅ sign (∇˜ x0 i L (f(˜ x0 i ; θ), yi))) ˜ xt+1 i = Π (˜ xt i + α ⋅ sign (∇˜ xt i L (f(˜ xt i ; θ), yi))) ˜ x2 i = Π (˜ x1 i + α ⋅ sign (∇˜ x1 i L (f(˜ x1 i ; θ), yi))) ϵ OPSN ℓ2 ˜ x0 i x ˜ xt+1 i εςοϓαΠζ α CBMMʹҾ͖͢Өؔ Π ϵ ෮ճ T ˜ x0 i = Π (xi + r) s . t . r ∼ U[−ϵ, ϵ] Λ CBMMͷϥϯμϜͳҐஔʹҠಈ xi ϵ ෮తʹઁಈΛಋग़ ˜ x0 i x ˜ xt+1 i -
w "EWFSTBSJBMBUUBDLΛܰݮ͢ΔͨΊͷςΫχοΫ ೖྗը૾Λૢ࡞͢Δޚ "&TΛ༻ֶ͍ͨशʹΑΔޚˠ"EWFSTBSJBMUSBJOJOH "EWFSTBSJBMEFGFOTF 7 "&Tݕग़ͷͨΊͷᮢ T
ઁಈڧ ϵ ʹର͢Δڭࢣ৴߸ y xnat ֶश η ֶशՄೳͳύϥϝʔλ θ ೖྗը૾Λૢ࡞͢Δޚ "&TΛ༻ֶ͍ͨशʹΑΔޚ xi ϊΠζআڈ ˜ xi $// f(˜ xi ; θ) %FOPJTJOH ը૾ੜϞσϧΛ༻͍ͯೖྗը૾͔ΒϊΠζΛআڈ xi ݕग़ثϕ $// ϕ(xi ) ≤ T "EWFSTBSJBMTBNQMF ϕ(xi ) > T f(xi ; θ) %FUFDUJPO લஈʹݕग़ثΛઃஔͯ͠ɼ҆શͳαϯϓϧ͚ͩࣝผϞσϧ͢ $// x′  f(xnat ; θ) y θt+1 ← θt − η ∂L (f(x′  ; θt ), y) ∂θt 1BSBNFUFSVQEBUF "&TΛ༻͍ͨϞσϧͷߋ৽ "EWFSTBSJBMUSBJOJOH "&TΛϕʔεʹύϥϝʔλΛߋ৽ͯ͠ϞσϧຊମΛ߈ܸʹڧ͘͢Δ ύϥϝʔλΛݻఆͯ͠ "&Tͷ࡞ "&TΛ༻͍ͯ ύϥϝʔλͷߋ৽ -
w "&TΛֶश͢Δ͜ͱͰϞσϧࣗମΛؤ݈ʹ͢Δޚख๏ "&Tͷ࡞ *OOFSNBYJNJ[BUJPO ύϥϝʔλߋ৽ 0VUFSNJOJNJ[BUJPO "EWFSTBSJBM5SBJOJOH<".BESZ
*$-3 > 8 min θ 𝔼 (xi ,yi )∼D [ max ∥δ∥p ≤ ϵ L(xi + δ, yi ; θ) ] *OOFSNBYJNJ[BUJPO '(4.1(%BUUBDLΛ༻͍ͯઁಈΛಋग़ جຊతʹɼ߈ܸதͷޡࠩؔΫϩεΤϯτϩϐʔޡࠩ 0VUFSNJOJNJ[BUJPO "&TΛ༻͍ͯޡ͕ࠩ࠷খʹͳΔΑ͏ʹύϥϝʔλ Λߋ৽ ͜͜Ͱ͏ޡࠩؔ"&TʹҰखؒՃ͑Δ͜ͱ͕ଟ͍ θ $// ˜ x f(˜ x; θ) y θt+1 ← θt − η ∂L (f(˜ x; θt ), y) ∂θt (SBEJFOUEFTDFOE ύϥϝʔλߋ৽ 0VUFSNJOJNJ[BUJPO $// QBSBNFUFS fi Y xnat f(˜ x; θ) y δ := α ⋅ sign (∇xnat L (f(xnat ; θ), y)) "&Tͷ࡞ *OOFSNBYJNJ[BUJPO r ∼ U[−ϵ, ϵ] + ˜ x = + (SBEJFOUBTDFOE "&TΛجʹύϥϝʔλߋ৽ "&Tͷ࡞ -
"EWFSTBSJBM5SBJOJOHͷݚڀಈ 9 ࣝผڥքʹண ֶशதͷ"&Tͷ࡞ํ๏ʹண αϯϓϧ͝ͱʹ8FJHIUJOH .JTMFBEͨ͠αϯϓϧͷ׆༻ ࣍ݩಛۭؒ ೖྗը૾ۭؒ %FGFOTF "UUBDL
"5(*' <$$IFO BS9JW`> *"5 <"-BNC "*4FD`> .5-"5 <"-BVHSPT &$$7`> %"5 <:8BOH *$.-`> 'FBUVSFTDBUUFS <);IBOHBOE+8BOH /FVS*14`> $"5 <2;$BJ *+$"*`> 6OJWFSTBM"5 <"4IBGBIJ """*`> "7NJYVQ <4-FF $713`> ("5 <(4SJSBNBOBO /FVS*14`> ("*3"5 <+;IBOH *$-3`> ."*- <28BOH /FVS*14`> 8..3 <);FOH """*`> #J-"8 <$)PMU[ 0QFO3FWJFX`> -#("5 <+$VJ *$$7`> #("5 <+$VJ *$$7`> 1$-$ <9-J """*`> 1$MPTT <".VTUBGB *$$7`> $//X3#'LFSOFM <4"5BHIBOBLJ $713`> "-1 <),BOOBO BS9JW`> ."35 <:8BOH *$-3`> ..-%" <51BOH *$.-`> ..$ <51BOH *$-3`> -#'(4 <$4[FHFEZ *$-3`> '(4. <*(PPEGFMMPX *$-3`> $8 </$BSMJOJBOE%8BHOFS 41`> 1(% <".BESZ *$-3`> #*. *-$. ઁಈͷ࠷దԽ .VMUJQMFUBSHFUFE <4(PXBM BS9JW`> 6OJWFSTBM"&T <4..PPTBWJ%F[GPPMJ $713`> "VUP"UUBDL <'$SPDFBOE.)FJO *$.-`> '"# <'$SPDFBOE.)FJO *$.-`> 4RVBSF"UUBDL <""OESJVTIDIFOLP &$$7`> "VUP1(% "VUP1(%%-3 4"*'(. <9%POH $713`> ("." <(4SJSBNBOBO /FVS*14`> .VMUJεςοϓͷ࣌ <",VSBLJO *$-38`> ଛࣦؔωοτϫʔΫઃܭͷվળ Ϟσϧग़ྗʹର͢Δਖ਼ଇԽ ܭࢉίετͷݮ ࣄޙ֬ͷਖ਼ଇԽ ࣝͷৠཹ 4UBOEBSE"5 <*(PPEGFMMPX *$-3`> "5XJUI1(% <".BESZ *$-3`> ˢ /BUVSBMͱ"&Tͷ༻ 1(%BUUBDLͷ"&TΛར༻ ˢ "&TͷΈ μΠφϛοΫͳ εςοϓαΠζͷಋೖ 0VUFSNJOJNJ[BUJPOͷଛࣦܭࢉ .." <(8%JOH *$-3`> 53"%&4 <);IBOH *$.-`> '"5 <+;IBOH *$.-`> )"5 <33BEF *$.-8`> -
"EWFSTBSJBMUSBJOJOHͷݚڀಈ 10 ࣝผڥքʹண ֶशதͷ"&Tͷ࡞ํ๏ʹண αϯϓϧ͝ͱʹ8FJHIUJOH .JTMFBEͨ͠αϯϓϧͷ׆༻ ࣍ݩಛۭؒ ೖྗը૾ۭؒ %FGFOTF "UUBDL
"5(*' <$$IFO BS9JW`> *"5 <"-BNC "*4FD`> .5-"5 <"-BVHSPT &$$7`> %"5 <:8BOH *$.-`> 'FBUVSFTDBUUFS <);IBOHBOE+8BOH /FVS*14`> $"5 <2;$BJ *+$"*`> 6OJWFSTBM"5 <"4IBGBIJ """*`> "7NJYVQ <4-FF $713`> ("5 <(4SJSBNBOBO /FVS*14`> ("*3"5 <+;IBOH *$-3`> ."*- <28BOH /FVS*14`> 8..3 <);FOH """*`> #J-"8 <$)PMU[ 0QFO3FWJFX`> -#("5 <+$VJ *$$7`> #("5 <+$VJ *$$7`> 1$-$ <9-J """*`> 1$MPTT <".VTUBGB *$$7`> $//X3#'LFSOFM <4"5BHIBOBLJ $713`> "-1 <),BOOBO BS9JW`> ."35 <:8BOH *$-3`> ..-%" <51BOH *$.-`> ..$ <51BOH *$-3`> -#'(4 <$4[FHFEZ *$-3`> '(4. <*(PPEGFMMPX *$-3`> $8 </$BSMJOJBOE%8BHOFS 41`> 1(% <".BESZ *$-3`> #*. *-$. ઁಈͷ࠷దԽ .VMUJQMFUBSHFUFE <4(PXBM BS9JW`> 6OJWFSTBM"&T <4..PPTBWJ%F[GPPMJ $713`> "VUP"UUBDL <'$SPDFBOE.)FJO *$.-`> '"# <'$SPDFBOE.)FJO *$.-`> 4RVBSF"UUBDL <""OESJVTIDIFOLP &$$7`> "VUP1(% "VUP1(%%-3 4"*'(. <9%POH $713`> ("." <(4SJSBNBOBO /FVS*14`> .VMUJεςοϓͷ࣌ <",VSBLJO *$-38`> ଛࣦؔωοτϫʔΫઃܭͷվળ Ϟσϧग़ྗʹର͢Δਖ਼ଇԽ ܭࢉίετͷݮ ࣄޙ֬ͷਖ਼ଇԽ ࣝͷৠཹ 4UBOEBSE"5 <*(PPEGFMMPX *$-3`> "5XJUI1(% <".BESZ *$-3`> ˢ /BUVSBMͱ"&Tͷ༻ 1(%BUUBDLͷ"&TΛར༻ ˢ "&TͷΈ μΠφϛοΫͳ εςοϓαΠζͷಋೖ 0VUFSNJOJNJ[BUJPOͷଛࣦܭࢉ .." <(8%JOH *$-3`> 53"%&4 <);IBOH *$.-`> '"5 <+;IBOH *$.-`> )"5 <33BEF *$.-8`> -
w ैདྷͷ"5ʹ͓͚Δ 1(%ͰٻΊͨઁಈΫϥεڥքΛେ͖͘ލ͙ ޡྨ͢Δ͔൱͔ઁಈͷॳظํʹґଘ w ઁಈͷ࡞ํ๏ʹணͨ͠ख๏ 'SJFOEMZ"EWFSTBSJBM5SBJOJOH
'"5 <+;IBOH *$.- > (VJEFE"EWFSTBSJBM5SBJOJOH ("5 <(4SJSBNBOBO /FVS*14 > "EWFSTBSJBM7FSUFYNJYVQ "7NJYVQ <4-FF $713 > ֶ̍शதͷ"&Tͷ࡞ํ๏ʹணͨ͠ख๏ 11 -
w ΫϥεڥքۙͷઁಈΛٻΊֶͯश FBSMZTUPQQFE1(%Λར༻ͨ͠ઁಈಋग़ '"5<+;IBOH *$.- > 12 '"5'SJFOEMZ"EWFSTBSJBM5SBJOJOH +;IBOH
et al. l"UUBDLT8IJDI%POPU,JMM5SBJOJOH.BLF"EWFSTBSJBM-FBSOJOH4USPOHFSz *$.- # PVOEBSZ $MBTTDFOUFS $MBTTDFOUFS ɿ1(%ͰٻΊͨैདྷͷ"&T ɿ'SJFOEMZ"EWFSTBSJBM&YBNQMFT ℬ[x] = {˜ x ∈ 𝒳 ∣ ∥x − ˜ x∥∞ ≤ ϵ} ˜ xi = arg max ˜ xi ∈ℬ[xi ] L(˜ xi , yi ; θ) ڭࢣ৴߸ͱͷଛࣦ͕࠷େʹͳΔ"&TΛબ 4UBOEBSE"EWFSTBSJBM&YBNQMFT s . t . L(˜ x, yi ; θ) − min y∈ 𝒴 L(˜ xi , y; θ) ≥ ρ ˜ xi = arg min ˜ xi ∈ℬ[xi ] L(˜ xi , yi ; θ) ڭࢣ৴߸ͱͷଛࣦ͕࠷খɼ͔ͭޡྨ͕ੜ͍ͯ͡Δ"&TΛબ 'SJFOEMZ"EWFSTBSJBM&YBNQMFT -
w 3FMBYBUJPO߲ͷՃͰదͳॳظํΛ༻͍ͨ"&Tͷ࡞ ޡࠩۂ໘ΛΒ͔ʹ͢Δ͜ͱͰదͳํΛٻΊΔ ("5<(4SJSBNBOBO /FVS*14 > 13 ("5(VJEFE"EWFSTBSJBM5SBJOJOH (4SJSBNBOBO
et al. l(VJEFE"EWFSTBSJBM"UUBDLGPS&WBMVBUJOHBOE&OIBODJOH"EWFSTBSJBM%FGFOTFTz /FVS*14 ˜ xi = xi + ϵ ⋅ sign (∇xi (L(xi , yi ; θ) + λ ⋅ ∥f(xi + r) − f(xi )∥2 2 )) Ϟσϧશମͷ࠷దԽࣜ r ∼ Bern(−ϵ/2,ϵ/2) "&Tͷಋग़ ɿϋΠύʔύϥϝʔλ λ ޡྨ͕ੜ͡ͳ͍"&Tͷྫ min θ 1 n n ∑ i=1 (L(xi , yi ; θ) + λ ⋅ ∥f(˜ xi ) − f(xi )∥2 2 ) 3FMBYBUJPO߲ 3FMBYBUJPO߲ 3FMBYBUJPO߲ͷՃ -
w NJYVQΛར༻ͯ͠/BUVSBMͷੑೳྼԽΛ͗ͭͭؤ݈ੑೳΛ্ "EWFSTBSJBMWFSUFYʢഒͨ͠"&Tʣͱ/BUVSBMΛҙͷൺͰૠ "7NJYVQ<4-FF $713 > 14 "7NJYVQ"EWFSTBSJBM7FSUFYNJYVQ 4-FF
et al. l"EWFSTBSJBM7FSUFY.JYVQ5PXBSE#FUUFS"EWFSTBSJBMMZ3PCVTU(FOFSBMJ[BUJPOz $713 JOQVUx "EWFSTBSJBMFYBNQMF "EWFSTBSJBMWFSUFY |δ| γ|δ| xav = x + γ ⋅ δx ˜ x = αx + (1 − α)xav ˜ y = αϕ(y, λ1 ) + (1 − α)ϕ(y, λ2 ) ϕ(y, λ) = λy + 1 − λ k − 1 (1 − y) -BCFMTNPPUIJOH ը૾ͷNJYVQ "EWFSTBSJBMWFSUFYͷ࡞ ڭࢣ৴߸ͷNJYVQ α ∼ Beta(1,1) ɿTNPPUIJOHύϥϝʔλ λ1 , λ2 ˠ"&TͷಛΛ܇࿅σʔλͷͭͱͯ͠ٵऩ ˠ܇࿅σʔληοτͷΧόϨοδΛ֦ு -
"EWFSTBSJBMUSBJOJOHͷݚڀಈ 15 ࣝผڥքʹண ֶशதͷ"&Tͷ࡞ํ๏ʹண αϯϓϧ͝ͱʹ8FJHIUJOH .JTMFBEͨ͠αϯϓϧͷ׆༻ ࣍ݩಛۭؒ ೖྗը૾ۭؒ %FGFOTF "UUBDL
"5(*' <$$IFO BS9JW`> *"5 <"-BNC "*4FD`> .5-"5 <"-BVHSPT &$$7`> %"5 <:8BOH *$.-`> 'FBUVSFTDBUUFS <);IBOHBOE+8BOH /FVS*14`> $"5 <2;$BJ *+$"*`> 6OJWFSTBM"5 <"4IBGBIJ """*`> "7NJYVQ <4-FF $713`> ("5 <(4SJSBNBOBO /FVS*14`> ("*3"5 <+;IBOH *$-3`> ."*- <28BOH /FVS*14`> 8..3 <);FOH """*`> #J-"8 <$)PMU[ 0QFO3FWJFX`> -#("5 <+$VJ *$$7`> #("5 <+$VJ *$$7`> 1$-$ <9-J """*`> 1$MPTT <".VTUBGB *$$7`> $//X3#'LFSOFM <4"5BHIBOBLJ $713`> "-1 <),BOOBO BS9JW`> ."35 <:8BOH *$-3`> ..-%" <51BOH *$.-`> ..$ <51BOH *$-3`> -#'(4 <$4[FHFEZ *$-3`> '(4. <*(PPEGFMMPX *$-3`> $8 </$BSMJOJBOE%8BHOFS 41`> 1(% <".BESZ *$-3`> #*. *-$. ઁಈͷ࠷దԽ .VMUJQMFUBSHFUFE <4(PXBM BS9JW`> 6OJWFSTBM"&T <4..PPTBWJ%F[GPPMJ $713`> "VUP"UUBDL <'$SPDFBOE.)FJO *$.-`> '"# <'$SPDFBOE.)FJO *$.-`> 4RVBSF"UUBDL <""OESJVTIDIFOLP &$$7`> "VUP1(% "VUP1(%%-3 4"*'(. <9%POH $713`> ("." <(4SJSBNBOBO /FVS*14`> .VMUJεςοϓͷ࣌ <",VSBLJO *$-38`> ଛࣦؔωοτϫʔΫઃܭͷվળ Ϟσϧग़ྗʹର͢Δਖ਼ଇԽ ܭࢉίετͷݮ ࣄޙ֬ͷਖ਼ଇԽ ࣝͷৠཹ 4UBOEBSE"5 <*(PPEGFMMPX *$-3`> "5XJUI1(% <".BESZ *$-3`> ˢ /BUVSBMͱ"&Tͷ༻ 1(%BUUBDLͷ"&TΛར༻ ˢ "&TͷΈ μΠφϛοΫͳ εςοϓαΠζͷಋೖ 0VUFSNJOJNJ[BUJPOͷଛࣦܭࢉ .." <(8%JOH *$-3`> 53"%&4 <);IBOH *$.-`> '"5 <+;IBOH *$.-`> )"5 <33BEF *$.-8`> -
w ैདྷͷ"5ʹ͓͚Δ "&TΛޡྨ͠ͳ͍Α͏ʹڭࢣ৴߸ͱͷΫϩεΤϯτϩϐʔޡࠩΛ࠷খԽ ˠ"&Tʹաద߹ͯ͠/BUVSBMαϯϓϧΛޡྨ w Ϟσϧग़ྗʹର͢Δਖ਼ଇԽΛՃͨ͠ख๏ "EWFSTBSJBM-PHJU1BJSJOH "-1
<),BOOBO BS9JW > 53"%&4<);IBOH *$.- > Ϟσϧͷग़ྗʹର͢Δਖ਼ଇԽͷՃ 16 -
w "&Tͱ/BUVSBMαϯϓϧͷग़ྗͱҰகͤ͞Δ "&Tͱϕʔεͷ/BUVSBMαϯϓϧಉ͡ಛΛଊ͑Δ ϩδοτʹணͨ͠ख๏ 18 "-1<),BOOBO BS9JW > "EWFSTBSJBM-PHJU1BJSJOH
),BOOBO et al. l"EWFSTBSJBM-PHJU1BJSJOHz BS9JW w /BUVSBMͱ"&TͷϩδοτΛҰக ฏۉೋޡࠩͷ࠷খԽ #PVOEBSZ xi "&T $MBTTDFOUFS L(xi , yi ; θ) = LCE (f(˜ xi ), yi ; θ) + λ k ∥f(xi ) − f(˜ xi )∥2 2 ˢ "&Tʹର͢ΔΫϩεΤϯτϩϐʔޡࠩ ˢ ϩδοτʹର͢Δਖ਼ଇԽ ग़ྗͷϖΞϦϯά -
w "&Tͱ/BUVSBMαϯϓϧͷग़ྗͱҰகͤ͞Δ "&Tͱϕʔεͷ/BUVSBMαϯϓϧಉ͡ಛΛଊ͑Δ ࣄޙʹணͨ͠ख๏ 19 "-1<),BOOBO BS9JW > "EWFSTBSJBM-PHJU1BJSJOH
),BOOBO et al. l"EWFSTBSJBM-PHJU1BJSJOHz BS9JW w /BUVSBMͱ"&TͷϩδοτΛҰக ฏۉೋޡࠩͷ࠷খԽ #PVOEBSZ xi "&T $MBTTDFOUFS L(xi , yi ; θ) = LCE (f(˜ xi ), yi ; θ) + λ k ∥f(xi ) − f(˜ xi )∥2 2 ˢ "&Tʹର͢ΔΫϩεΤϯτϩϐʔޡࠩ ˢ ϩδοτʹର͢Δਖ਼ଇԽ w /BUVSBMͱ"&Tͷࣄޙ֬ΛҰக ,-μΠόʔδΣϯεͷ࠷খԽ 53"%&4<);IBOH *$.- > 53BEFP ff JOTQJSFE"EWFSTBSJBM%&GFOTFWJB4VSSPHBUFNJOJNJ[BUJPO L(xi , yi ; θ) = LCE (f(xi ), yi ; θ) + λ ⋅ DKL [p(xi )∥p(˜ xi )] ˢ OBUVSBMʹର͢ΔΫϩεΤϯτϩϐʔޡࠩ );IBOH et al. l5IFPSFUJDBMMZ1SJODJQMFE5SBEFP ff CFUXFFO3PCVTUOFTTBOE"DDVSBDZz *$.- ˢ ࣄޙ֬ʹର͢Δਖ਼ଇԽ ग़ྗͷϖΞϦϯά -
"EWFSTBSJBMUSBJOJOHͷݚڀಈ 20 ࣝผڥքʹண ֶशதͷ"&Tͷ࡞ํ๏ʹண αϯϓϧ͝ͱʹ8FJHIUJOH .JTMFBEͨ͠αϯϓϧͷ׆༻ ࣍ݩಛۭؒ ೖྗը૾ۭؒ %FGFOTF "UUBDL
"5(*' <$$IFO BS9JW`> *"5 <"-BNC "*4FD`> .5-"5 <"-BVHSPT &$$7`> %"5 <:8BOH *$.-`> 'FBUVSFTDBUUFS <);IBOHBOE+8BOH /FVS*14`> $"5 <2;$BJ *+$"*`> 6OJWFSTBM"5 <"4IBGBIJ """*`> "7NJYVQ <4-FF $713`> ("5 <(4SJSBNBOBO /FVS*14`> ("*3"5 <+;IBOH *$-3`> ."*- <28BOH /FVS*14`> 8..3 <);FOH """*`> #J-"8 <$)PMU[ 0QFO3FWJFX`> -#("5 <+$VJ *$$7`> #("5 <+$VJ *$$7`> 1$-$ <9-J """*`> 1$MPTT <".VTUBGB *$$7`> $//X3#'LFSOFM <4"5BHIBOBLJ $713`> "-1 <),BOOBO BS9JW`> ."35 <:8BOH *$-3`> ..-%" <51BOH *$.-`> ..$ <51BOH *$-3`> -#'(4 <$4[FHFEZ *$-3`> '(4. <*(PPEGFMMPX *$-3`> $8 </$BSMJOJBOE%8BHOFS 41`> 1(% <".BESZ *$-3`> #*. *-$. ઁಈͷ࠷దԽ .VMUJQMFUBSHFUFE <4(PXBM BS9JW`> 6OJWFSTBM"&T <4..PPTBWJ%F[GPPMJ $713`> "VUP"UUBDL <'$SPDFBOE.)FJO *$.-`> '"# <'$SPDFBOE.)FJO *$.-`> 4RVBSF"UUBDL <""OESJVTIDIFOLP &$$7`> "VUP1(% "VUP1(%%-3 4"*'(. <9%POH $713`> ("." <(4SJSBNBOBO /FVS*14`> .VMUJεςοϓͷ࣌ <",VSBLJO *$-38`> ଛࣦؔωοτϫʔΫઃܭͷվળ Ϟσϧग़ྗʹର͢Δਖ਼ଇԽ ܭࢉίετͷݮ ࣄޙ֬ͷਖ਼ଇԽ ࣝͷৠཹ 4UBOEBSE"5 <*(PPEGFMMPX *$-3`> "5XJUI1(% <".BESZ *$-3`> ˢ /BUVSBMͱ"&Tͷ༻ 1(%BUUBDLͷ"&TΛར༻ ˢ "&TͷΈ μΠφϛοΫͳ εςοϓαΠζͷಋೖ 0VUFSNJOJNJ[BUJPOͷଛࣦܭࢉ .." <(8%JOH *$-3`> 53"%&4 <);IBOH *$.-`> '"5 <+;IBOH *$.-`> )"5 <33BEF *$.-8`> -
w ैདྷͷ"5ʹ͓͚Δ /BUVSBMαϯϓϧͷྨ݁Ռʹؔͳ͘ɼશαϯϓϧʹରͯ͠"&TΛఆֶٛͯ͠श ˠޡྨ͕ੜ͍ͯ͡Δαϯϓϧ"5ʹد༩͠ͳ͍ w αϯϓϧͷྨ݁ՌʹԠͨ͡ଛࣦܭࢉΛߦ͏ख๏ .BY.BSHJO"EWFSTBSJBM5SBJOJOH .."
<(8%JOH *$-3 > .JTDMBTTJ fi DBUJPO"XBSF"EWFSTBSJBM5SBJOJOH ."35 <:8BOH *$-3 > ޡྨͨ͠αϯϓϧͷޮՌతͳར༻ 21 -
"EWFSTBSJBMUSBJOJOHͷݚڀಈ 22 ࣝผڥքʹண ֶशதͷ"&Tͷ࡞ํ๏ʹண αϯϓϧ͝ͱʹ8FJHIUJOH .JTMFBEͨ͠αϯϓϧͷ׆༻ ࣍ݩಛۭؒ ೖྗը૾ۭؒ %FGFOTF "UUBDL
"5(*' <$$IFO BS9JW`> *"5 <"-BNC "*4FD`> .5-"5 <"-BVHSPT &$$7`> %"5 <:8BOH *$.-`> 'FBUVSFTDBUUFS <);IBOHBOE+8BOH /FVS*14`> $"5 <2;$BJ *+$"*`> 6OJWFSTBM"5 <"4IBGBIJ """*`> "7NJYVQ <4-FF $713`> ("5 <(4SJSBNBOBO /FVS*14`> ("*3"5 <+;IBOH *$-3`> ."*- <28BOH /FVS*14`> 8..3 <);FOH """*`> #J-"8 <$)PMU[ 0QFO3FWJFX`> -#("5 <+$VJ *$$7`> #("5 <+$VJ *$$7`> 1$-$ <9-J """*`> 1$MPTT <".VTUBGB *$$7`> $//X3#'LFSOFM <4"5BHIBOBLJ $713`> "-1 <),BOOBO BS9JW`> ."35 <:8BOH *$-3`> ..-%" <51BOH *$.-`> ..$ <51BOH *$-3`> -#'(4 <$4[FHFEZ *$-3`> '(4. <*(PPEGFMMPX *$-3`> $8 </$BSMJOJBOE%8BHOFS 41`> 1(% <".BESZ *$-3`> #*. *-$. ઁಈͷ࠷దԽ .VMUJQMFUBSHFUFE <4(PXBM BS9JW`> 6OJWFSTBM"&T <4..PPTBWJ%F[GPPMJ $713`> "VUP"UUBDL <'$SPDFBOE.)FJO *$.-`> '"# <'$SPDFBOE.)FJO *$.-`> 4RVBSF"UUBDL <""OESJVTIDIFOLP &$$7`> "VUP1(% "VUP1(%%-3 4"*'(. <9%POH $713`> ("." <(4SJSBNBOBO /FVS*14`> .VMUJεςοϓͷ࣌ <",VSBLJO *$-38`> ଛࣦؔωοτϫʔΫઃܭͷվળ Ϟσϧग़ྗʹର͢Δਖ਼ଇԽ ܭࢉίετͷݮ ࣄޙ֬ͷਖ਼ଇԽ ࣝͷৠཹ 4UBOEBSE"5 <*(PPEGFMMPX *$-3`> "5XJUI1(% <".BESZ *$-3`> ˢ /BUVSBMͱ"&Tͷ༻ 1(%BUUBDLͷ"&TΛར༻ ˢ "&TͷΈ μΠφϛοΫͳ εςοϓαΠζͷಋೖ 0VUFSNJOJNJ[BUJPOͷଛࣦܭࢉ .." <(8%JOH *$-3`> 53"%&4 <);IBOH *$.-`> '"5 <+;IBOH *$.-`> )"5 <33BEF *$.-8`> -
w ैདྷͷ"5ʹ͓͚Δ ΫϥεڥքͱαϯϓϧͷϚʔδϯΛߟֶྀͯ͠श͕͞Ε͍ͯͳ͍ ˠڥքʹ͍ۙαϯϓϧ߈ܸͷϦεΫ͕ߴ͍ w Ϋϥεڥք͔ۙΒཧతʹ͢ख๏ 1SPUPUZQF$POGPSNJUZMPTT 1$MPTT
<".VTUBGB *$$7 > 1SPCBCJMJTUJDBMMZ$PNQBDUMPTTXJUI-PHJU$POTUSBJOUT 1$-$ <9-J """* > ଛࣦؔωοτϫʔΫઃܭͷվળ 23 -
w ֶशՄೳͳΫϥεத৺Λ༻͍ͯಛදݱΛૢ࡞ ਖ਼ղΫϥεɿಛྔͱΫϥεத৺ͷڑΛ࠷খԽ͢Δ͜ͱͰίϯύΫτʹදݱ ෆਖ਼ղΫϥεɿಛྔͱΫϥεத৺ͷڑΛ࠷େԽ͢Δ͜ͱͰϫΠυʹදݱ 1$MPTT<".VTUBGB *$$7 > 24
".VTUBGB et al. l"EWFSTBSJBM%FGFOTFCZ3FTUSJDUJOHUIF)JEEFO4QBDFPG%FFQ/FVSBM/FUXPSLTz *$$7 1$MPTT1SPUPUZQF$POGPSNJUZMPTT ˞ ʹؚΊͳͯ͘҉తʹΕΔ ∥wc yi − wc yj ∥2 LPC ֶशՄೳͳΫϥεॏ৺ wc αϯϓϧ n ʹؔ͢ΔಛϕΫτϧ fi xi Ϋϥε k ϋΠύʔύϥϝʔλ λ1 , λ2 L(xi , yi ) = LCE (xi , yi ) + LPC (xi , yi ) L(xi , yi ; θ) = LCE (xi , yi ; θ) + λ1 ⋅ ∥f(˜ xi ) − wc yi ∥2 − λ2 k − 1 ⋅ ∑ yj ≠yi (∥f(˜ xi ) − wc yj ∥2 + ∥wc yi − wc yj ∥2) ֶश͢Δଛࣦؔ ˢ ਖ਼ղΫϥεத৺ͱͷڑܭࢉ ˢ ෆਖ਼ղΫϥεத৺ ͱͷڑܭࢉ ˢ Ϋϥεத৺ؒͷڑܭࢉ fi (˜ xi ) wc yj wc yj wc yi ͚ۙͮΔ ͢ ͢ ͢ ͢ -
w ΫϩεΤϯτϩϐʔޡࠩͷܭࢉͳ͠Ͱ1$MPTTͱಉ༷ͷૢ࡞ ਖ਼ղΫϥεͷ͕֬ҙͷᮢΛԼճΔαϯϓϧશͯෆਖ਼ղˠίϯύΫτ͔ͭϫΠυͳදݱ ਖ਼ղΫϥεͱྡΫϥε֬ͷ͕ࠩৗʹਖ਼ΛཁˠΫϥε͕ަࠩ͢Δ͜ͱΛࢭ 1$-$<9-J """* > 25
9-J et al. l*NQSPWJOH"EWFSTBSJBM3PCVTUOFTTWJB1SPCBCJMJTUJDBMMZ$PNQBDU-PTTXJUI-PHJU$POTUSBJOUTz """* 1$-$1SPCBCJMJTUJDBMMZ$PNQBDUMPTTXJUI-PHJU$POTUSBJOU 1$-$ͷଛࣦؔ L(xi , yi ; θ) = max (0,py′  (˜ xi ) + τ − pyi (˜ xi )) + λ (max (0,zyi (˜ xi ) − zy′  (˜ xi )) − C′  ) #PVOEBSZ $MBTTDFOUFS $MBTTDFOUFS τ ˢ ྨڥքΛਖ਼ղΫϥεଆʹ ͚ͩҠಈ τ ˢ ྡΫϥεͱͷަࠩΛࢭ -
w ΫϩεΤϯτϩϐʔޡࠩͷܭࢉͳ͠Ͱ1$MPTTͱಉ༷ͷૢ࡞ ਖ਼ղΫϥεͷ͕֬ҙͷᮢΛԼճΔαϯϓϧશͯෆਖ਼ղˠίϯύΫτ͔ͭϫΠυͳදݱ ਖ਼ղΫϥεͱྡΫϥε֬ͷ͕ࠩৗʹਖ਼ΛཁˠΫϥε͕ަࠩ͢Δ͜ͱΛࢭ 1$-$<9-J """* > 26
9-J et al. l*NQSPWJOH"EWFSTBSJBM3PCVTUOFTTWJB1SPCBCJMJTUJDBMMZ$PNQBDU-PTTXJUI-PHJU$POTUSBJOUTz """* 1$-$1SPCBCJMJTUJDBMMZ$PNQBDUMPTTXJUI-PHJU$POTUSBJOU 1$-$ͷଛࣦؔ L(xi , yi ; θ) = max (0,py′  (˜ xi ) + τ − pyi (˜ xi )) + λ (max (0,zyi (˜ xi ) − zy′  (˜ xi )) − C′  ) #PVOEBSZ $MBTTDFOUFS $MBTTDFOUFS τ ˢ ෆਖ਼ղαϯϓϧ ˢ ྨڥքΛਖ਼ղΫϥεଆʹ ͚ͩҠಈ τ ˢ ྡΫϥεͱͷަࠩΛࢭ -
w ΫϩεΤϯτϩϐʔޡࠩͷܭࢉͳ͠Ͱ1$MPTTͱಉ༷ͷૢ࡞ ਖ਼ղΫϥεͷ͕֬ҙͷᮢΛԼճΔαϯϓϧશͯෆਖ਼ղˠίϯύΫτ͔ͭϫΠυͳදݱ ਖ਼ղΫϥεͱྡΫϥε֬ͷ͕ࠩৗʹਖ਼ΛཁˠΫϥε͕ަࠩ͢Δ͜ͱΛࢭ 1$-$<9-J """* > 27
9-J et al. l*NQSPWJOH"EWFSTBSJBM3PCVTUOFTTWJB1SPCBCJMJTUJDBMMZ$PNQBDU-PTTXJUI-PHJU$POTUSBJOUTz """* 1$-$1SPCBCJMJTUJDBMMZ$PNQBDUMPTTXJUI-PHJU$POTUSBJOU 1$-$ͷଛࣦؔ L(xi , yi ; θ) = max (0,py′  (˜ xi ) + τ − pyi (˜ xi )) + λ (max (0,zyi (˜ xi ) − zy′  (˜ xi )) − C′  ) #PVOEBSZ $MBTTDFOUFS $MBTTDFOUFS τ ˢ ෆਖ਼ղαϯϓϧ ˢ ྨڥքΛਖ਼ղΫϥεଆʹ ͚ͩҠಈ τ ˢ ྡΫϥεͱͷަࠩΛࢭ -
"EWFSTBSJBMUSBJOJOHͷݚڀಈ 28 ࣝผڥքʹண ֶशதͷ"&Tͷ࡞ํ๏ʹண αϯϓϧ͝ͱʹ8FJHIUJOH .JTMFBEͨ͠αϯϓϧͷ׆༻ ࣍ݩಛۭؒ ೖྗը૾ۭؒ %FGFOTF "UUBDL
"5(*' <$$IFO BS9JW`> *"5 <"-BNC "*4FD`> .5-"5 <"-BVHSPT &$$7`> %"5 <:8BOH *$.-`> 'FBUVSFTDBUUFS <);IBOHBOE+8BOH /FVS*14`> $"5 <2;$BJ *+$"*`> 6OJWFSTBM"5 <"4IBGBIJ """*`> "7NJYVQ <4-FF $713`> ("5 <(4SJSBNBOBO /FVS*14`> ("*3"5 <+;IBOH *$-3`> ."*- <28BOH /FVS*14`> 8..3 <);FOH """*`> #J-"8 <$)PMU[ 0QFO3FWJFX`> -#("5 <+$VJ *$$7`> #("5 <+$VJ *$$7`> 1$-$ <9-J """*`> 1$MPTT <".VTUBGB *$$7`> $//X3#'LFSOFM <4"5BHIBOBLJ $713`> "-1 <),BOOBO BS9JW`> ."35 <:8BOH *$-3`> ..-%" <51BOH *$.-`> ..$ <51BOH *$-3`> -#'(4 <$4[FHFEZ *$-3`> '(4. <*(PPEGFMMPX *$-3`> $8 </$BSMJOJBOE%8BHOFS 41`> 1(% <".BESZ *$-3`> #*. *-$. ઁಈͷ࠷దԽ .VMUJQMFUBSHFUFE <4(PXBM BS9JW`> 6OJWFSTBM"&T <4..PPTBWJ%F[GPPMJ $713`> "VUP"UUBDL <'$SPDFBOE.)FJO *$.-`> '"# <'$SPDFBOE.)FJO *$.-`> 4RVBSF"UUBDL <""OESJVTIDIFOLP &$$7`> "VUP1(% "VUP1(%%-3 4"*'(. <9%POH $713`> ("." <(4SJSBNBOBO /FVS*14`> .VMUJεςοϓͷ࣌ <",VSBLJO *$-38`> ଛࣦؔωοτϫʔΫઃܭͷվળ Ϟσϧग़ྗʹର͢Δਖ਼ଇԽ ܭࢉίετͷݮ ࣄޙ֬ͷਖ਼ଇԽ ࣝͷৠཹ 4UBOEBSE"5 <*(PPEGFMMPX *$-3`> "5XJUI1(% <".BESZ *$-3`> ˢ /BUVSBMͱ"&Tͷ༻ 1(%BUUBDLͷ"&TΛར༻ ˢ "&TͷΈ μΠφϛοΫͳ εςοϓαΠζͷಋೖ 0VUFSNJOJNJ[BUJPOͷଛࣦܭࢉ .." <(8%JOH *$-3`> 53"%&4 <);IBOH *$.-`> '"5 <+;IBOH *$.-`> )"5 <33BEF *$.-8`> -
w ैདྷͷ"5ʹ͓͚Δ શαϯϓϧΛ͘͠ଛࣦܭࢉ͢ΔͨΊɼଛࣦ͕େ͖͍αϯϓϧʹґଘͯ͠ޡ͕ࠩఀ ˠϞσϧશମͷੑೳྼԽ w ΫϥεڥքͱͷزԿతͳڑ͔ؔΒαϯϓϧͷॏΈ͚Λ͢Δख๏ (FPNFUSZ"XBSF*OTUBODF3FXFJHIUFE"EWFSTBSJBM5SBJOJOH ("*3"5
<+;IBOH *$-3 > 8FJHIUFE.JOJ.BY3JTL 8..3 <);FOH """* > .BSHJO"XBSF*OTUBODF3FXFJHIUJOH-FBSOJOH ."*- <28BOH /FVS*14 > #JMFWFM-FBSOBCMF"EWFSTBSJBM3FXFJHIUJOH #J-"8 <$)PMU[ 0QFO3FWJFX > αϯϓϧ͝ͱͷ8FJHIUJOHͷར༻ 29 Ϟσϧશମͷ࠷దԽࣜ ֤αϯϓϧͷଛࣦʹର͢ΔॏΈ͚ ω(xi , yi ) min θ 1 n n ∑ i=1 L(f(˜ xi ; θ), yi ) -
w 1(%ͷ߈ܸճʹج͍ͮͨॏΈఆٛ গͳ͍ճͰޡྨ͕ੜͨ͡αϯϓϧ΄Ͳ߈ܸͷϦεΫ͕ߴ͍ ࢦఆճͰޡྨ͕ੜ͡ͳ͍αϯϓϧ߈ܸͷϦεΫ͕͍ w /BUVSBMͳঢ়ଶͰޡྨ͍ͯ͠Δ͔൱͔ߟྀ͠ͳ͍ ("*3"5<+;IBOH *$-3
> 30 +;IBOH et al. l(&0.&53:"8"3&*/45"/$&3&8&*()5&%"%7&34"3*"-53"*/*/(z *$-3 ("*3"5(FPNFUSZ"XBSF*OTUBODF3FXFJHIUFE"EWFSTBSJBM5SBJOJOH 8FJHIUJOHؔ ω(xi , yi ) = (1 − tanh(λ + 5 × (1 − 2 × κ(xi , yi )/K))) 2 ω(xi , yi ) ≥ 0 n ∑ i=1 ω(xi , yi ) = 1 ߈ܸʹޭͨ͠࠷খεςοϓ κ(x, y) 1(%ͷ૯εςοϓ K ϋΠύʔύϥϝʔλ λ #PVOEBSZ $MBTTDFOUFS $MBTTDFOUFS x1 x2 x3 ڥքͱͷϚʔδϯ -
w Ϋϥε֬Λ༻͍ͯڥք·ͰͷزԿతͳڑΛఆٛ ූ߸͕ਖ਼͔ͭϚʔδϯ͕େ͖͍ˠখ͞ͳॏΈɿॏཁ͕͍ ූ߸͕ਖ਼͔ͭϚʔδϯ͕খ͍͞ˠେ͖ͳॏΈɿॏཁ͕ߴ͍ ූ߸͕ෛˠେ͖ͳॏΈɿॏཁ͕ߴ͍ ࣄޙΛϕʔεʹϚʔδϯΛܾఆ͢Δख๏ 31
$MBTTDFOUFS #PVOEBSZ $MBTTDFOUFS p = 0.7 p = 0.3 p = 0.8 p = 0.2 -
w Ϋϥε֬Λ༻͍ͯڥք·ͰͷزԿతͳڑΛఆٛ ූ߸͕ਖ਼͔ͭϚʔδϯ͕େ͖͍ˠখ͞ͳॏΈɿॏཁ͕͍ ූ߸͕ਖ਼͔ͭϚʔδϯ͕খ͍͞ˠେ͖ͳॏΈɿॏཁ͕ߴ͍ ූ߸͕ෛˠେ͖ͳॏΈɿॏཁ͕ߴ͍ ࣄޙΛϕʔεʹϚʔδϯΛܾఆ͢Δख๏ 32
8..3<);FOH """* > 8FJHIUFE.JOJ.BY3JTL w ࢦؔʹΑΔॏΈఆٛ ޡྨͨ͠αϯϓϧ΄Ͳେ͖ͳॏΈ͚ͮ $MBTTDFOUFS #PVOEBSZ $MBTTDFOUFS p = 0.7 p = 0.3 p = 0.8 p = 0.2 ω(xi , yi ) = exp (−α ⋅ margin (˜ xi , yi)) margin (˜ xi , yi) = pyi (˜ xi ) − max j≠yi pj (˜ xi ) 8FJHIUJOHؔ );FOH et al. l"SF"EWFSTBSJBM&YBNQMFT$SFBUFE&RVBM "-FBSOBCMF8FJHIUFE.JOJNBY3JTLGPS3PCVTUOFTTVOEFS/POVOJGPSN"UUBDLTz """* -
w Ϋϥε֬Λ༻͍ͯڥք·ͰͷزԿతͳڑΛఆٛ ූ߸͕ਖ਼͔ͭϚʔδϯ͕େ͖͍ˠখ͞ͳॏΈɿॏཁ͕͍ ූ߸͕ਖ਼͔ͭϚʔδϯ͕খ͍͞ˠେ͖ͳॏΈɿॏཁ͕ߴ͍ ූ߸͕ෛˠେ͖ͳॏΈɿॏཁ͕ߴ͍ ࣄޙΛϕʔεʹϚʔδϯΛܾఆ͢Δख๏ 33
8..3<);FOH """* > 8FJHIUFE.JOJ.BY3JTL w ࢦؔʹΑΔॏΈఆٛ ޡྨͨ͠αϯϓϧ΄Ͳେ͖ͳॏΈ͚ͮ $MBTTDFOUFS #PVOEBSZ $MBTTDFOUFS p = 0.7 p = 0.3 p = 0.8 p = 0.2 ω(xi , yi ) = exp (−α ⋅ margin (˜ xi , yi)) margin (˜ xi , yi) = pyi (˜ xi ) − max j≠yi pj (˜ xi ) 8FJHIUJOHؔ );FOH et al. l"SF"EWFSTBSJBM&YBNQMFT$SFBUFE&RVBM "-FBSOBCMF8FJHIUFE.JOJNBY3JTLGPS3PCVTUOFTTVOEFS/POVOJGPSN"UUBDLTz """* w 4JHNPJEؔʹΑΔॏΈఆٛ ϛχόονͰॏΈΛਖ਼نԽ ."*-<28BOH /FVS*14 > .BSHJO"XBSF*OTUBODF3FXFJHIUJOH-FBSOJOH ω(xi , yi ) = sigmoid (−γ ⋅ (PM(xi , yi ) − β)) PMnat (xi , yi ) = pyi (xi ) − max j≠yi pj (xi ) PMadv (˜ xi , yi ) = pyi (˜ x′  i ) − max j≠yi pj (˜ xi ) PMdif (x′  i , yi ) = pyi (xi ) − pyi (x′  i ) 8FJHIUJOHؔ 28BOH et al. l1SPCBCJMJTUJD.BSHJOTGPS*OTUBODF3FXFJHIUJOHJO"EWFSTBSJBM5SBJOJOHz /FVS*14 -
"EWFSTBSJBMUSBJOJOHͷݚڀಈ 34 ࣝผڥքʹண ֶशதͷ"&Tͷ࡞ํ๏ʹண αϯϓϧ͝ͱʹ8FJHIUJOH .JTMFBEͨ͠αϯϓϧͷ׆༻ ࣍ݩಛۭؒ ೖྗը૾ۭؒ %FGFOTF "UUBDL
"5(*' <$$IFO BS9JW`> *"5 <"-BNC "*4FD`> .5-"5 <"-BVHSPT &$$7`> %"5 <:8BOH *$.-`> 'FBUVSFTDBUUFS <);IBOHBOE+8BOH /FVS*14`> $"5 <2;$BJ *+$"*`> 6OJWFSTBM"5 <"4IBGBIJ """*`> "7NJYVQ <4-FF $713`> ("5 <(4SJSBNBOBO /FVS*14`> ("*3"5 <+;IBOH *$-3`> ."*- <28BOH /FVS*14`> 8..3 <);FOH """*`> #J-"8 <$)PMU[ 0QFO3FWJFX`> -#("5 <+$VJ *$$7`> #("5 <+$VJ *$$7`> 1$-$ <9-J """*`> 1$MPTT <".VTUBGB *$$7`> $//X3#'LFSOFM <4"5BHIBOBLJ $713`> "-1 <),BOOBO BS9JW`> ."35 <:8BOH *$-3`> ..-%" <51BOH *$.-`> ..$ <51BOH *$-3`> -#'(4 <$4[FHFEZ *$-3`> '(4. <*(PPEGFMMPX *$-3`> $8 </$BSMJOJBOE%8BHOFS 41`> 1(% <".BESZ *$-3`> #*. *-$. ઁಈͷ࠷దԽ .VMUJQMFUBSHFUFE <4(PXBM BS9JW`> 6OJWFSTBM"&T <4..PPTBWJ%F[GPPMJ $713`> "VUP"UUBDL <'$SPDFBOE.)FJO *$.-`> '"# <'$SPDFBOE.)FJO *$.-`> 4RVBSF"UUBDL <""OESJVTIDIFOLP &$$7`> "VUP1(% "VUP1(%%-3 4"*'(. <9%POH $713`> ("." <(4SJSBNBOBO /FVS*14`> .VMUJεςοϓͷ࣌ <",VSBLJO *$-38`> ଛࣦؔωοτϫʔΫઃܭͷվળ Ϟσϧग़ྗʹର͢Δਖ਼ଇԽ ܭࢉίετͷݮ ࣄޙ֬ͷਖ਼ଇԽ ࣝͷৠཹ 4UBOEBSE"5 <*(PPEGFMMPX *$-3`> "5XJUI1(% <".BESZ *$-3`> ˢ /BUVSBMͱ"&Tͷ༻ 1(%BUUBDLͷ"&TΛར༻ ˢ "&TͷΈ μΠφϛοΫͳ εςοϓαΠζͷಋೖ 0VUFSNJOJNJ[BUJPOͷଛࣦܭࢉ .." <(8%JOH *$-3`> 53"%&4 <);IBOH *$.-`> '"5 <+;IBOH *$.-`> )"5 <33BEF *$.-8`> -
w ैདྷͷ"5ʹ͓͚Δ ௨ৗͷ"5Ͱ"&TʹϑΟοτͨ͠ΫϥεڥքΛ֫ಘ ˠ/BUVSBMαϯϓϧʹର͢Δޡྨ͕ଟൃ w /BUVSBMαϯϓϧͷΫϥεڥքΛΨΠυʹͨ͠ख๏ #PVOEBSZ(VJEFE"EWFSTBSJBM5SBJOJOH #("5
<+$VJ *$$7 > -FBSOBCMF#PVOEBSZ(VJEFE"EWFSTBSJBM5SBJOJOH -#("5 <+$VJ *$$7 > ࣝͷৠཹ 35 ௨ৗͷֶशΛͨ͠Ϟσϧ "5Λͨ͠Ϟσϧ -
w /BUVSBMͷΫϥεڥքΛΨΠυʹͨ͠"5 /BUVSBMͷࣝΛϩόετͳϞσϧܧঝ "&Tʹର͢ΔΫϩεΤϯτϩϐʔޡࠩܭࢉ͠ͳ͍ -#("5<+$VJ *$$7 > 36
+$VJ et al. l-FBSOBCMF#PVOEBSZ(VJEFE"EWFSTBSJBM5SBJOJOHz *$$7 -#("5-FBSOBCMF#PVOEBSZ(VJEFE"EWFSTBSJBM5SBJOJOH min θ 𝔼 (xi ,yi )∈D L (ℳrob (xadv i ), ℳnat (xi )) #PVOEBSZ(VJEFE"EWFSTBSJBM5SBJOJOH 1BSBNFUFS fi YFE ℳnat ℳrob ℳnat (xi ) xi xadv i ℳrob (xadv i ) MSE (ℳrob (xi ), ℳnat (xadv i )) ֶशࡁΈͷ ͷΫϥεڥքΛ ʹܧঝ ˞ΫϩεΤϯτϩϐʔޡࠩ༻͠ͳ͍ ℳnat ℳrob min θ,θ* 𝔼 (xi ,yi )∈D L (ℳrob (xadv i ), ℳnat (xi )) +β ⋅ L(xi , yi ; θ) ℳnat ℳrob ℳnat (xi ) xi xadv i ℳrob (xadv i ) MSE (ℳrob (xi ), ℳnat (xadv i )) L (xi , yi ; θ) -FBSOBCMF#PVOEBSZ(VJEFE"EWFSTBSJBM5SBJOJOH ͱ Λॳظ͔Βڞಉֶश ˞ ʹؔͯ͠ΫϩεΤϯτϩϐʔޡࠩ༻͠ͳ͍ ℳnat ℳrob ℳrob -
w ϞσϧͱσʔληοτΛ౷Ұͯ͠ྨਫ਼ͱ߈ܸʹର͢Δؤ݈ੑΛൺֱ ֶश݅جຊతʹจهࡌͷΛར༻ w ڞ௨ͷ݅ σʔληοτɿ$*'"3 ϕʔεϞσϧɿ8JEF3FT/FU
w ֶश݅ʢจʹهࡌ͕ͳ͍߹ʣ ֶशճɿ όοναΠζɿ ࠷దԽख๏ɿNPNFOUVN4(% ֶशɿ ֶशͷݮਰɿ FQPDIͰ NPNFOUVNɿ *OOFSNBYɿ1(% ʣ K K = 10 ϵ = 8/255 α = ϵ/4 ධՁ࣮ݧ 37 -
ධՁࢦඪ 38 Acc = 1 M M ∑ i=1 1
[f(xi ) = yi] Ϋϥεྨਫ਼ /BUVSBMͳਫ਼ɿਪσʔλʹର͢ΔධՁ Ϟσϧͷؤ݈ੑೳɿਪσʔλΛ߈ܸͨ࣌͠ͷਫ਼ ैདྷͷධՁࢦඪ ಛۭؒͷఆྔతධՁ தؒͷಛྔʹؔ͢ΔධՁࢦඪ ɾ$BMJOTLJ)BSBCBT[ࢦඪ ɾ4JMIPVFUUFείΞ ࣄޙ֬Λ༻͍ͨධՁࢦඪ ɾ)PNPHFOFJUZείΞ ɾ$PNQMFUFOFTTείΞ ˠྨਫ਼͚ͩͰͳ͘ಛۭؒͷఆྔతධՁඞཁ Ϟσϧ Ϟσϧ -
w Ϋϥελ͕ίϯύΫτ͔ͭΫϥελ͕ؒϫΠυͳදݱ είΞ͕ߴ͍΄Ͳ༏ΕͨΫϥελׂ είΞ͕ʹ͍ۙ΄ͲෆదͳΫϥελׂ $BMJOTLJBOE)BSBCBT[ࢦඪ 39 5$BMJOTLJBOE+)BSBCBT[ l"EFOESJUFNFUIPEGPSDMVTUFSBOBMZTJTz
$PNNVOJDBUJPOTBOE4UBUJDT Cal . = tr(Bk ) tr(Wk ) × (nE − k) k − 1 Wk = k ∑ q=1 ∑ x∈Cq ∥x − cq ∥2 2 Bk = k ∑ q=1 nq ∥cq − cE ∥2 2 ɿΫϥε k ɿΫϥε ͷΫϥελ Cq q ɿσʔληοτશମͷத৺ cE ɿΫϥε ͷΫϥελத৺ cq q ɿΫϥε ͷαϯϓϧ nq q cE ɿσʔληοτશମͷαϯϓϧ nE c1 c3 c2 c1 c3 c2 C1 C2 C3 ΫϥεࢄɿΫϥελத৺ͱαϯϓϧͷڑ Ϋϥεؒࢄɿ֤Ϋϥελத৺ͱશମத৺ͷڑ -
w ҙͷαϯϓϧ͕దͳΫϥελʹଐͯ͠Δ͔Ͳ͏͔Λද͢ࢦඪ είΞ͕ʹ͍ۙ΄Ͳ༏ΕͨΫϥελׂ είΞ͕ʹ͍ۙ΄ͲΫϥελ্ׂ͕ख͘Ͱ͖ͯͳ͍ 4JMIPVFUUFείΞ 40 1+3PVTTFFVX l4JMIPVFUUFTB(SBQIJDBM"JEUPUIF*OUFSQSFUBUJPOBOE7BMJEBUJPOPG$MVTUFS"OBMZTJTz
$PNQVUBUJPOBMBOE"QQMJFE.BUIFNBUJDT Sil . (i) = b(i) − a(i) max(a(i), b(i)) a(i) = 1 |Cin | − 1 ∑ x( j)∈Cin ∥x(i) − x(j)∥2 b(i) = 1 |Cnear | − 1 ∑ x( j)∈Cnear ∥x(i) − x(j)∥2 ɿ ͕ଐ͢ΔΫϥελ Cin x(i) ɿ ͕ଐ͢ΔΫϥελʹ࠷͍ۙΫϥελ Cnear x(i) ɿ ·ͨ ʹؚ·ΕΔҙͷαϯϓϧ x( j) Cin Cnear x(i) a(i) x(j) Cin Ϋϥελͷฏۉڑͷܭࢉ x(i) b(i) x(j) Cnear Ϋϥελؒͷฏۉڑͷܭࢉ -
w ΫϥελΛجຊ֓೦ͱͨ͠ࢦඪ ֤Ϋϥελʹ͓͍֤ͯσʔλ͕ಉ͡Ϋϥεϥϕϧ͔Λఆ Ϋϥελʹؚ·ΕΔαϯϓϧͷΫϥε͕छྨͷͱ͖είΞ͕ߴ͍ )PNPHFOFJUZείΞ 41 "3PTFOCFSHBOE+)JSTDICFSH l7.FBTVSF"$POEJUJPOBM&OUSPQZ#BTFE&YUFSOBM$MVTUFS&WBMVBUJPO.FBTVSFz
&./-1$P-- Ϋϥελͷαϯϓϧ͕ෳͷΫϥεΛؚΉ ˠ)PNPHFOFJUZείΞ͕͍ ֤ΫϥελͷαϯϓϧΫϥε͕छྨ ˠ)PNPHFOFJUZείΞ͕ߴ͍ Homo . = { 1 if H(C, K) = 0 1 − H(C|K) H(C) else H(C|K) = − |K| ∑ k=1 |C| ∑ c=1 ack N log ack ∑ |C| c=1 ack H(C) = − |C| ∑ c=1 ∑ |K| k=1 ack n log ∑ |K| k=1 ack n ɿΫϥεू߹ C = {ci |i = 1,…, n} ɿΫϥελू߹ K = {ki |i = 1,…, m} ɿΫϥε ͰΫϥελ ʹؚ·ΕΔσʔλू߹ A = {aij } i j -
w ֤αϯϓϧʹର͢ΔΫϥεϥϕϧΛجຊ֓೦ͱͨ͠ࢦඪ ֤Ϋϥεϥϕϧͷσʔλ͕ಉ͡Ϋϥελʹ͋Δ͔ΛධՁ ͭͷΫϥελʹಉ͡Ϋϥεϥϕϧͷαϯϓϧ͕શؚͯ·ΕΔͱ͖είΞ͕ߴ͍ $PNQMFUFOFTTείΞ 42 Comp .
= { 1 if H(K, C) = 0 1 − H(K|C) H(K) else H(K|C) = − |C| ∑ c=1 |K| ∑ k=1 ack N log ack ∑ |K| k=1 ack H(K) = − |K| ∑ k=1 ∑ |C| c=1 ack m log ∑ |C| c=1 ack m "3PTFOCFSHBOE+)JSTDICFSH l7.FBTVSF"$POEJUJPOBM&OUSPQZ#BTFE&YUFSOBM$MVTUFS&WBMVBUJPO.FBTVSFz &./-1$P-- Ϋϥελʹಉ͡Ϋϥεϥϕϧͷαϯϓϧؚ͕·ΕΔ ˠ$PNQMFUFOFTTείΞ͕ߴ͍ ಉ͡Ϋϥεϥϕϧͷαϯϓϧ͕ෳͷΫϥελʹଐ͢Δ ˠ$PNQMFUFOFTTείΞ͕͍ ɿΫϥεू߹ C = {ci |i = 1,…, n} ɿΫϥελू߹ K = {ki |i = 1,…, m} ɿΫϥε ͰΫϥελ ʹؚ·ΕΔσʔλू߹ A = {aij } i j -
w ͲͪΒ͔ͭͰ༏ΕͨΫϥελׂ͔Λܾఆ͢Δ͜ͱࠔ جຊతʹ)PNPHFOFJUZͱ$PNQMFUFOFTT૬͢Δؔ దͳΫϥελׂ͕Ͱ͖ͨ߹ɼͭͷείΞ͕ͱʹߴ͘ͳΔ )PNPHFOFJUZͱ$PNQMFUFOFTT 43 ֤ΫϥελͷαϯϓϧΫϥε͕छྨ ಉ͡ΫϥεϥϕϧͷαϯϓϧͭͷΫϥελʹશͯଐ͢Δ
ˠ$PNQMFUFOFTTɼ)PNPHFOFJUZͱʹߴ͍ ˠͭͷࢦඪΛ߹ΘͤͯධՁ͢Δ͜ͱ͕ඞཁ -
ੑೳൺֱ 44 Ϋϥεྨੑೳ ಛۭؒͷఆྔධՁ /BUVSBM '(4. 1(% $8㱣 4JM $BM
)PNP $PNQ "5 1$MPTT 1$-$ "-1 53"%&4 ."35 ("*3"5 8..3 ."*- #("5 -#("5 "7NJYVQ ("5 '"5 -
ੑೳൺֱɿΫϥεྨੑೳ 45 Ϋϥεྨਫ਼Ͱ"7NJYVQ͕༏ΕͨੑೳΛൃش Ϋϥεྨੑೳ ಛۭؒͷఆྔධՁ /BUVSBM '(4. 1(% $8㱣 4JM
$BM )PNP $PNQ "5 1$MPTT 1$-$ "-1 53"%&4 ."35 ("*3"5 8..3 ."*- #("5 -#("5 "7NJYVQ ("5 '"5 -
ੑೳൺֱɿಛۭؒͷఆྔධՁ 46 தؒͷಛۭؒ-#("5͕༏ΕͨΫϥελׂˠ/BUVSBMαϯϓϧͷಛྔΛͱʹֶशͨ͠Ըܙ Ϋϥεྨੑೳ ಛۭؒͷఆྔධՁ /BUVSBM '(4. 1(% $8㱣 4JM
$BM )PNP $PNQ "5 1$MPTT 1$-$ "-1 53"%&4 ."35 ("*3"5 8..3 ."*- #("5 -#("5 "7NJYVQ ("5 '"5 "5ͷಛۭؒ U4/& -#("5ͷಛۭؒ U4/& -
1$MPTTʹؔ͢Δߟ 47 1$MPTT߈ܸʹର͢Δؤ݈ੑೳ͕͍͕ɼ༏ΕͨಛදݱΛ࣮ݱ Ϋϥεྨੑೳ ಛۭؒͷఆྔධՁ /BUVSBM '(4. 1(% $8㱣 4JM
$BM )PNP $PNQ "5 1$MPTT 1$-$ "-1 53"%&4 ."35 ("*3"5 8..3 ."*- #("5 -#("5 "7NJYVQ ("5 '"5 1$MPTTͷಛۭؒ U4/& -
w "EWFSTBSJBMBUUBDLʹΑͬͯ༰қʹ$//ͷޡྨΛ༠ൃՄೳ ਂֶशϕʔεͷΞϓϦέʔγϣϯͷηΩϡϦςΟͷڴҖ w "EWFSTBSJBM5SBJOJOH "5 ͷ /BUVSBMαϯϓϧʹର͢Δੑೳ͕ஶ͘͠ྼԽˠ"5͓͚ΔӬԕͷ՝
Ϋϥεڥքͱͷؔʹணֶͨ͠शํ๏͕τϨϯυ Πϯελϯε͝ͱͷ#PPTUJOH ཧతʹΫϥεڥք͔Β͢ଛࣦͷՃ ֤αϯϓϧͷྨ݁ՌΛߟྀͨ͠ଛࣦઃܭ w ྨੑೳ͚ͩͰͳ͘ಛۭؒʹணͨ͠ख๏ൺֱ ߴ͍ྨੑೳ ༏Εͨಛۭؒ ಛۭؒʹର͢ΔఆྔతͳධՁඇৗʹॏཁ ≠ ·ͱΊ 48