y } = E { ax + b } = a E { x } + b = aµ + b • ฏۉͱࢄҎԼͷΑ͏ʹԠ Var { y } = E ( y Ey )2 = E [ ax + b ( aµ + b )]2 = E a 2( x µ )2 = a 2E ( x µ )2 = a 2Var { x } = a 2 2
E ST x = ST E { x } = ST µ Var { y } = E ( y E { y })( y E { y })T = E (ST x ST µ )(ST x ST µ )T = E ST ( x µ )[ST ( x µ )]T = E ST ( x µ )( x µ )T S = ST E ( x µ )( x µ )T S = ST ⌃S
x µ )o = ⇤ 1/2ST (E { x } µ ) = 0 Var { u } = E n⇤ 1/2ST ( x µ )( x µ )T S(⇤ 1/2)T o = ⇤ 1/2ST E ( x µ )( x µ )T S(⇤ 1/2)T = ⇤ 1/2ST ⌃S(⇤ 1/2)T = ⇤ 1/2⇤(⇤ 1/2)T = I • ඪ४Խ͞Εɺ͔ͭແ૬ؔԽ͞Εͨʂ
1( x µ ) = ( x µ )T [S⇤S 1] 1( x µ ) = ( x µ )T S⇤ 1S( x µ ) = [ST ( x µ )]T ⇤ 1[ST ( x µ )] = y T ⇤ 1 y (* y ⌘ ST ( x µ )) = y T (⇤1/2)T ⇤1/2 y = (⇤1/2 y )T (⇤1/2 y ) = z T z (* z ⌘ ⇤ 1/2 y )
ln P(Ci) d 2 ln(2⇡) 1 2 ln |⌃i |1/2 1 2 ( x µi)T ⌃ 1 i ( x µi) gi( x ) = ( x µi)T ⌃ 1 i ( x µi) + ln |⌃i | 2 ln P(Ci) [Recognized class] = arg min i [ gi(x)]
) = ( x µi)T ⌃ 1 i ( x µi) + ln |⌃i | 2 ln P(Ci) ( x µj)T ⌃ 1 j ( x µj) ln |⌃j | + 2 ln P(Cj) = x ⌃ 1 i x x ⌃ 1 i µi µi⌃ 1 i x + µi⌃ 1 i µi x ⌃ 1 j x x ⌃ 1 j µj µj⌃ 1 j x + µj⌃ 1 j µj + ln |⌃i | ⌃j 2 ln P(Ci) P(Cj) = x (⌃ 1 i ⌃ 1 j ) x + 2( µ T j ⌃ 1 j µ T i ⌃ 1 i ) x + µT i ⌃ 1 i µiµT j ⌃ 1 j µj + ln |⌃i | ⌃j 2 ln P(Ci) P(Cj) ) x T S x + 2 c T x + F = 0 ʢ2 ࣍ࣝผؔʣ +µT i ⌃ 1 i µi µT j ⌃ 1 j µj + ln |⌃i | |⌃j | 2 ln P(Ci) P(Cj) fij( x ) = gi( x ) gj( x ) = ( x µi)T ⌃ 1 i ( x µi) + ln |⌃i | 2 ln P(Ci) ( x µj)T ⌃ 1 j ( x µj) ln |⌃j | + 2 ln P(Cj) = x ⌃ 1 i x x ⌃ 1 i µi µi⌃ 1 i x + µi⌃ 1 i µi x ⌃ 1 j x x ⌃ 1 j µj µj⌃ 1 j x + µj⌃ 1 j µj + ln |⌃i | ⌃j 2 ln P(Ci) P(Cj) = x (⌃ 1 i ⌃ 1 j ) x + 2( µ T j ⌃ 1 j µ T i ⌃ 1 i ) x + µT i ⌃ 1 i µiµT j ⌃ 1 j µj + ln |⌃i | ⌃j 2 ln P(Ci) P(Cj) x ⌃ 1 j x + x ⌃ 1 j µj + µj⌃ 1 j x µj⌃ 1 j µj
͔ͭ ͷͱ͖ fij( x ) = 2( µ T j ⌃ 1 j µ T j ⌃ 1 i ) x + µ T i ⌃ 1 i µi µ T i ⌃ 1 i µi = 2 ( µ T j µ T i ) x + µ T i µi µ T j µj = 0 x T x + 2 µ T i x + µ T i µi x T x + 2 µ T j x µ T j µj = 0 ( x µi)T ( x µi) ( x µj)T ( x µj) = 0 ) ( x µi)T ( x µi) = ( x µj)T ( x µj) x T x 2 µ T i x + µ T i µi x T x + 2 µ T j x µ T j µj = 0 • ྆ล σ ͰׂΓɺ x^T x Λ͠Ҿ͖ ʢ࠷ۙ๏……ͱຊʹॻ͍ͯ͋Δ͕ઢܗผੳʢLDAʣͰʁ ʢฏۉ͔ΒͷڑΛൺ͍ͯΔͷͰʣʣ +µT i ⌃ 1 i µi µT j ⌃ 1 j µj fij( x ) = 2( µ T j ⌃ 1 j µ T j ⌃ 1 i ) x + µ T i ⌃ 1 i µi µ T i ⌃ 1 i µi = 2 ( µ T j µ T i ) x + µ T i µi µ T j µj = 0
2 " N 2 ln 2 1 2 2 N X i=1 ( xi µ )2 # 2=ˆ2 = 0 N 2 1 ˆ2 1 2 1 (ˆ2)2 ( 1) N X i=1 ( xi µ )2 = 0 N ˆ2 + 1 (ˆ2)2 N X i=1 ( xi µ )2 = 0 ) ˆ2 = 1 N N X i=1 ( xi µ )2