BN !" ReLU !# + Conv !$ BN !% ReLU !& (a) CNNs Add !' !! ( !! ) !" ( !" ) !# ( !# ) !$ ( !$ ) !% ( !% ) !& ( !& ) !' ( !' ) Succeeding Layers Preceding Layers (b) Propagation on Dependency Graph !"ℎ $! " ≠ !"ℎ($! #) !"ℎ $$ " = !"ℎ($$ #) 1 0 2 3 0 1 2 3 1 0 2 3 1 0 2 3 1 0 2 3 1 0 2 3 0 1 2 3 1 0 2 3 Λج४ͱͨ͠߹ f4 %FQ(SBQIʹΑΔύϥϝʔλͷάϧʔϓԽ த෦େֶϩΰ த෦େֶϩΰ f+ 1 , f− 2 , f+ 2 , f− 3 , f+ 3 , f− 4 , f+ 4 f− 5 , f+ 5 f− 6 , f+ 6 , f− 7 , f+ 7 ࠷ऴతͳάϧʔϓ εΩοϓଓʹΑΓՃࢉ͢Δ ͕ ͱͷґଘ͕ؔଘࡏ f+ 3 f− 4 w[: , k, : , :] ≠ w[k, : , : , :] ೖྗͷࢬמΓ ग़ྗͷࢬמΓ w[out_ch, in_ch, fi lter_h, fi lter_w] ΈࠐΈͷॏΈ ˠґଘ͕ؔͳ͍ʢஅʣ ࠐΈೖग़ྗ͕ sch( f− i ) ≠ sch( f+ i )