Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Neural Semantic Encoders

youichiro
March 05, 2019

Neural Semantic Encoders

長岡技術科学大学
自然言語処理研究室
文献紹介(2019-03-05)
Neural Semantic Encoders
http://www.aclweb.org/anthology/E17-1038

youichiro

March 05, 2019
Tweet

More Decks by youichiro

Other Decks in Research

Transcript

  1. Neural Semantic Encoders 29015 -3 Tsendsuren Munkhdalai and Hong Yu

    Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, pages 397–407, 2017
  2. "CTUSBDU • .FNPSZ/FUXPSLΛ֦ுͨ͠/FVSBM4FNBOUJD&ODPEFST /4&  ΛఏҊ Ø ͋͘·Ͱ୯ޠදݱ &ODPEFS ͳͷͰ༷ʑͳλεΫʹԠ༻Մೳ

    Ø NFNPSZVQEBUFػೳͷ௥Ճ Ø .VMUJQMFNFNPSZBDDFTT4IBSFENFNPSZBDDFTT • ͭͷ/-1λεΫʹ͓͍ͯ༗ޮੑΛࣔͨ͠ 
  3. /FVSBM4FNBOUJD&ODPEFST         

    !"#$: &' ℎ)$$*+ ,-.-*: ℎ' ϝϞϦʹ͸͋Β͔͡Ίશ୯ޠΛ֨ೲͯ͠ ͓͘
  4. /FVSBM4FNBOUJD&ODPEFST         

    !"#$: &' ℎ)$$*+ ,-.-*: ℎ' ୯ޠ &' Λೖྗͯ͠ɼ ͭͷϕΫτϧ ℎ' Λग़ྗ͢Δ ˠ ޙஈͷϞσϧʹ౉͢
  5. /FVSBM4FNBOUJD&ODPEFST         

    !"#$: &' ℎ)$$*+ ,-.-*: ℎ' ϝϞϦͷத͔Βண໨͢Δ औΓग़͢ εϩο τΛࢦࣔ͢͠ϕΫτϧΛ࡞Δ ˠ /'
  6. /FVSBM4FNBOUJD&ODPEFST         

    !"#$: &' ℎ)$$*+ ,-.-*: ℎ' औΓग़ͨ͠ϝϞϦεϩοτͱೖྗ୯ޠΛ ૊Έ߹ΘͤͨϕΫτϧΛ࡞Δ ˠ /'
  7. /FVSBM4FNBOUJD&ODPEFST         

    !"#$: &' ℎ)$$*+ ,-.-*: ℎ' /'͔Βग़ྗϕΫτϧΛ࡞Δ ˠ ℎ' ಡΈࠐΜͩεϩοτͷҐஔʹ৽͍͠ঢ়ଶ Λ্ॻ͖͢Δ NFNPSZVPEBUF
  8. /FVSBM4FNBOUJD&ODPEFST 0 0 M = #$ , #& , …

    , #(        0 )* 0 )* +* 1 0 0 -0 - ,* , )* #-,* .* ℎ* 0*1$ 0* 0 0
  9. /FVSBM4FNBOUJD&ODPEFST 0 0 !" = $% , $' , …

    , $)        0 *" 0 *" +, 1 0 0 -0 - -, , *, $.,, /, ℎ, !,1% !, 0 0
  10. .VMUJQMFNFNPSZBDDFTT         !"#$:

    &' .FNPSZ. ℎ)$$*+ ,-.-*: ℎ' .FNPSZ. ü ෳ਺ͷϝϞϦΛࢀরͰ͖Δ
  11. 4IBSFENFNPSZBDDFTT         !"#$:

    &',) ℎ+$$,- ./0/,: ℎ',) .FNPSZ.O ü ڞ௨ͷϝϞϦΛࢀরͰ͖Δ        !"#$: &1,) ℎ+$$,- ./0/,: ℎ1,)
  12. %PDVNFOUNPEFMMJOH  จॻϨϕϧͷײ৘෼ྨλεΫ %BUBTFU  *.%# Ϋϥε  :FMQ Ϋϥε

    ஈ໨ͷ/4&ͰจϕΫτϧΛɼஈ໨ ͷ/4&-45.ͰจॻϕΫτϧΛ࡞Γɼ ࠷ޙʹTPGUNBYͰ෼ྨ͢Δ /4& /4&I   /4&   /4& /4&I   -45. 
  13. /FVSBMNBDIJOFUSBOTMBUJPO  %BUBTFU*84-5&OHMJTI(FSNBO &ODPEFS%FDPEFSϞσϧʹ/4&ΛదԠ /4&FOD -45.EFD  .-1 &OHMJTI (FSNBO

    5SBOTMBUJPO BUUFOUJPO /4&FOD /4&EFD  .-1 &OHMJTI (FSNBO 5SBOTMBUJPO BUUFOUJPO TIBSFE -45.FOD -45.EFD .-1 &OHMJTI (FSNBO 5SBOTMBUJPO BUUFOUJPO
  14. 

  15.