Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Robust Distant Supervision Relation Extraction ...

Robust Distant Supervision Relation Extraction via Deep Reinforcement Learning

第10回最先端 NLP 勉強会にて発表した、下記の論文の紹介スライドです。

Qin et al. Robust Distant Supervision Relation Extraction via Deep Reinforcement Learning. ACL 2018.
https://aclanthology.info/papers/P18-1199/p18-1199

https://sites.google.com/view/snlp-jp/home/2018

Mamoru Komachi

August 03, 2018
Tweet

More Decks by Mamoru Komachi

Other Decks in Research

Transcript

  1. Robust Distant Supervision Relation Extraction via Deep Reinforcement Learning Pengda

    Qin, Weiran Xu, William Yang Wang ACL 2018 εϥΠυதͷਤද͸࿦จ͔ΒҾ༻͞Εͨ΋ͷ খொक <[email protected]> ୈ10ճ࠷ઌ୺NLPษڧձ@ཧݚ AIP ೔ຊڮΦϑΟε 2018/08/03
  2. ؒ઀ڭࢣ͋Γֶशʹ͓͚Δ false positive ͷ໰୊ | ਂ૚ֶशొ৔લͷؒ઀ڭࢣ͋Γֶश { ෳ਺ؔ܎Λߟྀ͠ͳ͍ (Minz et

    al., 2009) { ෳ਺ؔ܎Λಉ࣌ʹֶश (Hofmann et al., 2011; Surdeanu et al., 2012) →ΠϯελϯεΛ໌ࣔతʹෛྫʹ༻͍͍ͯͳ͍ | ਂ૚ֶशొ৔ޙͷؒ઀ڭࢣ͋Γֶश { ӅΕ૚Ͱؤ݈ʹֶश͢Δ͜ͱΛૂ͏͕ɺ1Ϋϥε ʹର͠1Πϯελϯε͔͠ਖ਼ྫʹ༻͍ͳ͍ (Zeng et al., 2014; 2015) { ࣄྫʹର͢ΔΞςϯγϣϯΛ༻͍ͯϊΠζʹର Ԡ (Lin et al., 2016; Ji et al., 2017) →ෛྫʢfalse positiveʣΛߟྀ͍ͯ͠ͳ͍ 4
  3. ঢ়ଶ: ཤྺΛ Markov Decision Process ͰϞσϧԽ | จ͸୯ޠ෼ࢄදݱͱҐஔ෼ࢄදݱʹม׵ (Zeng et

    al., 2014) | จ෼ࢄදݱ͸ݱࡏͷจϕΫτϧͱ͜Ε·Ͱʹऔ Γআ͔ΕͨจͷฏۉϕΫτϧͷ࿈݁ 8
  4. ؔ܎நग़࣮ݧ | σʔληοτ { New York Times ίʔύεʹ Freebase ͷؔ܎Λ

    λά෇͚ͨ͠σʔλ (Riedel et al., 2010)→52छ ྨͷؔ܎λά { Stanford NE recognizer Ͱ NE λά෇͚ | ࣮ݧઃఆ { ΤʔδΣϯτ͸ CNNɺ୯ޠ෼ࢄදݱ͸ pre-train ͞Εͨ΋ͷΛ࢖༻ { ؔ܎෼ྨث΋ CNNɺ !" #$%ͱ!& #$%͸ͦΕͧΕ2:1ʹ ͳΔΑ͏ʹௐ੔ʢ'" #$%ͱ'& #$% ͸ͦΕͧΕରԠ͢ Δ!" #$%ͱ!& #$% ͷ2ഒʹͳΔΑ͏ʹϥϯμϜαϯϓ Ϧϯάʣ 14
  5. ஌ࣝϕʔε (Freebase) ͱ σʔλ (NYT) ͱͷͣΕʢਤ5ʣ | ྔ͕গͳ͍ؔ܎͸ؒҧ͍ͬͯΔ͜ͱ͕ଟ͍ʢؔ ܎ ID

    ͸ද1ͷ֤ߦʹରԠʣ →͜Ε·Ͱͷख๏͸औΓআ͍͍ͯͳ͔ͬͨͷͰɺ ੑೳѱԽʹͭͳ͕͍ͬͯͨ 17
  6. ॴײ | ڧԽֶशͱ৘ใநग़͸૬ੑ͕͍͍ (Narasimhan et al., 2016) →ʢϒʔτετϥοϓతख๏Ͱ΋͋Γ͕ͪͳʣ ϊΠζΛऔΓআ͘͜ͱ͕Ͱ͖Δ →೚ҙͷख๏ͷલॲཧͱͯ͠΋࢖͑Δ

    | False positive ͷ໰୊͸ؒ઀ڭࢣ͋Γֶशʹͱͬ ͯ΍͸Γ໰୊ Ͱɺϋʔυͳ੍໿ͱͯ͠࢖͏ͷ͸ ةݥ (Nagesh et al., 2014) | ΠϯελϯεΛू߹ͱͯ͠ѻ͏Ξϓϩʔνͱ૊ Έ߹Θ͍ͤͨ | Ϋϥεؒͷؔ܎ΛϞσϧʹೖΕ͍ͨ 20
  7. ࢀߟจݙ σʔληοτ | Riedel et al.. Modeling Relations and Their

    Mentions without Labeled Set. ECML PKDD 2010. ຊݚڀͷϕʔεϥΠϯ | Zeng et al. Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks. EMNLP 2015. | Lin et al. Neural Relation Extraction with Selective Attention over Instances. ACL 2016. 23
  8. ࢀߟจݙ χϡʔϥϧҎલͷ৘ใநग़ʢؒ઀ڭࢣ͋Γʣ | Mintz et al. Distant Supervision for Relation

    Extraction without Labeled Data. ACL 2009. | Hoffmann et al. Knowledge-based Weak Supervision for Information Extraction of Overlapping Relations. ACL 2011. | Surdeanu et al. Multi-instance Multi-label Learning for Relation Extraction. EMNLP 2012. | Nagesh et al. Noisy Or-based Model for Relation Extraction using Distant Supervision. EMNLP 2014. 24
  9. ࢀߟจݙ χϡʔϥϧҎޙͷ৘ใநग़ | Zeng et al. Relation Classification via Convolutional

    Deep Neural Network. COLING 2014. | Narasimhan et al. Improving Information Extraction by Acquiring External Evidence with Reinforcement Learning. EMNLP 2016. | Ji et al. Distant Supervision for Relation Extraction with Sentence-level Attention and Entity Descriptions. AAAI 2017. 25