Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介: Similarity-Based Reconstruction Loss for ...
Search
Yumeto Inaoka
May 26, 2019
Research
1
170
文献紹介: Similarity-Based Reconstruction Loss for Meaning Representation
2019/05/28の文献紹介で発表
Yumeto Inaoka
May 26, 2019
Tweet
Share
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
120
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
160
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
120
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
120
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
89
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
210
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
270
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
180
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
170
Other Decks in Research
See All in Research
Weekly AI Agents News! 7月号 論文のアーカイブ
masatoto
1
190
論文読み会 SNLP2024 Instruction-tuned Language Models are Better Knowledge Learners. In: ACL 2024
s_mizuki_nlp
1
300
[第62回NLPコロキウム]「なりきり」を促すHCI設計:対話型接客ロボットの遠隔操作者へのリアルタイム変換音声フィードバックの適用
nami_ogawa
0
280
大規模言語モデルのバイアス
yukinobaba
PRO
4
600
最近のVisual Odometryと Depth Estimation
sgk
1
200
Introducing Research Units of Matsuo-Iwasawa Laboratory
matsuolab
0
270
3次元点群の分類における評価指標について
kentaitakura
0
180
Как стать 10x экспертом
ikurochkin
1
120
システムから変える 自分と世界を変えるシステムチェンジの方法論 / Systems Change Approaches
dmattsun
3
750
Weekly AI Agents News! 6月号 論文のアーカイブ
masatoto
1
160
大規模言語モデル (LLM) の技術と最新動向
ikuyamada
33
19k
Weekly AI Agents News! 7月号 プロダクト/ニュースのアーカイブ
masatoto
0
140
Featured
See All Featured
Designing Dashboards & Data Visualisations in Web Apps
destraynor
228
52k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
225
22k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
105
48k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
Navigating Team Friction
lara
183
14k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
92
16k
Writing Fast Ruby
sferik
625
60k
We Have a Design System, Now What?
morganepeng
49
7.1k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
158
15k
Docker and Python
trallard
40
3k
Rails Girls Zürich Keynote
gr2m
93
13k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
355
29k
Transcript
Similarity-Based Reconstruction Loss for Meaning Representation
Literature 2
Abstract • • • 3
Introduction • • 4
Related Work • • • • 5
Related Work • • 6
Auto-Encoder •ℒ , • • • • 7
Weighted similarity loss •ℒ = − σ =1 sim ,
• • • : • • sim() • 8
Weighted cross-entropy loss •ℒ = − σ =1 sim ,
log( ) • • 9
Soft label loss •ℒ = − σ =1 ∗log •
∗ = ൞ sim , σ =1 sim(,) , ∈ top N 0 , ∉ top N • • 10
True-label encoding 11
Tasks & Datasets • • • 12
Results 13
Results 14
Additional Experiments • • 15
Results • • 16
Results 17
Results 18
Results 19
Discussion • • 20
Conclusion • • • • 21