Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介: Similarity-Based Reconstruction Loss for ...
Search
Yumeto Inaoka
May 26, 2019
Research
1
220
文献紹介: Similarity-Based Reconstruction Loss for Meaning Representation
2019/05/28の文献紹介で発表
Yumeto Inaoka
May 26, 2019
Tweet
Share
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
180
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
230
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
160
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
170
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
150
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
270
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
340
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
230
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
220
Other Decks in Research
See All in Research
Pix2Poly: A Sequence Prediction Method for End-to-end Polygonal Building Footprint Extraction from Remote Sensing Imagery
satai
3
530
ノンパラメトリック分布表現を用いた位置尤度場周辺化によるRTK-GNSSの整数アンビギュイティ推定
aoki_nosse
0
340
Adaptive Experimental Design for Efficient Average Treatment Effect Estimation and Treatment Choice
masakat0
0
150
Looking for Escorts in Sydney?
lunsophia
1
130
MIRU2025 チュートリアル講演「ロボット基盤モデルの最前線」
haraduka
8
2k
カスタマーサクセスの視点からAWS Summitの展示を考える~製品開発で活用できる勘所~
masakiokuda
2
150
【輪講資料】Moshi: a speech-text foundation model for real-time dialogue
hpprc
3
520
なめらかなシステムと運用維持の終わらぬ未来 / dicomo2025_coherently_fittable_system
monochromegane
0
1.3k
EOGS: Gaussian Splatting for Efficient Satellite Image Photogrammetry
satai
4
350
SSII2025 [TS1] 光学・物理原理に基づく深層画像生成
ssii
PRO
4
4k
Computational OT #1 - Monge and Kantorovitch
gpeyre
0
200
データサイエンティストの就労意識~2015→2024 一般(個人)会員アンケートより
datascientistsociety
PRO
0
750
Featured
See All Featured
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
29
9.6k
Automating Front-end Workflow
addyosmani
1370
200k
Faster Mobile Websites
deanohume
308
31k
Gamification - CAS2011
davidbonilla
81
5.4k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
8
850
Music & Morning Musume
bryan
46
6.7k
Docker and Python
trallard
45
3.5k
Writing Fast Ruby
sferik
628
62k
How to Think Like a Performance Engineer
csswizardry
25
1.8k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
357
30k
How STYLIGHT went responsive
nonsquared
100
5.7k
Transcript
Similarity-Based Reconstruction Loss for Meaning Representation
Literature 2
Abstract • • • 3
Introduction • • 4
Related Work • • • • 5
Related Work • • 6
Auto-Encoder •ℒ , • • • • 7
Weighted similarity loss •ℒ = − σ =1 sim ,
• • • : • • sim() • 8
Weighted cross-entropy loss •ℒ = − σ =1 sim ,
log( ) • • 9
Soft label loss •ℒ = − σ =1 ∗log •
∗ = ൞ sim , σ =1 sim(,) , ∈ top N 0 , ∉ top N • • 10
True-label encoding 11
Tasks & Datasets • • • 12
Results 13
Results 14
Additional Experiments • • 15
Results • • 16
Results 17
Results 18
Results 19
Discussion • • 20
Conclusion • • • • 21