Upgrade to Pro — share decks privately, control downloads, hide ads and more …

【輪講資料】How much can language models memorize?

Avatar for Yano Yano
August 19, 2026
0
0

【輪講資料】How much can language models memorize?

WIP

Avatar for Yano

Yano

August 19, 2026

More Decks by Yano

See All by Yano
【輪講資料】Decoding Dense Embeddings: Sparse Autoencoders for Interpreting and Discretizing Dense Retrieval
Avatar for Yano yano0
0
150
【輪講資料】Length-Induced Embedding Collapse in PLM-based Models
Avatar for Yano yano0
0
180
【輪講資料】How Do Large Language Models Acquire Factual Knowledge During Pretraining?
Avatar for Yano yano0
0
340
NLP2025参加報告
Avatar for Yano yano0
0
730
【輪講資料】ReAct: Synergizing Reasoning and Acting in Language Models / Tree of Thoughts: Deliberate Problem Solving with Large Language Models
Avatar for Yano yano0
0
290
【輪講資料】SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval
Avatar for Yano yano0
2
410
【輪講資料】From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual Transformers
Avatar for Yano yano0
0
160
【輪講資料】Zero-shot Cross-lingual Semantic Parsing
Avatar for Yano yano0
0
190

Featured

See All Featured
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
440
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
75
12k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
10k
Have SEOs Ruined the Internet? - User Awareness of SEO in 2025
Avatar for Akash Hashmi akashhashmi
0
430
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
Avatar for UX Y'all uxyall
1
2.4k
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
Avatar for Mfonobong Umondia mfonobong
2
490
Fireside Chat
Avatar for paigeccino paigeccino
42
4k
Odyssey Design
Avatar for Ryan Kendrick rkendrick25
PRO
2
770
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k
It's Worth the Effort
Avatar for 3n 3n
188
29k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
85
9.6k
Building the Perfect Custom Keyboard
Avatar for Naoto Takai takai
2
840

Transcript

  1. How much can language models memorize? John Xavier Morris, Chawin

    Sitawarin, Chuan Guo, Narine Kokhlikyan, G. Edward Suh, Alexander M Rush, Kamalika Chaudhuri, Saeed Mahloujifar 笹野研究室 D2 矢野千紘