Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Symmetry in language statistics shapes the geom...

Avatar for Sho Yokoi Sho Yokoi PRO
August 13, 2026
Research
12
0

Symmetry in language statistics shapes the geometry of model representations

第18回最先端NLP勉強会
https://sites.google.com/view/snlp-jp/home/2026

Avatar for Sho Yokoi

Sho Yokoi PRO

August 13, 2026

More Decks by Sho Yokoi

See All by Sho Yokoi
言語モデルから言語について語る際に押さえておきたいこと
Avatar for Sho Yokoi eumesy
PRO
7
2.5k
Language Models Are Implicitly Continuous
Avatar for Sho Yokoi eumesy
PRO
0
540
言語モデルの内部機序：解析と解釈
Avatar for Sho Yokoi eumesy
PRO
94
32k
コーパスを丸呑みしたモデルから言語の何がわかるか
Avatar for Sho Yokoi eumesy
PRO
12
4.9k
Zipf 白色化：タイプとトークンの区別がもたらす良質な埋め込み空間と損失関数
Avatar for Sho Yokoi eumesy
PRO
10
2.7k
Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solve
Avatar for Sho Yokoi eumesy
PRO
7
2.1k
「確率的なオウム」にできること、またそれがなぜできるのかについて
Avatar for Sho Yokoi eumesy
PRO
8
4.7k
A Theory of Emergent In-Context Learning as Implicit Structure Induction
Avatar for Sho Yokoi eumesy
PRO
5
1.8k
ChatGPT と自然言語処理 / 言語の意味の計算と最適輸送
Avatar for Sho Yokoi eumesy
PRO
24
19k

Other Decks in Research

See All in Research
Research Engineerという仕事 / Research Engineering: Bridging Research and Business
Avatar for chck chck
1
250
某助成金プロジェクト採択に向けて企業研究所のアウトリーチ専任者がやったこと
Avatar for afroscript afroscript
0
160
SAKURAONE: An Open Ethernet-based AI HPC System And Its Observed Workload Dynamics in a Single-Tenant LLM Development Environment
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
1
520
National high-resolution cropland classification of Japan with agricultural census information and multi-temporal multi-modality datasets
Avatar for SatAI.challenge satai
3
430
東京大学工学部計数工学科、計数工学特別講義の説明資料
Avatar for KIKUCHI Shunsuke kikuzo
0
600
[IR Reading 2026春 論文紹介] LLM-based Listwise Reranking under the Effect of Positional Bias (ECIR 2026) /IR-Reading-2026-Spring
Avatar for Kohei Shinden koheishinden
PRO
0
310
【中間報告】国会議員の立法・政策実務を支える環境を巡る現状と課題
Avatar for 株式会社PoliPoli/PoliPoli.Inc polipoli
0
430
HackSick vol.7 LT資料【LLMアーキテクチャ入門・事前学習時の躓き所解説】 スパースなAttention・状態空間モデル
Avatar for Rikka Botan rikkabotan7
0
150
【ローカルAIに向き合う展示会vol.2】液体時間定数型モジュールを用いた オリジナルの双方向エンコーダーモデルNexteraBERT 推論速度向上検討並びにダウンストリーム評価
Avatar for Rikka Botan rikkabotan7
0
160
コーディングエージェントとABNを再考
Avatar for Hironobu Fujiyoshi hf149
2
830
ros2-perf-multihost: 分散システムにおける客観的なアーキテクチャ評価フレームワーク
Avatar for takasehideki takasehideki
0
190
COMETAを用いたデータ民主化運動の歴史
Avatar for Kazuya Mori sazimai
0
210

Featured

See All Featured
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
Avatar for Mfonobong Umondia mfonobong
2
480
Claude Code のすすめ
Avatar for schroneko schroneko
67
230k
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
640
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
Avatar for David Carrasco davidcarrasco
3
200
The browser strikes back
Avatar for Jono Alderson jonoalderson
0
1.5k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
170
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.9k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
123
22k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
141
7.6k
Navigating Weather and Climate Data
Avatar for Ryan Abernathey rabernat
0
470
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
141
35k

Transcript

  1. Symmetry in language statistics shapes the geometry of model representations

    Dhruva Karkada, Daniel J. Korchinski, Andres Nava, Matthieu Wyart, Yasaman Bahri (UC Berkeley, EPFL, Johns Hopkins, Google DeepMind) ICML 2026, Spotlight https://arxiv.org/abs/2602.15029 読む⼈︓横井 祥 国語研・統数研・理研・JST創発・ . 2026-**-**, 第18回最先端NLP勉強会 ※ とくに注釈がない限り，図や数式は， 論⽂に掲載されているものを紹介者が適宜加筆・修正したものです