Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
150

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
700
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
320
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
160
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
170
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
200
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
330
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
300
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
270

Other Decks in Research

See All in Research
From Data Meshes to Data Spaces
Avatar for Posedio posedio
PRO
0
370
COFFEE-Japan PROJECT Impact Report（海ノ向こうコーヒー）
Avatar for 坂ノ途中 ontheslope
0
1k
LLMアプリケーションの透明性について
Avatar for Yusuke Fukasawa fufufukakaka
0
190
SREのためのテレメトリー技術の探究 / Telemetry for SRE
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
13
3.3k
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
260
2026年1月の生成AI領域の重要リリース＆トピック解説
Avatar for KAJI | 梶谷健人 kajikent
0
830
製造業主導型経済からサービス経済化における中間層形成メカニズムのパラダイムシフト
Avatar for Masatake Yamoto yamotty
0
520
2026 東京科学大 情報通信系 研究室紹介 (大岡山)
Avatar for Tokyo Tech ICT Dept. icttitech
0
840
LLM-Assisted Semantic Guidance for Sparsely Annotated Remote Sensing Object Detection
Avatar for SatAI.challenge satai
3
610
ForestCast: Forecasting Deforestation Risk at Scale with Deep Learning
Avatar for SatAI.challenge satai
3
540
[SITA2025 Workshop] 空中計算による高速・低遅延な分散回帰分析
Avatar for Koya SATO k_sato
0
130
衛星×エッジAI勉強会 衛星上におけるAI処理制約とそ取組について
Avatar for SatAI.challenge satai
4
330

Featured

See All Featured
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
1.6k
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
640
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
249
1.3M
Ten Tips & Tricks for a 🌱 transition
Avatar for Manu Carrasco Molina stuffmc
0
88
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
260
Google's AI Overviews - The New Search
Avatar for Barry Adams badams
0
930
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.5k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.6k
The Spectacular Lies of Maps
Avatar for Per Axbom axbom
PRO
1
620
KATA
Avatar for Megan Lloyd mclloyd
PRO
35
15k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
432
66k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫