Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
180
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20260427 Ehime DS Seminar: MBR-CBDT Decoding
Avatar for Hiroyuki Deguchi de9uch1
1
80
20260624 NLP colloquium: 単一のhubテキストがCLIPを壊す：hubnessによる埋め込みの脆弱性特定
Avatar for Hiroyuki Deguchi de9uch1
2
300
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
860
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
390
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
190
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
210
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
250
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
350
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
300

Other Decks in Research

See All in Research
Adapter les bergeries aux fortes chaleurs
Avatar for Idele institutdelelevage
PRO
0
150
A new deal for disabled people
Avatar for Resolution Foundation resolutionfoundation
0
290
視覚若手の会LENSって何？？
Avatar for 小島瑞貴 mickey_0226
0
360
Pretrain Where? Investigating How Pretraining Data Diversity Impacts Geospatial Foundation Model Performance
Avatar for SatAI.challenge satai
3
180
Prithvi-EO-2.0
Avatar for SatAI.challenge satai
3
110
GLIM とMegaParticles：正規分布近似の限界とタイトカップリング＆パーティクルフィルタの進展 / GLIM and MegaParticles : Progress of the distribution representation in SLAM
Avatar for koide3 koide3
0
970
ICAITD 2026 Oral Presentation
Avatar for Rikka Botan rikkabotan7
0
120
フィジカルAIの社会実装に向けて -AIエージェントからAgentic Roboticsへ-
Avatar for Hironobu Fujiyoshi hf149
1
2.3k
Bilan travail en élevage : première restitution des enquêtes 2025-2026
Avatar for Idele institutdelelevage
PRO
0
110
Language and AI
Avatar for Ayana Niwa ayaniwa
0
330
Vector Map as Language: Toward Unified Remote Sensing Vector Mapping
Avatar for SatAI.challenge satai
3
320
[SNLP2026] Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
Avatar for 池田航 wataruuuuu
0
350

Featured

See All Featured
Marketing Yourself as an Engineer | Alaka | Gurzu
Avatar for Gurzu gurzu
0
330
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
850
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
10k
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
410
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.9k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
55
8.4k
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon Słowik szymonslowik
1
480
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.9k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
529
40k
[SF Ruby Conf 2025] Rails X
Avatar for Vladimir Dementyev palkan
3
1.5k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
56
3.5k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫