Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
130

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
590
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
290
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
140
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
160
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
180
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
300
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
260
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
260

Other Decks in Research

See All in Research
[論文紹介] Intuitive Fine-Tuning
Avatar for Ryokan RI ryou0634
0
130
J-RAGBench: 日本語RAGにおける Generator評価ベンチマークの構築
Avatar for Koki Itai koki_itai
0
870
論文紹介：Not All Tokens Are What You Need for Pretraining
Avatar for Kosuke Nishida kosuken
0
200
Sat2City:3D City Generation from A Single Satellite Image with Cascaded Latent Diffusion
Avatar for SatAI.challenge satai
3
200
論文紹介: ReGenesis: LLMs can Grow into Reasoning Generalists via Self-Improvement
Avatar for Hisao Katsumi hisaokatsumi
0
110
snlp2025_prevent_llm_spikes
Avatar for Sho Takase takase
0
390
超高速データサイエンス
Avatar for Yusuke Matsui matsui_528
1
170
国際論文を出そう！ICRA / IROS / RA-L への論文投稿の心構えとノウハウ / RSJ2025 Luncheon Seminar
Avatar for koide3 koide3
10
5.8k
一人称視点映像解析の最先端（MIRU2025 チュートリアル）
Avatar for Takuma Yagi takumayagi
6
4k
ip71_contraflow_reconfiguration
Avatar for SatokiMasuda stkmsd
0
110
日本語新聞記事を用いた大規模言語モデルの暗記定量化 / LLMC2025
Avatar for Shotaro Ishihara upura
0
300
LLM-jp-3 and beyond: Training Large Language Models
Avatar for Yusuke Oda odashi
1
540

Featured

See All Featured
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.1k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
514
110k
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
60
9.6k
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.4k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
29
5.6k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
12k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
650
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.6k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
370
20k
Side Projects
Avatar for Sacha Greif sachag
455
43k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫