Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
120

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
490
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
260
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
120
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
150
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
170
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
290
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
240
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
240

Other Decks in Research

See All in Research
Large Language Model Agent: A Survey on Methodology, Applications and Challenges
Avatar for Shunsuke KITADA shunk031
12
8.5k
When Submarine Cables Go Dark: Examining the Web Services Resilience Amid Global Internet Disruptions
Avatar for Irvin Chen irvin
0
230
Adaptive fusion of multi-modal remote sensing data for optimal sub-field crop yield prediction
Avatar for SatAI.challenge satai
3
220
Weekly AI Agents News!
Avatar for masatoto masatoto
33
68k
利用シーンを意識した推薦システム 〜SpotifyとAmazonの事例から〜
Avatar for kuri8ive kuri8ive
1
210
最適化と機械学習による問題解決
Avatar for MIKIO KUBO mickey_kubo
0
140
Combinatorial Search with Generators
Avatar for Keisuke Okumura | 奥村圭祐 kei18
0
360
データｘデジタルマップで拓く
ミラノ発・地域共創最前線
Avatar for mapconcierge mapconcierge4agu
0
190
カスタマーサクセスの視点からAWS Summitの展示を考える～製品開発で活用できる勘所～
Avatar for モブエンジニア masakiokuda
2
110
2025/7/5 応用音響研究会招待講演＠北海道大学
Avatar for Takuma OKAMOTO takuma_okamoto
1
100
SkySense : A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery
Avatar for SatAI.challenge satai
3
250
MGDSS：慣性式モーションキャプチャを用いたジェスチャによるドローンの操作 / ec75-yamauchi
Avatar for yumulab yumulab
0
260

Featured

See All Featured
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
299
21k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
6
310
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
7
740
Side Projects
Avatar for Sacha Greif sachag
455
42k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
207
24k
Making Projects Easy
Avatar for Brett Harned brettharned
116
6.3k
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
71
11k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
161
15k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
45
7.5k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
173
14k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
90
590k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
336
57k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫