$30 off During Our Annual Pro Sale. View Details »

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Hiroyuki Deguchi
October 03, 2023
Research
0
54

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
de9uch1
0
76
My Research Environmental Setup
de9uch1
0
160
Nearest Neighbor Machine Translation
de9uch1
0
150
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
de9uch1
0
190
paper reading - Tree Transformer
de9uch1
0
130
Dependency-Based Self-Attention for Transformer NMT (RANLP2019)
de9uch1
0
33

Other Decks in Research

See All in Research
IRではデータ収集がどのように実施・認識されてきたのか
gmoriki
0
170
The Dark Playground of CICD: Attack Delivery by GitHub Actions
nttcom
0
240
レガシーなサービス・組織でリサーチの土壌を耕す
uepon73
3
1.1k
RecSys2023論文読み会 - Augmented Negative Sampling for Collaborative Filtering
yudai00
1
220
行動変容 自分と世界を変える技術 / Behavior change techniques
dmattsun
28
16k
Apache Tapestryの 注意すべき特殊な仕様
isayan
0
310
Google Cloud Next’23「Title：出店ブースで10社以上におすすめ機能を質問してきた」
yasumuusan
0
390
V&V of Systems Engineering Models and Modeling Languages
ftsrg
0
180
阪神タイガース優勝のひみつ - Pythonでシュッと調べた件 / SABRmetrics for Python
shinyorke
1
280
SNLP2023: When and Why Vision-Language Models Behave like Bags-Of-Words, and What to Do About It?
muraoka7
0
150
[CVPR 2023 論文紹介] Unifying Vision, Text, and Layout for Universal Document Processing / kanto-cv-59-udop
shimacos
3
540
Schrödinger Bridge問題に基づく拡散生成モデル学習
takeshi_koshizuka
0
220

Featured

See All Featured
Facilitating Awesome Meetings
lara
37
5.2k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
52
19k
Art Directing for the Web. Five minutes with CSS Template Areas
malarkey
197
11k
Making Projects Easy
brettharned
105
5.2k
Streamline your AJAX requests with AmplifyJS and jQuery
dougneiner
130
9.8k
Rebuilding a faster, lazier Slack
samanthasiow
71
7.9k
Done Done
chrislema
178
15k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
6
7.3k
5 minutes of I Can Smell Your CMS
philhawksworth
199
19k
The Web Native Designer (August 2011)
paulrobertlloyd
78
2.7k
Build The Right Thing And Hit Your Dates
maggiecrowley
23
1.7k
Docker and Python
trallard
32
2.4k

Transcript

  1. View Slide

  2. ◼ [1]
    ◼
    ◼
    ◼
    [1] PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

    View Slide

  3. [1]
    ◼
    ◼
    ⚫
    ⚫
    ⚫
    ⚫
    ◼
    ◼
    [1] PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

    View Slide

  4. ◼
    ⚫
    ⚫
    ◼
    ⚫
    ⚫
    ▶
    ▶

    View Slide

  5. ◼
    ⚫
    ⚫ [2]
    ⚫ [2]
    ◼
    ⚫
    ⚫
    [2] Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

    View Slide

  6. ◼
    ⚫
    ⚫

    View Slide

  7. ◼
    ⚫
    ◼ ◼

    View Slide

  8. ◼
    ◼
    ◼

    View Slide

  9. ◼
    ⚫
    ▶
    ▶
    ⚫
    ⚫
    ◼
    ⚫
    ▶

    View Slide

  10. ◼
    ⚫
    ⚫
    ⚫
    ▶
    ▶
    ▶

    View Slide

  11. ◼
    ⚫
    ⚫
    ▶
    ▶

    View Slide

  12. ◼
    ⚫
    ▶
    ▶
    ◼
    ⚫
    ⚫
    ▶
    ⚫

    View Slide