Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Hiroyuki Deguchi
October 03, 2023
Research
0
97

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
de9uch1
0
120
サブセット探索を用いた高速なkNNニューラル機械翻訳
de9uch1
0
54
20240226_AAMT-Japio
de9uch1
0
80
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
de9uch1
0
120
My Research Environmental Setup
de9uch1
0
220
Nearest Neighbor Machine Translation
de9uch1
0
190
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
de9uch1
0
230
paper reading - Tree Transformer
de9uch1
0
190
Dependency-Based Self-Attention for Transformer NMT (RANLP2019)
de9uch1
0
53

Other Decks in Research

See All in Research
文化が形作る音楽推薦の消費と、その逆
kuri8ive
0
160
渋谷Well-beingアンケート調査結果
shibuyasmartcityassociation
0
260
文書画像のデータ化における VLM活用 / Use of VLM in document image data conversion
sansan_randd
2
200
さんかくのテスト.pdf
sankaku0724
0
350
The Fellowship of Trust in AI
tomzimmermann
0
130
marukotenant01/tenant-20240916
marketing2024
0
520
システムから変える　自分と世界を変えるシステムチェンジの方法論 / Systems Change Approaches
dmattsun
3
870
テキストマイニングことはじめー基本的な考え方からメディアディスコース研究への応用まで
langstat
1
120
Weekly AI Agents News! 7月号 論文のアーカイブ
masatoto
1
230
Weekly AI Agents News! 9月号 論文のアーカイブ
masatoto
1
120
第79回 産総研人工知能セミナー 発表資料
agiats
2
160
KDD論文読み会2024: False Positive in A/B Tests
ryotoitoi
0
200

Featured

See All Featured
Site-Speed That Sticks
csswizardry
0
34
Become a Pro
speakerdeck
PRO
25
5k
Intergalactic Javascript Robots from Outer Space
tanoku
269
27k
Writing Fast Ruby
sferik
627
61k
Producing Creativity
orderedlist
PRO
341
39k
The Art of Programming - Codeland 2020
erikaheidi
52
13k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
Faster Mobile Websites
deanohume
305
30k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
93
16k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.3k
How STYLIGHT went responsive
nonsquared
95
5.2k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
109
49k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫