Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
160
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
770
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
350
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
170
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
200
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
220
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
340
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
310
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
290

Other Decks in Research

See All in Research
Data Visualization Tools in the Age of AI
Avatar for Fritz Lekschas flekschas
0
160
Unified Audio Source Separation (Defense Slides)
Avatar for Kohei Saijo kohei_1979
1
620
Using our influence and power for patient safety
Avatar for Helen Bevan helenbevan
0
360
「行ける・行けない表」による地域公共交通の性能評価
Avatar for 萬創社 bansousha
0
160
社内データ分析AIエージェントを できるだけ使いやすくする工夫
Avatar for Yusuke Fukasawa fufufukakaka
1
1.1k
SoftMatcha 2: 1兆語規模コーパスの超高速かつ柔らかい検索
Avatar for Masataka YONEDA e869120_sub
6
3.5k
(SIGQS17) Frasco-VS：フラグメントに基づく薬剤候補化合物選抜の量子アニーリングによる実現
Avatar for Keisuke Yanagisawa keisukeyanagisawa
PRO
0
120
Language and AI
Avatar for Ayana Niwa ayaniwa
0
120
討議：RACDA設立30周年記念都市交通フォーラム2026
Avatar for Traffic Brain trafficbrain
0
960
typst の使い方：言語学を研究する学生のために
Avatar for Tomoya gitomochang
0
460
人間中心の意思決定支援AI
Avatar for Yukino Baba yukinobaba
PRO
6
2.9k
明日から使える！研究効率化ツール入門
Avatar for Yusuke Matsui matsui_528
13
7.3k

Featured

See All Featured
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.5k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Crafting Experiences
Avatar for Bethany Jepchumba bethany
1
180
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.9k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
210
Facilitating Awesome Meetings
Avatar for Lara Hogan lara
57
7k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
250
1.3M
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
287
14k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2.3k
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
Avatar for Sara Fernández Carmona sarafernandez
0
210
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
Scaling GitHub
Avatar for Zach Holman holman
464
140k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫