Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
160
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
260624_NLP-colloquium: Hubness
Avatar for Hiroyuki Deguchi de9uch1
0
110
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
800
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
360
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
170
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
200
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
220
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
340
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
310

Other Decks in Research

See All in Research
Φ-Sat-2のAutoEncoderによる情報圧縮系論文
Avatar for SatAI.challenge satai
4
860
はじまりの クエスチョンブック —余暇と豊かさにあふれた社会とは？
Avatar for 立ち止まれる社会 culturaltransition
PRO
0
570
オーストリア流 都市の公共交通サービス水準評価@公共交通オープンデータ最前線2026
Avatar for Traffic Brain trafficbrain
0
210
議論 学術ムーブメントを成功させるために何が必要なのだろうか
Avatar for Ryuichi Maruyama rmaruy
0
100
人間中心の意思決定支援AI
Avatar for Yukino Baba yukinobaba
PRO
7
3.5k
第64回CV・PRML勉強会　論文紹介：Linguistic Priors for Visual Decoupling: Towards Symmetric Vision-Brain Alignment
Avatar for Soki Katayama sokikatayama
0
140
(SIGQS17) Frasco-VS：フラグメントに基づく薬剤候補化合物選抜の量子アニーリングによる実現
Avatar for Keisuke Yanagisawa keisukeyanagisawa
PRO
0
170
Cross-Media Information Spaces and Architectures
Avatar for Beat Signer signer
PRO
0
320
LLM の Attention 機構まとめ — 数式・計算量・メモリ
Avatar for プワー puwaer
8
2.3k
AIを叩き台として、 「検証」から「共創」へと進化するリサーチ
Avatar for めーら/Miki mela_dayo
0
310
LLM Compute Infrastructure Overview
Avatar for KARAKURI Inc. karakurist
2
1.5k
第12回人と環境にやさしい交通をめざす全国大会／熊本都市圏「車1割削減、渋滞半減、公共交通2倍」をめざして
Avatar for Traffic Brain trafficbrain
0
140

Featured

See All Featured
Collaborative Software Design: How to facilitate domain modelling decisions
Avatar for Kenny Baas-Schwegler baasie
1
260
Done Done
Avatar for chrislema chrislema
186
16k
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
6
1.2k
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
72
40k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
56k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
Avatar for Tech SEO Connect techseoconnect
PRO
0
330
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
7k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
240
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
Avatar for Ines Montani inesmontani
PRO
3
3.6k
State of Search Keynote: SEO is Dead Long Live SEO
Avatar for Ryan Jones ryanjones
0
220
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
183
10k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫