Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
170
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
260624_NLP-colloquium: Hubness
Avatar for Hiroyuki Deguchi de9uch1
1
170
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
810
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
370
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
180
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
200
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
230
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
350
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
320

Other Decks in Research

See All in Research
Using our influence and power for patient safety
Avatar for Helen Bevan helenbevan
0
390
敵対生成プロンプト同時探索による内省型プロンプト最適化
Avatar for Kotaro Inoue kinoue_smarthr
0
360
人間中心の意思決定支援AI
Avatar for Yukino Baba yukinobaba
PRO
7
3.8k
National high-resolution cropland classification of Japan with agricultural census information and multi-temporal multi-modality datasets
Avatar for SatAI.challenge satai
3
420
進学校の生徒にはア行の苗字が多いのか
Avatar for Takashi Ozeki ozekinote
0
520
技術は予測を代補する：スティグレールの三次的記憶論と予測処理パラダイムの交差
Avatar for Kanta Tanishima ktanishima
0
120
SoftMatcha 2: 1兆語規模コーパスの超高速かつ柔らかい検索
Avatar for Masataka YONEDA e869120_sub
7
3.7k
Dual Quadric表現を用いた動的物体追跡とRGB-D・IMU制約の密結合によるオドメトリ推定
Avatar for Toyozo Shimada nanoshimarobot
0
500
セマンティック通信勉強会 6Gに向けたデバイス間効率的な通信の技術紹介・課題・今後展望
Avatar for SatAI.challenge satai
3
270
nlp2026 In-Context Learningに基づく経路案内のための地理的知識の活用方法に関する検討
Avatar for Takashi INUI takashiinui
0
120
大規模言語モデルは誰を覚えているか / Who Do Large Language Models Memorize?
Avatar for Shotaro Ishihara upura
0
120
Sequences of Logits Reveal the Low Rank Structure of Language Models
Avatar for SansanTech sansantech
PRO
1
310

Featured

See All Featured
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
63k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
7k
Un-Boring Meetings
Avatar for Sebastian Deterding codingconduct
0
380
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
232
55k
SERP Conf. Vienna - Web Accessibility: Optimizing for Inclusivity and SEO
Avatar for Sara Fernández Carmona sarafernandez
2
1.5k
We Analyzed 250 Million AI Search Results: Here's What I Found
Avatar for Josh Blyskal joshbly
1
1.8k
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
400
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.4k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
BBQ
Avatar for Matthew Crist matthewcrist
89
10k
Fireside Chat
Avatar for paigeccino paigeccino
42
4k
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
230

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫