Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
120

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
420
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
240
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
110
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
140
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
160
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
280
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
230
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
230

Other Decks in Research

See All in Research
SSII2025 [TS2] リモートセンシング画像処理の最前線
Avatar for 画像センシングシンポジウム ssii
PRO
6
2.1k
90 分で学ぶ P 対 NP 問題
Avatar for E869120 e869120
16
7.2k
研究テーマのデザインと研究遂行の方法論
Avatar for Hisashi Ishihara hisashiishihara
5
1.2k
公立高校入試等に対する受入保留アルゴリズム（DA）導入の提言
Avatar for Shunya Noda shunyanoda
0
4.6k
Computational OT #1 - Monge and Kantorovitch
Avatar for Gabriel Peyré gpeyre
0
150
Batch Processing Algorithm for Elliptic Curve Operations and Its AVX-512 Implementation
Avatar for herumi herumi
0
170
作業記憶の発達的特性が言語獲得の臨界期を形成する（NLP2025）
Avatar for Masato Mita chemical_tree
2
550
在庫管理のための機械学習と最適化の融合
Avatar for MIKIO KUBO mickey_kubo
3
1k
Sosiaalisen median katsaus 03/2025 + tekoäly
Avatar for Harto Pönkä hponka
0
1.1k
実行環境に中立なWebAssemblyライブマイグレーション機構/techtalk-2025spring
Avatar for Yuki Nakata chikuwait chikuwait
0
190
数理最適化と機械学習の融合
Avatar for MIKIO KUBO mickey_kubo
15
8.2k
チャッドローン：LLMによる画像認識を用いた自律型ドローンシステムの開発と実験 / ec75-morisaki
Avatar for yumulab yumulab
1
320

Featured

See All Featured
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
430
65k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
PRO
19
1.2k
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
48
5.4k
Scaling GitHub
Avatar for Zach Holman holman
459
140k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
407
66k
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
46
14k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
35
2.7k
Making Projects Easy
Avatar for Brett Harned brettharned
116
6.2k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
126
17k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
71
4.8k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫