$30 off During Our Annual Pro Sale. View Details »

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
140

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
610
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
300
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
150
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
170
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
190
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
310
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
270
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
260

Other Decks in Research

See All in Research
Stealing LUKS Keys via TPM and UUID Spoofing in 10 Minutes - BSides 2025
Avatar for AnyKeyShik anykeyshik
0
170
スキマバイトサービスにおける現場起点でのデザインアプローチ
Avatar for 眞行寺由郎 yoshioshingyouji
0
270
一人称視点映像解析の最先端（MIRU2025 チュートリアル）
Avatar for Takuma Yagi takumayagi
6
4.4k
機械学習と数理最適化の融合 (MOAI) による革新
Avatar for MIKIO KUBO mickey_kubo
1
430
離散凸解析に基づく予測付き離散最適化手法 (IBIS '25)
Avatar for Taihei OKI taihei_oki
PRO
1
620
AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label data
Avatar for SatAI.challenge satai
3
540
[Devfest Incheon 2025] 모두를 위한 친절한 언어모델(LLM) 학습 가이드
Avatar for Beomi beomi
2
1k
「リアル×スキマ時間」​を活用したUXリサーチ ​〜新規事業を前に進めるためのUXリサーチプロセスの設計〜
Avatar for PERSOL CAREER Dev | techtekt techtekt
PRO
0
180
ロボット学習における大規模検索技術の展開と応用
Avatar for Mai Nishimura denkiwakame
1
170
自動運転におけるデータ駆動型AIに対する安全性の考え方 / Safety Engineering for Data-Driven AI in Autonomous Driving Systems
Avatar for Fuyuki Ishikawa / 石川 冬樹 ishikawafyu
0
110
その推薦システムの評価指標、ユーザーの感覚とズレてるかも
Avatar for kuri8ive kuri8ive
1
280
長期・短期メモリを活用したエージェントの個別最適化
Avatar for AITC - DENTSU SOKEN isidaitc
0
330

Featured

See All Featured
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.5k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
698
190k
Build your cross-platform service in a week with App Engine
Avatar for Jose L jlugia
234
18k
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
34
9k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
54
7.9k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.3k
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.3k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
671
58k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
190
11k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
7.8k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫