$30 off During Our Annual Pro Sale. View Details »

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
140

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
610
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
300
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
150
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
170
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
190
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
310
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
270
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
260

Other Decks in Research

See All in Research
ロボット学習における大規模検索技術の展開と応用
Avatar for Mai Nishimura denkiwakame
1
170
[RSJ25] Enhancing VLA Performance in Understanding and Executing Free-form Instructions via Visual Prompt-based Paraphrasing
Avatar for Semantic Machine Intelligence Lab., Keio Univ. keio_smilab
PRO
0
180
Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning
Avatar for SatAI.challenge satai
2
120
長期・短期メモリを活用したエージェントの個別最適化
Avatar for AITC - DENTSU SOKEN isidaitc
0
330
Pythonでジオを使い倒そう！ 〜それとFOSS4G Hiroshima 2026のご紹介を少し〜
Avatar for wata909 wata909
0
1.2k
VectorLLM: Human-like Extraction of Structured Building Contours via Multimodal LLMs
Avatar for SatAI.challenge satai
4
510
AIスパコン「さくらONE」のLLM学習ベンチマークによる性能評価 / SAKURAONE LLM Training Benchmarking
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
2
900
説明可能な機械学習と数理最適化
Avatar for kelicht kelicht
2
730
病院向け生成AIプロダクト開発の実践と課題
Avatar for Takashi Nishibayashi hagino3000
0
450
言語モデルの地図：確率分布と 情報幾何による類似性の可視化
Avatar for Hidetoshi Shimodaira shimosan
8
2.2k
When Learned Data Structures Meet Computer Vision
Avatar for Yusuke Matsui matsui_528
1
1.4k
論文紹介: ReGenesis: LLMs can Grow into Reasoning Generalists via Self-Improvement
Avatar for Hisao Katsumi hisaokatsumi
0
140

Featured

See All Featured
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
13k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.3k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
190
11k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
249
1.3M
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
186
22k
Fireside Chat
Avatar for paigeccino paigeccino
41
3.7k
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
56
14k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.6k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
Navigating Team Friction
Avatar for Lara Hogan lara
191
16k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫