Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
140

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
620
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
300
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
150
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
170
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
190
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
310
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
270
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
290
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
260

Other Decks in Research

See All in Research
スキマバイトサービスにおける現場起点でのデザインアプローチ
Avatar for 眞行寺由郎 yoshioshingyouji
0
270
LLM-jp-3 and beyond: Training Large Language Models
Avatar for Yusuke Oda odashi
1
740
視覚から身体性を持つAIへ: 巧緻な動作の3次元理解
Avatar for Take Ohkawa tkhkaeio
0
130
AIスーパーコンピュータにおけるLLM学習処理性能の計測と可観測性 / AI Supercomputer LLM Benchmarking and Observability
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
1
420
AIグラフィックデザインの進化：断片から統合（One Piece）へ / From Fragment to One Piece: A Survey on AI-Driven Graphic Design
Avatar for Shunsuke KITADA shunk031
0
580
長期・短期メモリを活用したエージェントの個別最適化
Avatar for AITC - DENTSU SOKEN isidaitc
0
370
An Open and Reproducible Deep Research Agent for Long-Form Question Answering
Avatar for Ikuya Yamada ikuyamada
0
160
"主観で終わらせない"定性データ活用 ― プロダクトディスカバリーを加速させるインサイトマネジメント / Utilizing qualitative data that "doesn't end with subjectivity" - Insight management that accelerates product discovery
Avatar for 株式会社カミナシ kaminashi
15
18k
Multi-Agent Large Language Models for Code Intelligence: Opportunities, Challenges, and Research Directions
Avatar for Fatemeh Fard (UBC) fatemeh_fard
0
120
単施設でできる臨床研究の考え方
Avatar for Shuntaro Sato shuntaros
0
3.4k
超高速データサイエンス
Avatar for Yusuke Matsui matsui_528
1
330
財務諸表監査のための逐次検定
Avatar for MasaKat0 masakat0
0
220

Featured

See All Featured
Odyssey Design
Avatar for Ryan Kendrick rkendrick25
PRO
0
450
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.2k
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
180
It's Worth the Effort
Avatar for 3n 3n
187
29k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
Avatar for Tech SEO Connect techseoconnect
PRO
0
75
How To Speak Unicorn (iThemes Webinar)
Avatar for Michelle Schulp Hunt marktimemedia
1
350
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
19k
brightonSEO & MeasureFest 2025 - Christian Goodrich - Winning strategies for Black Friday CRO & PPC
Avatar for Christian Goodrich cargoodrich
2
73
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
122
21k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
9.8k
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
0
30k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫