Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
130

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
560
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
280
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
140
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
160
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
180
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
300
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
250
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
250

Other Decks in Research

See All in Research
20250725-bet-ai-day
Avatar for cipepser cipepser
2
420
カスタマーサクセスの視点からAWS Summitの展示を考える～製品開発で活用できる勘所～
Avatar for モブエンジニア（Masaki Okuda） masakiokuda
2
200
AlphaEarth Foundations: An embedding field model for accurate and efficient global mapping from sparse label data
Avatar for SatAI.challenge satai
1
220
AIスパコン「さくらONE」のLLM学習ベンチマークによる性能評価 / SAKURAONE LLM Training Benchmarking
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
0
360
RHO-1: Not All Tokens Are What You Need
Avatar for Sansan R&D sansan_randd
1
180
時系列データに対する解釈可能な 決定木クラスタリング
Avatar for MIKIO KUBO mickey_kubo
2
950
EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues
Avatar for SatAI.challenge satai
1
110
引力・斥力を制御可能なランダム部分集合の確率分布
Avatar for Takahiro Kawashima wasyro
0
240
ストレス計測方法の確立に向けたマルチモーダルデータの活用
Avatar for Yuriko Kikuchi yurikomium
0
1.5k
Agentic AIとMCPを利用したサービス作成入門
Avatar for MIKIO KUBO mickey_kubo
0
550
「どう育てるか」より「どう働きたいか」〜スクラムマスターの最初の一歩〜
Avatar for hirakawa hirakawa51
0
870
SSII2025 [TS3] 医工連携における画像情報学研究
Avatar for 画像センシングシンポジウム ssii
PRO
2
1.3k

Featured

See All Featured
Code Reviewing Like a Champion
Avatar for maltzj maltzj
525
40k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
96
6.2k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.8k
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
49
14k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.4k
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
56
13k
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
22k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
31
2.2k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
15
1.7k
Side Projects
Avatar for Sacha Greif sachag
455
43k
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
462
33k
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.1k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫