Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
130

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
550
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
280
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
140
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
160
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
180
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
300
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
250
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
280
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
250

Other Decks in Research

See All in Research
Language Models Are Implicitly Continuous
Avatar for Sho Yokoi eumesy
PRO
0
230
2025年度人工知能学会全国大会チュートリアル講演「深層基盤モデルの数理」
Avatar for Taiji Suzuki taiji_suzuki
25
18k
集合間Bregmanダイバージェンスと置換不変NNによるその学習
Avatar for Takahiro Kawashima wasyro
0
140
cvpaper.challenge 10年の軌跡 / cvpaper.challenge a decade-long journey
Avatar for gatheluck gatheluck
3
310
SSII2025 [TS2] リモートセンシング画像処理の最前線
Avatar for 画像センシングシンポジウム ssii
PRO
7
3.1k
Submeter-level land cover mapping of Japan
Avatar for SatAI.challenge satai
3
290
Agentic AIとMCPを利用したサービス作成入門
Avatar for MIKIO KUBO mickey_kubo
0
540
20250624_熊本経済同友会6月例会講演
Avatar for Traffic Brain trafficbrain
1
610
Creation and environmental applications of 15-year daily inundation and vegetation maps for Siberia by integrating satellite and meteorological datasets
Avatar for SatAI.challenge satai
3
270
大規模な2値整数計画問題に対する 効率的な重み付き局所探索法
Avatar for MIKIO KUBO mickey_kubo
1
360
EarthSynth: Generating Informative Earth Observation with Diffusion Models
Avatar for SatAI.challenge satai
3
260
Vision and LanguageからのEmbodied AIとAI for Science
Avatar for Yoshitaka Ushiku yushiku
PRO
1
530

Featured

See All Featured
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
18
1.1k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
37
2.9k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
Writing Fast Ruby
Avatar for Erik Berlin sferik
628
62k
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
22k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.8k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
10
810
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
3
620
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1032
460k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
126
53k
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
49
14k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫