Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Rol...

Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
0
120

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
0
370
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
220
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
100
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
130
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
160
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
270
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
230
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
270
paper reading - Tree Transformer
Avatar for Hiroyuki Deguchi de9uch1
0
230

Other Decks in Research

See All in Research
データサイエンティストの採用に関するアンケート
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
610
DPUを用いたマルチタスクDNN表情認識システムのFPGA実装
Avatar for Takuto ANDO takuto_andtt
0
150
[輪講] Transformer Layers as Painters
Avatar for Naoki Kato nk35jk
4
760
RapidPen: AIエージェントによるペネトレーションテスト 初期侵入全自動化の研究
Avatar for Sho Nakatani laysakura
0
410
Adaptive fusion of multi-modal remote sensing data for optimal sub-field crop yield prediction
Avatar for SatAI.challenge satai
3
130
Vision Language Modelと完全自動運転AIの最新動向
Avatar for Tsubasa Takahashi tsubasashi
2
420
Satellite Sunroof: High-res Digital Surface Models and Roof Segmentation for Global Solar Mapping
Avatar for SatAI.challenge satai
3
290
20250502_ABEJA_論文読み会_スライド
Avatar for Tomoki Fujihara flatton
0
120
BtoB プロダクトにおけるインサイトマネジメントの必要性 現場ドリブンなカミナシがインサイトマネジメントに取り組むワケ / Why field-driven Kaminashi is working on insight management
Avatar for 株式会社カミナシ kaminashi
1
390
한국어 오픈소스 거대 언어 모델의 가능성: 새로운 시대의 언어 이해와 생성
Avatar for Jeongkyu Shin inureyes
PRO
0
310
VAGeo: View-specific Attention for Cross-View Object Geo-Localization
Avatar for SatAI.challenge satai
3
220
知識強化言語モデルLUKE @ LUKEミートアップ
Avatar for Ikuya Yamada ikuyamada
0
400

Featured

See All Featured
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
8
690
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
126
17k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
693
190k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
45
9.5k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.3k
Faster Mobile Websites
Avatar for Dean Hume deanohume
306
31k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
298
20k
Writing Fast Ruby
Avatar for Erik Berlin sferik
628
61k
Done Done
Avatar for chrislema chrislema
184
16k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
29
920
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
276
23k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
158
23k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫