Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Searching for Needles in a Haystack: On the Rol...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Hiroyuki Deguchi Hiroyuki Deguchi
October 03, 2023
Research
180
0

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Avatar for Hiroyuki Deguchi

Hiroyuki Deguchi

October 03, 2023

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
20260427 Ehime DS Seminar: MBR-CBDT Decoding
Avatar for Hiroyuki Deguchi de9uch1
1
53
20260624 NLP colloquium: 単一のhubテキストがCLIPを壊す：hubnessによる埋め込みの脆弱性特定
Avatar for Hiroyuki Deguchi de9uch1
2
280
20250226 NLP colloquium: "SoftMatcha: 10億単語規模コーパス検索のための柔らかくも高速なパターンマッチャー"
Avatar for Hiroyuki Deguchi de9uch1
1
850
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
Avatar for Hiroyuki Deguchi de9uch1
0
380
サブセット探索を用いた高速なkNNニューラル機械翻訳
Avatar for Hiroyuki Deguchi de9uch1
0
180
20240226_AAMT-Japio
Avatar for Hiroyuki Deguchi de9uch1
0
210
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
240
My Research Environmental Setup
Avatar for Hiroyuki Deguchi de9uch1
0
350
Nearest Neighbor Machine Translation
Avatar for Hiroyuki Deguchi de9uch1
0
300

Other Decks in Research

See All in Research
[IR Reading 2026春 論文紹介] LLM-based Listwise Reranking under the Effect of Positional Bias (ECIR 2026) /IR-Reading-2026-Spring
Avatar for Kohei Shinden koheishinden
PRO
0
450
量子サマースクール2026「量子計算機アーキテクチャ分野の概観」
Avatar for Yosuke Ueno youten622
1
950
Karkada さんの論文 × 2 の紹介: (1) Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models, (2) Symmetry in language statistics shapes the geometry of model representations
Avatar for Sho Yokoi eumesy
PRO
1
800
PHTalks Bengaluru - SSRF When All Else Fails
Avatar for Debangshu Kundu dk999
0
1.2k
敵対生成プロンプト同時探索による内省型プロンプト最適化
Avatar for Kotaro Inoue kinoue_smarthr
0
430
Pretrain Where? Investigating How Pretraining Data Diversity Impacts Geospatial Foundation Model Performance
Avatar for SatAI.challenge satai
3
160
Language and AI
Avatar for Ayana Niwa ayaniwa
0
310
Sleuthcon Keynote - How Cybercriminals (ab)use AI
Avatar for Thomas Roccia fr0gger
0
350
視覚若手の会LENSって何？？
Avatar for 小島瑞貴 mickey_0226
0
320
Visual SLAM未来予測 / Future Prediction in Visual SLAM
Avatar for koide3 koide3
1
1.1k
Anthropic が提案する LLM の内部状態を自然言語で説明可能にした Natural Language Autoencoders / Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activations
Avatar for Shunsuke KITADA shunk031
0
320
進化？迷走？CasualConc ファミリーアプリの現在地 @ 英語コーパス学会 2026
Avatar for Yasu Imao casualconc
0
120

Featured

See All Featured
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
Avatar for Katarina Dahlin katarinadahlin
PRO
3
3.8k
Amusing Abliteration
Avatar for ianozsvald ianozsvald
1
320
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
1
2.4k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
35
2.6k
Music & Morning Musume
Avatar for Bryan Veloso bryan
48
7.4k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.8k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
33
5k
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
710
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
306
120k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
700
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
1
570
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
97
6.8k

Transcript

  1. None

  2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling

    with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1]

    PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

  4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶

  5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2]

    Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

  6. ◼ ⚫ ⚫

  7. ◼ ⚫ ◼ ◼

  8. ◼ ◼ ◼

  9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶

  10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶

  11. ◼ ⚫ ⚫ ▶ ▶

  12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫