Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Transcript

2. ◼ [1] ◼ ◼ ◼ [1] PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)
3. [1] ◼ ◼ ⚫ ⚫ ⚫ ⚫ ◼ ◼ [1] PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)
4. ◼ ⚫ ⚫ ◼ ⚫ ⚫ ▶ ▶
5. ◼ ⚫ ⚫ [2] ⚫ [2] ◼ ⚫ ⚫ [2] Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)
6. ◼ ⚫ ⚫
7. ◼ ⚫ ◼ ◼
8. ◼ ◼ ◼
9. ◼ ⚫ ▶ ▶ ⚫ ⚫ ◼ ⚫ ▶
10. ◼ ⚫ ⚫ ⚫ ▶ ▶ ▶
11. ◼ ⚫ ⚫ ▶ ▶
12. ◼ ⚫ ▶ ▶ ◼ ⚫ ⚫ ▶ ⚫