Exploring Language-Agnosticity in Function Vectors: A Case Study in Machine Translation

Researchers found that function vectors—task representations extracted from multilingual LLMs during in-context learning—transfer across languages when trained on a single translation direction. Translation vectors learned from English-to-one-language pairs improved token ranking in unseen target languages, suggesting language-agnostic task encoding in decoder-only models.

MentionsFunction vectors · Machine translation · Multilingual LLMs · In-context learning

Modelwire summarizes — we don’t republish. The full article lives on arxiv.org. If you’re a publisher and want a different summarization policy for your work, see our takedown page.