Sirvi Autor "Lhoneux, Miryam de" järgi

Nüüd näidatakse 1 - 1 1

The Roles of English in Evaluating Multilingual Language Models
(University of Tartu Library, 2025-03) Poelman, Wessel; Lhoneux, Miryam de; Johansson, Richard; Stymne, Sara
Multilingual natural language processing is getting increased attention, with numerous models, benchmarks, and methods being released for many languages. English is often used in multilingual evaluation to prompt language models (LMs), mainly to overcome the lack of instruction tuning data in other languages. In this position paper, we lay out two roles of English in multilingual LM evaluations: as an interface and as a natural language. We argue that these roles have different goals: task performance versus language understanding. This discrepancy is highlighted with examples from datasets and evaluation setups. Numerous works explicitly use English as an interface to boost task performance. We recommend to move away from these imprecise methods and instead focus on language understanding.