Sirvi Autor "Carlsson, Fredrik" järgi
Nüüd näidatakse 1 - 3 3
- Tulemused lehekülje kohta
- Sorteerimisvalikud
listelement.badge.dso-type Kirje , It’s Basically the Same Language Anyway: the Case for a Nordic Language Model(Reykjavik, Iceland (Online), Linköping University Electronic Press, Sweden, pp. 367--372, 2021) Sahlgren, Magnus; Carlsson, Fredrik; Olsson, Fredrik; Börjeson, Love; Dobnik, Simon; Øvrelid, Liljalistelement.badge.dso-type Kirje , Should we Stop Training More Monolingual Models, and Simply Use Machine Translation Instead?(Reykjavik, Iceland (Online), Linköping University Electronic Press, Sweden, pp. 385--390, 2021) Isbister, Tim; Carlsson, Fredrik; Sahlgren, Magnus; Dobnik, Simon; Øvrelid, Liljalistelement.badge.dso-type Kirje , SweSAT-1.0: The Swedish University Entrance Exam as a Benchmark for Large Language Models(University of Tartu Library, 2025-03) Kurfalı, Murathan; Zahra, Shorouq; Gogoulou, Evangelia; Dürlich, Luise; Carlsson, Fredrik; Nivre, Joakim; Johansson, Richard; Stymne, SaraThis introduces SweSAT-1.0, a new benchmark dataset created from the Swedish university entrance exam (Högskoleprovet) to assess large language models in Swedish. The current version of the benchmark includes 867 questions across six different tasks, including reading comprehension, mathematical problem solving, and logical reasoning. We find that some widely used open-source and commercial models excel in verbal tasks, but we also see that all models, even the commercial ones, struggle with reasoning tasks in Swedish. We hope that SweSAT-1.0 will facilitate research on large language models for Swedish by enriching the breadth of available tasks, offering a challenging evaluation benchmark that is free from any translation biases.