Sirvi Autor "Gogoulou, Evangelia" järgi

Tulemuste filtreerimiseks trükkige paar esimest tähte
Nüüd näidatakse 1 - 2 2
  • Pisipilt
    Kirje
    On the Concept of Resource-Efficiency in NLP
    (University of Tartu Library, 2023-05) Dürlich, Luise; Gogoulou, Evangelia; Nivre, Joakim
  • Pisipilt
    Kirje
    SweSAT-1.0: The Swedish University Entrance Exam as a Benchmark for Large Language Models
    (University of Tartu Library, 2025-03) Kurfalı, Murathan; Zahra, Shorouq; Gogoulou, Evangelia; Dürlich, Luise; Carlsson, Fredrik; Nivre, Joakim; Johansson, Richard; Stymne, Sara
    This introduces SweSAT-1.0, a new benchmark dataset created from the Swedish university entrance exam (Högskoleprovet) to assess large language models in Swedish. The current version of the benchmark includes 867 questions across six different tasks, including reading comprehension, mathematical problem solving, and logical reasoning. We find that some widely used open-source and commercial models excel in verbal tasks, but we also see that all models, even the commercial ones, struggle with reasoning tasks in Swedish. We hope that SweSAT-1.0 will facilitate research on large language models for Swedish by enriching the breadth of available tasks, offering a challenging evaluation benchmark that is free from any translation biases.