Sirvi Autor "Nimb, Sanni" järgi
Nüüd näidatakse 1 - 6 6
- Tulemused lehekülje kohta
- Sorteerimisvalikud
Kirje Evaluating LLM-Generated Explanations of Metaphors – A Culture-Sensitive Study of Danish(University of Tartu Library, 2025-03) Pedersen, Bolette S.; Sørensen, Nathalie; Nimb, Sanni; Hansen, Dorte Haltrup; Olsen, Sussi; Al-Laith, Ali; Johansson, Richard; Stymne, SaraIn this study, we examine how well Danish culture-specific metaphors are explained by two of the best performing language models for Danish, namely ChatGPT and Llama. For comparison, the explanations are measured against how well cross- lingual (or ’universal’) metaphors are explained by the models; referring here to metaphors that exist in Danish as well as across cultures and languages and in particular in English. To perform our study, we compile a pilot dataset of 150 Danish metaphors and idioms divided tentatively by culture specificity. We prompt the two models and perform a careful qualitative evaluation of the explanations against a four-graded scale. Our studies show that both models are heavily biased towards English since they have much more success in explaining the metaphors that also exist in English than the culture-specific ones, relying presumably on erroneous transfer from English when dealing with the latter. In particular, the sentiment of the culture-specific metaphors seems to be often ’lost in translation’. We further claim that this strong colouring towards English poses a serious problem in the era of LLMs with regards to developing and maintaining cultural and linguistic diversity in other languages.Kirje Supersense tagging for Danish(Vilnius, Lithuania, Linköping University Electronic Press, Sweden, pp. 21--29, 2015) Martínez Alonso, Héctor; Johannsen, Anders; Olsen, Sussi; Nimb, Sanni; Hartvig Sørensen, Nicolai; Braasch, Anna; Søgaard, Anders; Sandford Pedersen, Bolette; Megyesi, BeátaKirje The Danish Idiom Dataset: A collection of 1000 Danish idioms and fixed expressions(University of Tartu Library, 2025-03) Sørensen, Nathalie Hau; Nimb, Sanni; Mikkelsen, Agnes Aggergaard; Jensen, Jonas; Einarsson, Hafsteinn; Simonsen, Annika; Nielsen, Dan SaattrupInterpreting idiomatic expressions is a challenging task for learners and LLMs alike, as their meanings cannot be deduced directly from their individual components and often reflect nuances that are specific to the language in question. This makes idiom interpretation an ideal task for assessing the linguistic proficiency of large language models (LLMs). In order to test how LLMs handle this task, we introduce a new dataset comprising 1000 Danish idiomatic expressions sourced from the Danish Dictionary DDO (ordnet.dk/ddo). The dataset has been made publicly available at sprogteknologi.dk. For each expression, the dataset includes a correct dictionary definition, a literal false definition, a figurative false definition, and a random false definition. In the paper, we also present three experiments that demonstrate diverse applications of the dataset and aim to evaluate how well LLMs are able to identify the correct meanings of idiomatic expressions.Kirje The Semantic Relations of Artifacts in DanNet(2009-05-13T14:10:07Z) Nimb, SanniKirje Title Pages(2009-05-11T11:30:06Z) Pedersen, Bolette Sandford; Braasch, Anna; Nimb, Sanni; Fjeld, Ruth Vatvedt