Sirvi Autor "Creutz, Mathias" järgi

Nüüd näidatakse 1 - 3 3

Analyzing the Effect of Linguistic Instructions on Paraphrase Generation
(University of Tartu Library, 2025-03) Vahtola, Teemu; Hu, Songbo; Creutz, Mathias; Korhonen, Anna; Vulić, Ivan; Tiedemann, Jörg; Johansson, Richard; Stymne, Sara
Recent work has demonstrated that large language models can often generate fluent and linguistically correct text, adhering to given instructions. However, to what extent can they execute complex instructions requiring knowledge of fundamental linguistic concepts and elaborate semantic reasoning? Our study connects an established linguistic theory of paraphrasing with LLM-based practice to analyze which specific types of paraphrases LLMs can accurately produce and where they still struggle. To this end, we investigate a method of analyzing paraphrases generated by LLMs prompted with a comprehensive set of systematic linguistic instructions. We conduct a case study using GPT-4, which has shown strong performance across various language generation tasks, and we believe that other LLMs may face similar challenges in comparable scenarios. We examine GPT-4 from a linguistic perspective to explore its potential contributions to linguistic research regarding paraphrasing, systematically assessing how accurately the model generates paraphrases that adhere to specified transformation rules. Our results suggest that GPT-4 frequently prioritizes simple lexical or syntactic alternations, often disregarding the transformation guidelines if they overly complicate the primary task.
Evaluating Morphological Generalisation in Machine Translation by Distribution-Based Compositionality Assessment
(University of Tartu Library, 2023-05) Moisio, Anssi; Creutz, Mathias
Grammatical Error Generation Based on Translated Fragments
(Reykjavik, Iceland (Online), Linköping University Electronic Press, Sweden, pp. 398--403, 2021) Sjöblom, Eetu; Creutz, Mathias; Vahtola, Teemu; Dobnik, Simon; Øvrelid, Lilja