Browsing by Author "Absar, Shayaan"

Filter results by typing the first few letters
Now showing 1 - 1 of 1
  • Thumbnail Image
    listelement.badge.dso-type Item , listelement.badge.access-status Open Access ,
    Fine-Tuning Cross-Lingual LLMs for POS Tagging in Code-Switched Contexts
    (University of Tartu Library, 2025-03) Absar, Shayaan; Tudor, Crina Madalina; Debess, Iben Nyholm; Bruton, Micaella; Scalvini, Barbara; Ilinykh, Nikolai; Holdt, Špela Arhar
    Code-switching (CS) involves speakers switching between two (or potentially more) languages during conversation and is a common phenomenon in bilingual communities. The majority of NLP research has been devoted to mono-lingual language modelling. Consequentially, most models perform poorly on code-switched data. This paper investigates the effectiveness of Cross-Lingual Large Language Models on the task of POS (Part-of-Speech) tagging in code-switched contexts, once they have undergone a fine-tuning process. The models are trained on code-switched combinations of Indian languages and English. This paper also seeks to investigate whether fine-tuned models are able to generalise and POS tag code-switched combinations that were not a part of the fine-tuning dataset. Additionally, this paper presents a new metric, the S-index (Switching-Index), for measuring the level of code-switching within an utterance.