53 hasil
Menampilkan 1–20 · 0,63 detik · RSS
Northern European Journal of Language Technology
ISSN 2000-1533 · Linköping University Electronic Press · 53 artikel di indeks
-
Artikel Jurnal
Evaluating Task-oriented Dialogue Systems: A Systematic Review of Measures, Constructs and their Operationalisations
This review gives an overview of evaluation methods for task-oriented dialogue systems, discussing the constructs, metrics and operationalisations used in previous work and highlighting the challenges in the context of dialogue system evaluation. The objective of this review is to encourage a more…
-
Artikel Jurnal
A note on the detection of LLM-generated political speeches
We use a recent data set (ParliaBench) containing political speeches as well as LLM-generated versions of such speeches to investigate whether the latter can be detected as being LLM-generated. We find that, for this data set, a linear, interpretable classifier can easily do so, achieving an F1…
-
Artikel Jurnal
Assessing Moral Judgment by Large Language Models – A Survey of Available Datasets
Recent advances in language modeling have contributed to a growing emphasis on machine ethics, including researching and assessing moral judgments made by large language models (LLMs). This paper provides a critical survey of the existing datasets for exactly this assessment, with a special focus…
-
Artikel Jurnal
Study of Language Identification Task on the Token Level for Ukrainian-Russian Code-Mixing Dataset
This paper presents experiments on language identification for a Ukrainian-Russian code-switching dataset. Code-switching, a common phenomenon in multilingual societies, presents significant challenges for natural language processing. This study discusses various issues encountered during dataset…
-
Artikel Jurnal
SAKHA: A Chatbot-Based Support System for Legal and Mental Health Aid to Women & Children Cybercrime Victims
In a digital world where cybercrimes are on the rise, women and children in India face unique challenges that are often overlooked by existing solutions. The globally available platforms fail to address the nuances of Indian laws and the cultural stigma surrounding sensitive issues like mental…
-
Artikel Jurnal
Domain Adaptation in Sequence Labelling: A Case Study for Two South African Languages
In this paper, we investigate domain adaptation for Part-of-speech (POS) tagging of two under-resourced South African languages, isiZulu and Sesotho sa Leboa, by studying its effect on the POS tagging results and how to possibly predict what quality can be expected when applying an existing POS…
-
Artikel Jurnal
Controlling Language and Style of Multi-lingual Generative Language Models with Control Vectors
Control vectors have recently gained popularity as a method for steering transformer-based generative language models. This paper contributes to this path of research by evaluating the robustness of these control vectors in multi- and cross-lingual question-answering settings mimicking the…
-
Artikel Jurnal
Hybrid Human-LLM Corpus Construction and LLM Evaluation for the Caused-Motion Construction
The caused-motion construction (CMC, “She sneezed the foam off her cappuccino”) is one of the most well-studied constructions in Construction Grammar (CxG). It is a prime example for describing how constructions must carry meaning, as otherwise the fact that “sneeze” in this context takes two…
-
Artikel Jurnal
Implicit and Indirect: Detecting Face-threatening and Paired Actions in Asynchronous Online Conversations
This paper presents an approach to computationally detecting face-threatening and paired actions in asynchronous online conversations. Action detection has been widely studied for synchronous chats. However, there are fewer models or datasets for asynchronous conversations, and they have not…
-
Artikel Jurnal
Documenting Geographically and Contextually Diverse Language Data Sources
Contemporary large-scale data collection efforts have prioritized the amount of data collected to improve large language models (LLM). This quantitative approach has resulted in concerns for the rights of data subjects represented in data collections. This concern is exacerbated by a lack of…
-
Artikel Jurnal
Generation and Evaluation of Multiple-choice Reading Comprehension Questions for Swedish
Multiple-choice questions (MCQs) provide a widely used means of assessing reading comprehension. The automatic generation of such MCQs is a challenging language-technological problem that also has interesting educational applications. This article presents several methods for automatically…
-
Artikel Jurnal
Understanding Counterspeech for Online Harm Mitigation
Counterspeech offers direct rebuttals to hateful speech by challenging perpetrators of hate and showing support to targets of abuse. It provides a promising alternative to more contentious measures, such as content moderation and deplatforming, by contributing a greater amount of positive online…
-
Artikel Jurnal
DANSK: Domain Generalization of Danish Named Entity Recognition
Named entity recognition is an important application within Danish NLP, essential within both industry and research. However, Danish NER is inhibited by a lack coverage across domains and entity types. As a consequence, no current models are capable of fine-grained named entity recognition, nor…
-
Artikel Jurnal
Efficient Structured Prediction with Transformer Encoders
Finetuning is a useful method for adapting Transformer-based text encoders to new tasks but can be computationally expensive for structured prediction tasks that require tuning at the token level. Furthermore, finetuning is inherently inefficient in updating all base model parameters, which…
-
Artikel Jurnal
On Using Self-Report Studies to Analyze Language Models
We are at a curious point in time where our ability to build language models (LMs) has outpaced our ability to analyze them. We do not really know how to reliably determine their capabilities, biases, dangers, knowledge, and so on. The benchmarks we have are often overly specific, do not generalize…
-
Artikel Jurnal
QUA-RC: the semi-synthetic dataset of multiple choice questions for assessing reading comprehension in Ukrainian
In this article we present the first dataset of multiple choice questions for assessing reading comprehension in Ukrainian. The dataset is based on the texts from the Ukrainian national tests for reading comprehension, and the MCQs themselves are created semi-automatically in three stages. The…
-
Artikel Jurnal
An Empirical Configuration Study of a Common Document Clustering Pipeline
Document clustering is frequently used in applications of natural language processing, e.g. to classify news articles or creating topic models. In this paper, we study document clustering with the common clustering pipeline that includes vectorization with BERT or Doc2Vec, dimension reduction with…
-
Artikel Jurnal
Prevention or Promotion? Predicting Author's Regulatory Focus
People differ fundamentally in what motivates them to pursue a goal and how they approach it. For instance, some people seek growth and show eagerness, whereas others prefer security and are vigilant. The concept of regulatory focus is employed in psychology, to explain and predict this…