Minor changes make a difference: a case study on the consistency of UD-based dependency parsers
Many downstream applications are using dependency trees, and are thus relying on dependency parsers producing correct, or at least consistent, output. However, dependency parsers are trained using machine learning, and are therefore susceptible to unwanted inconsistencies due to biases in the training data. This paper explores the effects of such biases in four languages - English, Swedish, Russian, and Ukrainian - though an experiment where we study the effect of replacing numerals in sentences. We show that such seemingly insignificant changes in the input can cause large differences in the output, and suggest that data augmentation can remedy the problems.
Code (1)
Tasks
Data AugmentationSimilar Papers 제목 키워드 기반
Large Language Models Will Change The Way Children Think About Technology And Impact Every Interaction Paradigm
This paper presents a hopeful perspective on the potentially dramatic impacts of Large Language Models on how we children learn and how they will expect to interact with technology. We review the effects of LLMs on educa…
Trusting CHATGPT: how minor tweaks in the prompts lead to major differences in sentiment classification
One fundamental question for the social sciences today is: how much can we trust highly complex predictive models like ChatGPT? This study tests the hypothesis that subtle changes in the structure of prompts do not produ…
Large Language ModelSentiment AnalysisSentiment ClassificationReading Radiology Imaging Like The Radiologist
Automated radiology report generation aims to generate radiology reports that contain rich, fine-grained descriptions of radiology imaging. Compared with image captioning in the natural image domain, medical images are v…
Image CaptioningRetrievalText GenerationWhich principal components are most sensitive to distributional changes?
PCA is often used in anomaly detection and statistical process control tasks. For bivariate data, we prove that the minor projection (the least varying projection) of the PCA-rotated data is the most sensitive to distrib…
Anomaly DetectionSensitivityGender Differences in Abuse: The Case of Dutch Politicians on Twitter
Online abuse and threats towards politicians have become a significant concern in the Netherlands, like in many other countries across the world. This paper analyses gender differences in abuse received by Dutch politici…