paper-with-me

Papers

A Study on the Ambiguity in Human Annotation of German Oral History Interviews for Perceived Emotion Recognition and Sentiment Analysis

2022-01-18 · LREC 2022 6 · Michael Gref, Nike Matthiesen, Sreenivasa Hikkal Venugopala, Shalaka Satheesh, Aswinkumar Vijayananth, Duc Bach Ha, Sven Behnke, Joachim köhler

For research in audiovisual interview archives often it is not only of interest what is said but also how. Sentiment analysis and emotion recognition can help capture, categorize and make these different facets searchable. In particular, for oral history archives, such indexing technologies can be of great interest. These technologies can help understand the role of emotions in historical remembering. However, humans often perceive sentiments and emotions ambiguously and subjectively. Moreover, oral history interviews have multi-layered levels of complex, sometimes contradictory, sometimes very subtle facets of emotions. Therefore, the question arises of the chance machines and humans have capturing and assigning these into predefined categories. This paper investigates the ambiguity in human perception of emotions and sentiment in German oral history interviews and the impact on machine learning systems. Our experiments reveal substantial differences in human perception for different emotions. Furthermore, we report from ongoing machine learning experiments with different modalities. We show that the human perceptual ambiguity and other challenges, such as class imbalance and lack of training data, currently limit the opportunities of these technologies for oral history archives. Nonetheless, our work uncovers promising observations and possibilities for further research.

📄 PDF Abstract BibTeX arXiv:2201.06868

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningEmotion RecognitionSentiment Analysis

Similar Papers 제목 키워드 기반

Towards Alleviating the Modeling Ambiguity of Unsupervised Monocular 3D Human Pose Estimation

2021-01-01 · ICCV 2021 10 · Zhenbo Yu, Bingbing Ni, Jingwei Xu, Junjie Wang 외

In this work, we study the ambiguity problem in the task of unsupervised 3D human pose estimation from 2D counterpart. On one hand, without explicit annotation, the scale of 3D pose is difficult to be accurately capt…

3D Human Pose EstimationMonocular 3D Human Pose EstimationPose EstimationUnsupervised 3D Human Pose Estimation

An Evaluation of Hybrid Annotation Workflows on High-Ambiguity Spatiotemporal Video Footage

2025-10-20 · Juan Gutiérrez, Victor Gutiérrez, Ángel Mora, Silvia Rodriguez 외 arxiv

Manual annotation remains the gold standard for high-quality, dense temporal video datasets, yet it is inherently time-consuming. Vision-language models can aid human annotators and expedite this process. We report on th…

Annotation Challenges for Reconstructing the Structural Elaboration of Middle Low German

2017-08-01 · WS 2017 8 · Nina Seemann, Marie-Luis Merten, Michaela Geierhos, Doris Tophinke 외

In this paper, we present the annotation challenges we have encountered when working on a historical language that was undergoing elaboration processes. We especially focus on syntactic ambiguity and gradience in Middle …

Detecting Temporal Ambiguity in Questions

2024-09-25 · Bhawna Piryani, Abdelrahman Abdallah, Jamshid Mozafari, Adam Jatowt

Detecting and answering ambiguous questions has been a challenging task in open-domain question answering. Ambiguous questions have different answers depending on their interpretation and can take diverse forms. Temporal…

Open-Domain Question AnsweringQuestion Answering

"Is a picture of a bird a bird": Policy recommendations for dealing with ambiguity in machine vision models

2023-06-27 · Alicia Parrish, Sarah Laszlo, Lora Aroyo

Many questions that we ask about the world do not have a single clear answer, yet typical human annotation set-ups in machine learning assume there must be a single ground truth label for all examples in every task. The …