Building an annotated dataset of app store reviews with Appraisal features in English and Spanish
This paper describes the creation and annotation of a dataset consisting of 250 English and Spanish app store reviews from Google{'}s Play Store with Appraisal features. This is one of the most influential linguistic frameworks for the analysis of evaluation and opinion in discourse due to its insightful descriptive features. However, it has not been extensively applied in NLP in spite of its potential for the classification of the subjective content of these reviews. We describe the dataset, the annotation scheme and guidelines, the agreement studies, the annotation results and their impact on the characterisation of this genre.
Code (0)
등록된 구현이 없습니다.
Tasks
DescriptiveGeneral ClassificationSimilar Papers 제목 키워드 기반
Predicting the Past: Estimating Historical Appraisals with OCR and Machine Learning
Despite well-documented consequences of the U.S. government's 1930s housing policies on racial wealth disparities, scholars have struggled to quantify its precise financial effects due to the inaccessibility of historica…
Optical Character Recognition (OCR)APPReddit: a Corpus of Reddit Posts Annotated for Appraisal
Despite the large number of computational resources for emotion recognition, there is a lack of data sets relying on appraisal models. According to Appraisal theories, emotions are the outcome of a multi-dimensional eval…
Emotion RecognitionEfficient Few-Shot Fine-Tuning for Opinion Summarization
Abstractive summarization models are typically pre-trained on large amounts of generic texts, then fine-tuned on tens or hundreds of thousands of annotated samples. However, in opinion summarization, large annotated data…
Abstractive Text SummarizationOpinion SummarizationDo You Trust Me? Cognitive-Affective Signatures of Trustworthiness in Large Language Models
Perceived trustworthiness underpins how users navigate online information, yet it remains unclear whether large language models (LLMs),increasingly embedded in search, recommendation, and conversational systems, represen…
On the Role of Reviewer Expertise in Temporal Review Helpfulness Prediction
Helpful reviews have been essential for the success of e-commerce services, as they help customers make quick purchase decisions and benefit the merchants in their sales. While many reviews are informative, others provid…