DRANZIERA: An Evaluation Protocol For Multi-Domain Opinion Mining
Opinion Mining is a topic which attracted a lot of interest in the last years. By observing the literature, it is often hard to replicate system evaluation due to the unavailability of the data used for the evaluation or to the lack of details about the protocol used in the campaign. In this paper, we propose an evaluation protocol, called DRANZIERA, composed of a multi-domain dataset and guidelines allowing both to evaluate opinion mining systems in different contexts (Closed, Semi-Open, and Open) and to compare them to each other and to a number of baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Opinion MiningSimilar Papers 제목 키워드 기반
Can Large Language Models be Effective Online Opinion Miners?
The surge of user-generated online content presents a wealth of insights into customer preferences and market trends. However, the highly diverse, complex, and context-rich nature of such contents poses significant chall…
Opinion MiningSummarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised
We present a neural framework for opinion summarization from online product reviews which is knowledge-lean and only requires light supervision (e.g., in the form of product domain labels and user-provided ratings). Our …
Aspect ExtractionFormMultiple Instance LearningOpinion SummarizationTowards Temporal Knowledge-Base Creation for Fine-Grained Opinion Analysis with Language Models
We propose a scalable method for constructing a temporal opinion knowledge base with large language models (LLMs) as automated annotators. Despite the demonstrated utility of time-series opinion analysis of text for down…
Fine-Grained Opinion AnalysisPrompt EngineeringQuestion AnsweringOpinion MiningOne Prompt To Rule Them All: LLMs for Opinion Summary Evaluation
Evaluation of opinion summaries using conventional reference-based metrics rarely provides a holistic evaluation and has been shown to have a relatively low correlation with human judgments. Recent studies suggest using …
Allnlg evaluationOpinion SummarizationSpecificityConfirmatory Aspect-based Opinion Mining Processes
A new opinion extraction method is proposed to summarize unstructured, user-generated content (i.e., online customer reviews) in the fixed topic domains. To differentiate the current approach from other opinion extractio…
Opinion MiningPOSSentiment Analysis