Facts-and-Feelings: Capturing both Objectivity and Subjectivity in Table-to-Text Generation
Table-to-text generation, a long-standing challenge in natural language generation, has remained unexplored through the lens of subjectivity. Subjectivity here encompasses the comprehension of information derived from the table that cannot be described solely by objective data. Given the absence of pre-existing datasets, we introduce the Ta2TS dataset with 3849 data instances. We perform the task of fine-tuning sequence-to-sequence models on the linearized tables and prompting on popular large language models. We analyze the results from a quantitative and qualitative perspective to ensure the capture of subjectivity and factual consistency. The analysis shows the fine-tuned LMs can perform close to the prompted LLMs. Both the models can capture the tabular data, generating texts with 85.15% BERTScore and 26.28% Meteor score. To the best of our knowledge, we provide the first-of-its-kind dataset on tables with multiple genres and subjectivity included and present the first comprehensive analysis and comparison of different LLM performances on this task.
Code (0)
등록된 구현이 없습니다.
Tasks
Table-to-Text GenerationText GenerationSimilar Papers 제목 키워드 기반
Disembodied Machine Learning: On the Illusion of Objectivity in NLP
Machine Learning seeks to identify and encode bodies of knowledge within provided datasets. However, data encodes subjective content, which determines the possible outcomes of the models trained on it. Because such subje…
BIG-bench Machine LearningBeyond Domain Gap: Exploiting Subjectivity in Sketch-Based Person Retrieval
Person re-identification (re-ID) requires densely distributed cameras. In practice, the person of interest may not be captured by cameras and, therefore, needs to be retrieved using subjective information (e.g., sketches…
Person Re-IdentificationPerson RetrievalRetrievalCLiF-VQA: Enhancing Video Quality Assessment by Incorporating High-Level Semantic Information related to Human Feelings
Video Quality Assessment (VQA) aims to simulate the process of perceiving video quality by the human visual system (HVS). The judgments made by HVS are always influenced by human subjective feelings. However, most of the…
Video Quality AssessmentVisual Question Answering (VQA)Drawing the Line: Deep Segmentation for Extracting Art from Ancient Etruscan Mirrors
Etruscan mirrors constitute a significant category within Etruscan art and, therefore, undergo systematic examinations to obtain insights into ancient times. A crucial aspect of their analysis involves the labor-intensiv…
BinarizationSelf-Supervised LearningLarge Language Models for Subjective Language Understanding: A Survey
Subjective language understanding refers to a broad set of natural language processing tasks where the goal is to interpret or generate content that conveys personal feelings, opinions, or figurative meanings rather than…
Emotion RecognitionSentiment AnalysisSarcasm DetectionIntent Detection