paper-with-me

Papers

Enhancing Text Annotation through Rationale-Driven Collaborative Few-Shot Prompting

2024-09-15 · Jianfei Wu, Xubin Wang, Weijia Jia

The traditional data annotation process is often labor-intensive, time-consuming, and susceptible to human bias, which complicates the management of increasingly complex datasets. This study explores the potential of large language models (LLMs) as automated data annotators to improve efficiency and consistency in annotation tasks. By employing rationale-driven collaborative few-shot prompting techniques, we aim to improve the performance of LLMs in text annotation. We conduct a rigorous evaluation of six LLMs across four benchmark datasets, comparing seven distinct methodologies. Our results demonstrate that collaborative methods consistently outperform traditional few-shot techniques and other baseline approaches, particularly in complex annotation tasks. Our work provides valuable insights and a robust framework for leveraging collaborative learning methods to tackle challenging text annotation tasks.

📄 PDF Abstract BibTeX arXiv:2409.09615

Code (0)

등록된 구현이 없습니다.

Tasks

Managementtext annotation

Similar Papers 제목 키워드 기반

Interpretable Rationale Augmented Charge Prediction System

2018-08-01 · COLING 2018 8 · Xin Jiang, Hai Ye, Zhunchen Luo, Wenhan Chao 외

This paper proposes a neural based system to solve the essential interpretability problem existing in text classification, especially in charge prediction task. First, we use a deep reinforcement learning method to extra…

ClassificationDeep Reinforcement LearningGeneral ClassificationPrediction+5

RISE: Enhancing VLM Image Annotation with Self-Supervised Reasoning

2025-08-17 · Suhang Hu, Wei Hu, Yuhang Su, Fan Zhang arxiv

Vision-Language Models (VLMs) struggle with complex image annotation tasks, such as emotion classification and context-driven object detection, which demand sophisticated reasoning. Standard Supervised Fine-Tuning (SFT) …

Reinforcement LearningEmotion ClassificationObject Detection

Rationalization Models for Text-to-SQL

2025-02-10 · Gaetano Rossiello, Nhan Pham, Michael Glass, JunKyu Lee 외

We introduce a framework for generating Chain-of-Thought (CoT) rationales to enhance text-to-SQL model fine-tuning. These rationales consist of intermediate SQL statements and explanations, serving as incremental steps t…

Knowledge DistillationLanguage ModelingLanguage ModellingLarge Language Model+2

LightTag: Text Annotation Platform

2021-09-06 · EMNLP (ACL) 2021 11 · Tal Perry

Text annotation tools assume that their user's goal is to create a labeled corpus. However, users view annotation as a necessary evil on the way to deliver business value through NLP. Thus an annotation tool should optim…

text annotation

Can human clinical rationales improve the performance and explainability of clinical text classification models?

2025-07-28 · Christoph Metzner, Shang Gao, Drahomira Herrmannova, Heidi A. Hanson arxiv

AI-driven clinical text classification is vital for explainable automated retrieval of population-level health information. This work investigates whether human-based clinical rationales can serve as additional supervisi…

Text Classification