paper-with-me

홈 › Papers

Deep Active Learning for Text Classification with Diverse Interpretations

2021-08-15 · Qiang Liu, Yanqiao Zhu, Zhaocheng Liu, Yufeng Zhang, Shu Wu

Recently, Deep Neural Networks (DNNs) have made remarkable progress for text classification, which, however, still require a large number of labeled data. To train high-performing models with the minimal annotation cost, active learning is proposed to select and label the most informative samples, yet it is still challenging to measure informativeness of samples used in DNNs. In this paper, inspired by piece-wise linear interpretability of DNNs, we propose a novel Active Learning with DivErse iNterpretations (ALDEN) approach. With local interpretations in DNNs, ALDEN identifies linearly separable regions of samples. Then, it selects samples according to their diversity of local interpretations and queries their labels. To tackle the text classification problem, we choose the word with the most diverse interpretations to represent the whole sentence. Extensive experiments demonstrate that ALDEN consistently outperforms several state-of-the-art deep active learning methods.

📄 PDF Abstract BibTeX arXiv:2108.10687

Code (0)

등록된 구현이 없습니다.

Tasks

Active LearningClassificationDiversityInformativenessSentencetext-classificationText Classification

Methods 이 논문이 사용한 방법론

ALDEN 설명 없음

Similar Papers 제목 키워드 기반

On the Sensitivity and Stability of Model Interpretations

2021-10-16 · ACL ARR October 2021 10 · Anonymous

Recent years have witnessed the emergence of a variety of post-hoc interpretations that aim to uncover how natural language processing (NLP) models make predictions. Despite the surge of new interpretation methods, it re…

Adversarial RobustnessDependency ParsingmodelSensitivity+2

On the Sensitivity and Stability of Model Interpretations in NLP

2021-04-18 · ACL 2022 5 · Fan Yin, Zhouxing Shi, Cho-Jui Hsieh, Kai-Wei Chang

Recent years have witnessed the emergence of a variety of post-hoc interpretations that aim to uncover how natural language processing (NLP) models make predictions. Despite the surge of new interpretation methods, it re…

Adversarial RobustnessDependency ParsingSensitivitytext-classification+1

MAGNIFICo: Evaluating the In-Context Learning Ability of Large Language Models to Generalize to Novel Interpretations

2023-10-18 · Arkil Patel, Satwik Bhattamishra, Siva Reddy, Dzmitry Bahdanau

Humans possess a remarkable ability to assign novel interpretations to linguistic expressions, enabling them to learn new words and understand community-specific connotations. However, Large Language Models (LLMs) have a…

In-Context LearningSemantic ParsingText to SQLText-To-SQL

ChEX: Interactive Localization and Region Description in Chest X-rays

2024-04-24 · Philip Müller, Georgios Kaissis, Daniel Rueckert

Report generation models offer fine-grained textual interpretations of medical images like chest X-rays, yet they often lack interactivity (i.e. the ability to steer the generation process through user queries) and local…

Identifying the Source of Vulnerability in Fragile Interpretations: A Case Study in Neural Text Classification

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Prior works mainly used input perturbation methods for testing stability of post-hoc interpretation methods and observed fragile interpretations. However, different works show conflicting results on the primary source of…

text-classificationText Classification