paper-with-me

홈 › Papers

Efficient strategies for hierarchical text classification: External knowledge and auxiliary tasks

2020-05-05 · ACL 2020 6 · Kervy Rivas Rojas, Gina Bustamante, Arturo Oncevay, Marco A. Sobrevilla Cabezudo

In hierarchical text classification, we perform a sequence of inference steps to predict the category of a document from top to bottom of a given class taxonomy. Most of the studies have focused on developing novels neural network architectures to deal with the hierarchical structure, but we prefer to look for efficient ways to strengthen a baseline model. We first define the task as a sequence-to-sequence problem. Afterwards, we propose an auxiliary synthetic task of bottom-up-classification. Then, from external dictionaries, we retrieve textual definitions for the classes of all the hierarchy's layers, and map them into the word vector space. We use the class-definition embeddings as an additional input to condition the prediction of the next layer and in an adapted beam search. Whereas the modified search did not provide large gains, the combination of the auxiliary task and the additional input of class-definitions significantly enhance the classification accuracy. With our efficient approaches, we outperform previous studies, using a drastically reduced number of parameters, in two well-known English datasets.

📄 PDF Abstract BibTeX arXiv:2005.02473

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral Classificationtext-classificationText Classification

Similar Papers 제목 키워드 기반

A Hierarchical Neural Attention-based Text Classifier

2018-10-01 · EMNLP 2018 10 · Koustuv Sinha, Yue Dong, Jackie Chi Kit Cheung, Derek Ruths

Deep neural networks have been displaying superior performance over traditional supervised classifiers in text classification. They learn to extract useful features automatically when sufficient amount of data is present…

ClassificationGeneral Classificationtext-classificationText Classification

DKEC: Domain Knowledge Enhanced Multi-Label Classification for Diagnosis Prediction

2023-10-10 · Xueren Ge, Satpathy Abhishek, Ronald Dean Williams, John A. Stankovic 외

Multi-label text classification (MLTC) tasks in the medical domain often face the long-tail label distribution problem. Prior works have explored hierarchical label structures to find relevant information for few-shot cl…

ClassificationKnowledge GraphsMedical DiagnosisMulti-Label Classification+5

Wiki-LLaVA: Hierarchical Retrieval-Augmented Generation for Multimodal LLMs

2024-04-23 · Davide Caffagni, Federico Cocchi, Nicholas Moratelli, Sara Sarto 외

Multimodal LLMs are the natural evolution of LLMs, and enlarge their capabilities so as to work beyond the pure textual modality. As research is being carried out to design novel architectures and vision-and-language ada…

Question AnsweringRetrievalRetrieval-augmented GenerationVisual Question Answering

Hierarchical Image Classification using Entailment Cone Embeddings

2020-04-02 · Ankit Dhall, Anastasia Makarova, Octavian Ganea, Dario Pavllo 외

Image classification has been studied extensively, but there has been limited work in using unconventional, external guidance other than traditional image-label pairs for training. We present a set of methods for leverag…

ClassificationGeneral Classificationimage-classificationImage Classification+1

Deep Determinantal Point Process for Large-Scale Multi-Label Classification

2017-10-01 · ICCV 2017 10 · Pengtao Xie, Ruslan Salakhutdinov, Luntian Mou, Eric P. Xing

We study large-scale multi-label classification (MLC) on two recently released datasets: Youtube-8M and Open Images that contain millions of data instances and thousands of classes. The unprecedented problem scale poses …

ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+2