Gated Multi-Task Network for Text Classification
Multi-task learning with Convolutional Neural Network (CNN) has shown great success in many Natural Language Processing (NLP) tasks. This success can be largely attributed to the feature sharing by fusing some layers among tasks. However, most existing approaches just fully or proportionally share the features without distinguishing the helpfulness of them. By that the network would be confused by the helpless even harmful features, generating undesired interference between tasks. In this paper, we introduce gate mechanism into multi-task CNN and propose a new Gated Sharing Unit, which can filter the feature flows between tasks and greatly reduce the interference. Experiments on 9 text classification datasets shows that our approach can learn selection rules automatically and gain a great improvement over strong baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationMulti-Task Learningtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Vector of Locally Aggregated Embeddings for Text Representation
We present Vector of Locally Aggregated Embeddings (VLAE) for effective and, ultimately, lossless representation of textual content. Our model encodes each input text by effectively identifying and integrating the repres…
ClassificationGeneral Classificationtext-classificationText ClassificationMulti-level Gated Recurrent Neural Network for Dialog Act Classification
In this paper we focus on the problem of dialog act (DA) labelling. This problem has recently attracted a lot of attention as it is an important sub-part of an automatic question answering system, which is currently in g…
ClassificationDialog Act ClassificationGeneral ClassificationQuestion Answering+1Hierarchical Transfer Learning for Multi-label Text Classification
Multi-Label Hierarchical Text Classification (MLHTC) is the task of categorizing documents into one or more topics organized in an hierarchical taxonomy. MLHTC can be formulated by combining multiple binary classificatio…
Binary ClassificationClassificationGeneral ClassificationMulti Label Text Classification+4Cluster-Gated Convolutional Neural Network for Short Text Classification
Text classification plays a crucial role for understanding natural language in a wide range of applications. Most existing approaches mainly focus on long text classification (e.g., blogs, documents, paragraphs). However…
ClassificationClusteringGeneral Classificationtext-classification+1Text Classification in the LLM Era - Where do we stand?
Large Language Models revolutionized NLP and showed dramatic performance improvements across several tasks. In this paper, we investigated the role of such language models in text classification and how they compare with…
ClassificationSentiment AnalysisSentiment Classificationtext-classification+3