Do Convolutional Networks need to be Deep for Text Classification ?

2017-07-13 · Hoa T. Le, Christophe Cerisara, Alexandre Denis

We study in this work the importance of depth in convolutional models for text classification, either when character or word inputs are considered. We show on 5 standard text classification and sentiment analysis tasks that deep models indeed give better performances than shallow networks when the text input is represented as a sequence of characters. However, a simple shallow-and-wide network outperforms deep models such as DenseNet with word inputs. Our shallow word model further establishes new state-of-the-art performances on two datasets: Yelp Binary (95.9\%) and Yelp Full (64.9\%).

📄 PDF Abstract BibTeX arXiv:1707.04108

Code (0)

등록된 구현이 없습니다.

Tasks

Classification General Classification Sentiment Analysis text-classification Text Classification

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Batch Normalization 설명 없음

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Average Pooling 설명 없음

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…

Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Dense Block A Dense Block is a module used in convolutional neural networks that connects *all layers* (with matching feature-map sizes) directly with each other. It was originally…

Kaiming Initialization 설명 없음

A Compact Convolutional Neural Network for Textured Surface Anomaly Detection

2018-05-18 · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) 2018 5 · Domen Racki, Dejan Tomazevic, Danijel Skocaj

Convolutional neural methods have proven to outperform other approaches in various computer vision tasks. In this paper we apply the deep learning technique to the domain of automated visual surface inspection. We design…

Anomaly Detection Anomaly Segmentation Classification General Classification+1

An Innovative Word Encoding Method For Text Classification Using Convolutional Neural Network

2019-03-11 · Amr Adel Helmy, Yasser M. K. Omar, Rania Hodhod

Text classification plays a vital role today especially with the intensive use of social networking media. Recently, different architectures of convolutional neural networks have been used for text classification in whic…

Classification General Classification text-classification Text Classification

Learning Convolutional Text Representations for Visual Question Answering

2017-05-18 · Zhengyang Wang, Shuiwang Ji

Visual question answering is a recently proposed artificial intelligence task that requires a deep understanding of both images and texts. In deep learning, images are typically modeled through convolutional neural netwo…

General Classification image-classification text-classification Visual Question Answering+1

Compact Encoding of Words for Efficient Character-level Convolutional Neural Networks Text Classification

2018-01-01 · ICLR 2018 1 · Wemerson Marinho, Luis Marti, Nayat Sanchez-pi

This paper puts forward a new text to tensor representation that relies on information compression techniques to assign shorter codes to the most frequently used characters. This representation is language-independent wi…

General Classification text-classification Text Classification

Text Classification using Graph Convolutional Networks: A Comprehensive Survey

2024-10-12 · Syed Mustafa Haider Rizvi, Ramsha Imran, Arif Mahmood

Text classification is a quintessential and practical problem in natural language processing with applications in diverse domains such as sentiment analysis, fake news detection, medical diagnosis, and document classific…

Classification Document Classification Fake News Detection Medical Diagnosis+4