A Sensitivity Analysis of Attention-Gated Convolutional Neural Networks for Sentence Classification
In this paper, we investigate the effect of different hyperparameters as well as different combinations of hyperparameters settings on the performance of the Attention-Gated Convolutional Neural Networks (AGCNNs), e.g., the kernel window size, the number of feature maps, the keep rate of the dropout layer, and the activation function. We draw practical advice from a wide range of empirical results. Through the sensitivity analysis, we further improve the hyperparameters settings of AGCNNs. Experiments show that our proposals could achieve an average of 0.81% and 0.67% improvements on AGCNN-NLReLU-rand and AGCNN-SELU-rand, respectively; and an average of 0.47% and 0.45% improvements on AGCNN-NLReLU-static and AGCNN-SELU-static, respectively.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationSensitivitySentenceSentence ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AGD-Autoencoder: Attention Gated Deep Convolutional Autoencoder for Brain Tumor Segmentation
Brain tumor segmentation is a challenging problem in medical image analysis. The endpoint is to generate the salient masks that accurately identify brain tumor regions in an fMRI screening. In this paper, we propose a no…
Brain SegmentationBrain Tumor SegmentationMedical Image AnalysisSegmentation+1An Attention-Gated Convolutional Neural Network for Sentence Classification
The classification of sentences is very challenging, since sentences contain the limited contextual information. In this paper, we proposed an Attention-Gated Convolutional Neural Network (AGCNN) for sentence classificat…
ClassificationGeneral ClassificationSentenceSentence ClassificationAspect Based Sentiment Analysis with Self-Attention and Gated Convolutional Networks
Aspect based sentiment analysis (ABSA) is a fine-grained sentiment analysis task, whose main goal is to identify the sentiment polarity of an aspect in a sentence. A sentence may contain many different aspects, each of w…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Aspect Category Sentiment AnalysisSentence+1Amplifying Aspect-Sentence Awareness: A Novel Approach for Aspect-Based Sentiment Analysis
Aspect-Based Sentiment Analysis (ABSA) is increasingly crucial in Natural Language Processing (NLP) for applications such as customer feedback analysis and product recommendation systems. ABSA goes beyond traditional sen…
Aspect-Based Sentiment AnalysisAspect-Based Sentiment Analysis (ABSA)Product RecommendationRecommendation Systems+2Interpreting Negation in GPT-2: Layer- and Head-Level Causal Analysis
Negation remains a persistent challenge for modern language models, often causing reversed meanings or factual errors. In this work, we conduct a causal analysis of how GPT-2 Small internally processes such linguistic tr…