paper-with-me

홈 › Papers

An Ensemble Approach to Question Classification: Integrating Electra Transformer, GloVe, and LSTM

2023-08-13 · Sanad Aburass, Osama Dorgham, Maha Abu Rumman

Natural Language Processing (NLP) has emerged as a crucial technology for understanding and generating human language, playing an essential role in tasks such as machine translation, sentiment analysis, and more pertinently, question classification. As a subfield within NLP, question classification focuses on determining the type of information being sought, a fundamental step for downstream applications like question answering systems. This study presents an innovative ensemble approach for question classification, combining the strengths of Electra, GloVe, and LSTM models. Rigorously tested on the well-regarded TREC dataset, the model demonstrates how the integration of these disparate technologies can lead to superior results. Electra brings in its transformer-based capabilities for complex language understanding, GloVe offers global vector representations for capturing word-level semantics, and LSTM contributes its sequence learning abilities to model long-term dependencies. By fusing these elements strategically, our ensemble model delivers a robust and efficient solution for the complex task of question classification. Through rigorous comparisons with well-known models like BERT, RoBERTa, and DistilBERT, the ensemble approach verifies its effectiveness by attaining an 80% accuracy score on the test dataset.

📄 PDF Abstract BibTeX arXiv:2308.06828

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationMachine TranslationQuestion AnsweringSentiment Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
ELECTRA 설명 없음
Adam 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

NCUEE-NLP@SMM4H’22: Classification of Self-reported Chronic Stress on Twitter Using Ensemble Pre-trained Transformer Models

2022-10-01 · SMM4H (COLING) 2022 10 · Tzu-Mi Lin, Chao-Yi Chen, Yu-Wen Tzeng, Lung-Hao Lee

This study describes our proposed system design for the SMM4H 2022 Task 8. We fine-tune the BERT, RoBERTa, ALBERT, XLNet and ELECTRA transformers and their connecting classifiers. Each transformer model is regarded as a …

On the effectiveness of small, discriminatively pre-trained language representation models for biomedical text mining

2020-11-01 · EMNLP (sdp) 2020 11 · Ibrahim Burak Ozyurt

Neural language representation models such as BERT have recently shown state of the art performance in downstream NLP tasks and bio-medical domain adaptation of BERT (Bio-BERT) has shown same behavior on biomedical text …

Domain AdaptationGPUnamed-entity-recognitionNamed Entity Recognition+3

Ensemble ALBERT and RoBERTa for Span Prediction in Question Answering

2021-08-01 · ACL (dialdoc) 2021 8 · Sony Bachina, Spandana Balumuri, Sowmya Kamath S

Retrieving relevant answers from heterogeneous data formats, for given for questions, is a challenging problem. The process of pinpointing relevant information suitable to answer a question is further compounded in large…

Conversational Question AnsweringNatural QuestionsQuestion Answering

Optimizing Multi-Class Text Classification: A Diverse Stacking Ensemble Framework Utilizing Transformers

2023-08-19 · Anusuya Krishnan

Customer reviews play a crucial role in assessing customer satisfaction, gathering feedback, and driving improvements for businesses. Analyzing these reviews provides valuable insights into customer sentiments, including…

ClassificationMulti Class Text Classificationtext-classificationText Classification

FHAC at GermEval 2021: Identifying German toxic, engaging, and fact-claiming comments with ensemble learning

2021-09-07 · GermEval 2021 9 · Tobias Bornheim, Niklas Grieger, Stephan Bialonski

The availability of language representations learned by large pretrained neural network models (such as BERT and ELECTRA) has led to improvements in many downstream Natural Language Processing tasks in recent years. Pret…

Classification of toxic, engaging, fact-claiming commentsEngaging Comment ClassificationEnsemble LearningFact-Claiming Comment Classification+1