paper-with-me

홈 › Papers

Natural Language Processing Through Transfer Learning: A Case Study on Sentiment Analysis

2023-11-28 · Aman Yadav, Abhishek Vichare

Artificial intelligence and machine learning have significantly bolstered the technological world. This paper explores the potential of transfer learning in natural language processing focusing mainly on sentiment analysis. The models trained on the big data can also be used where data are scarce. The claim is that, compared to training models from scratch, transfer learning, using pre-trained BERT models, can increase sentiment classification accuracy. The study adopts a sophisticated experimental design that uses the IMDb dataset of sentimentally labelled movie reviews. Pre-processing includes tokenization and encoding of text data, making it suitable for NLP models. The dataset is used on a BERT based model, measuring its performance using accuracy. The result comes out to be 100 per cent accurate. Although the complete accuracy could appear impressive, it might be the result of overfitting or a lack of generalization. Further analysis is required to ensure the model's ability to handle diverse and unseen data. The findings underscore the effectiveness of transfer learning in NLP, showcasing its potential to excel in sentiment analysis tasks. However, the research calls for a cautious interpretation of perfect accuracy and emphasizes the need for additional measures to validate the model's generalization.

📄 PDF Abstract BibTeX arXiv:2311.16965

Code (0)

등록된 구현이 없습니다.

Tasks

Experimental DesignSentiment AnalysisSentiment ClassificationTransfer Learning

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Adam 설명 없음

Similar Papers 제목 키워드 기반

Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation

2024-03-27 · Mateusz Klimaszewski, Piotr Andruszkiewicz, Alexandra Birch

The rise of Modular Deep Learning showcases its potential in various Natural Language Processing applications. Parameter-efficient fine-tuning (PEFT) modularity has been shown to work for various use cases, from domain a…

Domain AdaptationKnowledge DistillationLanguage ModelingLanguage Modelling+6

Fine-Tuning Transformers: Vocabulary Transfer

2021-12-29 · Vladislav Mosin, Igor Samenko, Alexey Tikhonov, Borislav Kozlovskii 외

Transformers are responsible for the vast majority of recent advances in natural language processing. The majority of practical natural language processing applications of these models are typically enabled through trans…

Transfer Learning

Soft Language Prompts for Language Transfer

2024-07-02 · Ivan Vykopal, Simon Ostermann, Marián Šimko

Cross-lingual knowledge transfer, especially between high- and low-resource languages, remains challenging in natural language processing (NLP). This study offers insights for improving cross-lingual NLP applications thr…

Cross-Lingual Transferparameter-efficient fine-tuningTransfer Learning

Evolution of transfer learning in natural language processing

2019-10-16 · Aditya Malte, Pratik Ratadiya

In this paper, we present a study of the recent advancements which have helped bring Transfer Learning to NLP through the use of semi-supervised training. We discuss cutting-edge methods and architectures such as BERT, G…

Machine Translationtext-classificationText ClassificationTransfer Learning

An Evaluation of Progressive Neural Networksfor Transfer Learning in Natural Language Processing

2020-05-01 · LREC 2020 5 · Abdul Moeed, Gerhard Hagerer, Sumit Dugar, Sarthak Gupta 외

A major challenge in modern neural networks is the utilization of previous knowledge for new tasks in an effective manner, otherwise known as transfer learning. Fine-tuning, the most widely used method for achieving this…

text-classificationText ClassificationTransfer Learning