paper-with-me

홈 › Papers

Comparative study of Transformer and LSTM Network with attention mechanism on Image Captioning

2023-03-05 · Pranav Dandwate, Chaitanya Shahane, Vandana Jagtap, Shridevi C. Karande

In a globalized world at the present epoch of generative intelligence, most of the manual labour tasks are automated with increased efficiency. This can support businesses to save time and money. A crucial component of generative intelligence is the integration of vision and language. Consequently, image captioning become an intriguing area of research. There have been multiple attempts by the researchers to solve this problem with different deep learning architectures, although the accuracy has increased, but the results are still not up to standard. This study buckles down to the comparison of Transformer and LSTM with attention block model on MS-COCO dataset, which is a standard dataset for image captioning. For both the models we have used pretrained Inception-V3 CNN encoder for feature extraction of the images. The Bilingual Evaluation Understudy score (BLEU) is used to checked the accuracy of caption generated by both models. Along with the transformer and LSTM with attention block models,CLIP-diffusion model, M2-Transformer model and the X-Linear Attention model have been discussed with state of the art accuracy.

📄 PDF Abstract BibTeX arXiv:2303.02648

Code (0)

등록된 구현이 없습니다.

Tasks

Image Captioning

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Auxiliary Classifier Auxiliary Classifiers are type of architectural component that seek to improve the convergence of very deep networks. They are classifier heads we attach to layers before the…
Average Pooling 설명 없음
Inception-v3 Module Inception-v3 Module is an image block used in the Inception-v3 architecture. This architecture is used on the coarsest (8 ×…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Evaluating the Efficacy of AI Techniques in Textual Anonymization: A Comparative Study

2024-05-09 · Dimitris Asimopoulos, Ilias Siniosoglou, Vasileios Argyriou, Sotirios K. Goudos 외

In the digital era, with escalating privacy concerns, it's imperative to devise robust strategies that protect private data while maintaining the intrinsic value of textual information. This research embarks on a compreh…

A Comparative Analysis of Recurrent and Attention Architectures for Isolated Sign Language Recognition

2025-11-17 · Nigar Alishzade, Gulchin Abdullayeva arxiv

This study presents a systematic comparative analysis of recurrent and attention-based neural architectures for isolated sign language recognition. We implement and evaluate two representative models-ConvLSTM and Vanilla…

Sign Language RecognitionComputational Efficiency

A Comparative Analysis of Classical Machine Learning and Deep Learning Approaches for Sentiment Classification on IMDb Movie Reviews

2026-05-08 · Erma Daniar Safitri, Lia Hana Ichisasmita, Citra Agustin, Luluk Muthoharoh 외 arxiv

This paper presents a comparative study of classical machine learning and deep learning methods for sentiment classification on the IMDb movie reviews dataset. The machine learning pipeline uses TF-IDF features and PyCar…

Feature Engineering

A Comparison of LSTMs and Attention Mechanisms for Forecasting Financial Time Series

2018-12-18 · Thomas Hollis, Antoine Viscardi, Seung Eun Yi

While LSTMs show increasingly promising results for forecasting Financial Time Series (FTS), this paper seeks to assess if attention mechanisms can further improve performance. The hypothesis is that attention can help p…

Time SeriesTime Series Analysis

Small transformer architectures for task switching

2025-08-06 · Claudius Gros arxiv

The rapid progress seen in terms of large-scale generative AI is largely based on the attention mechanism. It is conversely non-trivial to conceive small-scale applications for which attention-based architectures outperf…