Bornon: Bengali Image Captioning with Transformer-based Deep learning approach
Image captioning using Encoder-Decoder based approach where CNN is used as the Encoder and sequence generator like RNN as Decoder has proven to be very effective. However, this method has a drawback that is sequence needs to be processed in order. To overcome this drawback some researcher has utilized the Transformer model to generate captions from images using English datasets. However, none of them generated captions in Bengali using the transformer model. As a result, we utilized three different Bengali datasets to generate Bengali captions from images using the Transformer model. Additionally, we compared the performance of the transformer-based model with a visual attention-based Encoder-Decoder approach. Finally, we compared the result of the transformer-based model with other models that employed different Bengali image captioning datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderDeep LearningImage CaptioningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Bangla Image Caption Generation through CNN-Transformer based Encoder-Decoder Network
Automatic Image Captioning is the never-ending effort of creating syntactically and validating the accuracy of textual descriptions of an image in natural language with context. The encoder-decoder structure used through…
Caption GenerationDecoderImage CaptioningImproved Bengali Image Captioning via deep convolutional neural network based encoder-decoder model
Image Captioning is an arduous task of producing syntactically and semantically correct textual descriptions of an image in natural language with context related to the image. Existing notable pieces of research in Benga…
DecoderImage CaptioningAlign Where the Words Look: Cross-Attention-Guided Patch Alignment with Contrastive and Transport Regularization for Bengali Captioning
Grounding vision--language models in low-resource languages remains challenging, as they often produce fluent text about the wrong objects. This stems from scarce paired data, translation pivots that break alignment, and…
Gaussian Smoothen Semantic Features (GSSF) -- Exploring the Linguistic Aspects of Visual Captioning in Indian Languages (Bengali) Using MSCOCO Framework
In this work, we have introduced Gaussian Smoothen Semantic Features (GSSF) for Better Semantic Selection for Indian regional language-based image captioning and introduced a procedure where we used the existing translat…
DiversityImage CaptioningText GenerationTranslationOptical Text Recognition in Nepali and Bengali: A Transformer-based Approach
Efforts on the research and development of OCR systems for Low-Resource Languages are relatively new. Low-resource languages have little training data available for training Machine Translation systems or other systems. …
DecoderMachine TranslationOptical Character Recognition (OCR)