paper-with-me

Papers

Deep Learning Approaches on Image Captioning: A Review

2022-01-31 · Taraneh Ghandi, Hamidreza Pourreza, Hamidreza Mahyar

Image captioning is a research area of immense importance, aiming to generate natural language descriptions for visual content in the form of still images. The advent of deep learning and more recently vision-language pre-training techniques has revolutionized the field, leading to more sophisticated methods and improved performance. In this survey paper, we provide a structured review of deep learning methods in image captioning by presenting a comprehensive taxonomy and discussing each method category in detail. Additionally, we examine the datasets commonly employed in image captioning research, as well as the evaluation metrics used to assess the performance of different captioning models. We address the challenges faced in this field by emphasizing issues such as object hallucination, missing context, illumination conditions, contextual understanding, and referring expressions. We rank different deep learning methods' performance according to widely used evaluation metrics, giving insight into the current state of the art. Furthermore, we identify several potential future directions for research in this area, which include tackling the information misalignment problem between image and text modalities, mitigating dataset bias, incorporating vision-language pre-training methods to enhance caption generation, and developing improved evaluation tools to accurately measure the quality of image captions.

📄 PDF Abstract BibTeX arXiv:2201.12944

Code (0)

등록된 구현이 없습니다.

Tasks

Caption GenerationDeep LearningHallucinationImage CaptioningObject Hallucination

Similar Papers 제목 키워드 기반

Pixels to Prose: Understanding the art of Image Captioning

2024-08-28 · Hrishikesh Singh, Aarti Sharma, Millie Pant

In the era of evolving artificial intelligence, machines are increasingly emulating human-like capabilities, including visual perception and linguistic expression. Image captioning stands at the intersection of these dom…

DescriptiveImage CaptioningNavigate

Video Captioning: a comparative review of where we are and which could be the route

2022-04-12 · Daniela Moctezuma, Tania Ramírez-delReal, Guillermo Ruiz, Othón González-Chávez

Video captioning is the process of describing the content of a sequence of images capturing its semantic relationships and meanings. Dealing with this task with a single image is arduous, not to mention how difficult it …

Video Captioning

Neural Attention for Image Captioning: Review of Outstanding Methods

2021-11-29 · Zanyar Zohourianshahzadi, Jugal K. Kalita

Image captioning is the task of automatically generating sentences that describe an input image in the best way possible. The most successful techniques for automatically generating image captions have recently used atte…

DecoderDeep LearningImage Captioning

Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation

2025-06-03 · Israa A. Albadarneh, Bassam H. Hammo, Omar S. Al-Kadi

Image captioning involves generating textual descriptions from input images, bridging the gap between computer vision and natural language processing. Recent advancements in transformer-based models have significantly im…

Caption GenerationImage CaptioningScene UnderstandingSurvey

A Thorough Review on Recent Deep Learning Methodologies for Image Captioning

2021-07-28 · Ahmed Elhagry, Karima Kadaoui

Image Captioning is a task that combines computer vision and natural language processing, where it aims to generate descriptive legends for images. It is a two-fold process relying on accurate image understanding and cor…

Caption GenerationDescriptiveImage CaptioningMeta-Learning