Image Paragraph Captioning
1개 벤치마크 · 논문 17편 · 이 태스크의 논문 보기 →
Benchmarks
Image Paragraph Captioning
Most implemented
A Hierarchical Approach for Generating Descriptive Image Paragraphs
VLIS: Unimodal Language Models Guide Multimodal Language Generation
Matching Visual Features to Hierarchical Semantic Topics for Image Paragraph Captioning
Context-Aware Visual Policy Network for Fine-Grained Image Captioning
Training for Diversity in Image Paragraph Captioning
Papers
VLIS: Unimodal Language Models Guide Multimodal Language Generation
Multimodal language generation, which leverages the synergy of language and vision, is a rapidly expanding field. However, existing vision-language models face challenges in tasks that require complex linguistic understa…
Caption GenerationExplanation GenerationImage Paragraph CaptioningLanguage Modeling+4Enhancing image captioning with depth information using a Transformer-based framework
Captioning images is a challenging scene-understanding task that connects computer vision and natural language processing. While image captioning models have been successful in producing excellent descriptions, the field…
Image CaptioningImage Paragraph CaptioningScene UnderstandingSentenceBypass Network for Semantics Driven Image Paragraph Captioning
Image paragraph captioning aims to describe a given image with a sequence of coherent sentences. Most existing methods model the coherence through the topic transition that dynamically infers a topic vector from precedin…
Image Paragraph CaptioningSentenceVisual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioning
People say, "A picture is worth a thousand words". Then how can we get the rich information out of the image? We argue that by using visual clues to bridge large pretrained vision foundation models and language models, w…
Image Paragraph CaptioningLanguage ModelingLanguage ModellingLarge Language ModelMatching Visual Features to Hierarchical Semantic Topics for Image Paragraph Captioning
Observing a set of images and their corresponding paragraph-captions, a challenging task is to learn how to produce a semantically coherent paragraph to describe the visual content of an image. Inspired by recent success…
Image Paragraph CaptioningLanguage ModelingLanguage ModellingVariational InferenceInteractive Key-Value Memory-augmented Attention for Image Paragraph Captioning
Image paragraph captioning (IPC) aims to generate a fine-grained paragraph to describe the visual content of an image. Significant progress has been made by deep neural networks, in which the attention mechanism plays an…
DecoderImage Paragraph Captioning