Papers Image Paragraph Captioning
“Image Paragraph Captioning” 태그가 달린 논문 17편 · 필터 해제
VLIS: Unimodal Language Models Guide Multimodal Language Generation
Multimodal language generation, which leverages the synergy of language and vision, is a rapidly expanding field. However, existing vision-language models face challenges in tasks that require complex linguistic understa…
Caption GenerationExplanation GenerationImage Paragraph CaptioningLanguage Modeling+4Enhancing image captioning with depth information using a Transformer-based framework
Captioning images is a challenging scene-understanding task that connects computer vision and natural language processing. While image captioning models have been successful in producing excellent descriptions, the field…
Image CaptioningImage Paragraph CaptioningScene UnderstandingSentenceBypass Network for Semantics Driven Image Paragraph Captioning
Image paragraph captioning aims to describe a given image with a sequence of coherent sentences. Most existing methods model the coherence through the topic transition that dynamically infers a topic vector from precedin…
Image Paragraph CaptioningSentenceVisual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioning
People say, "A picture is worth a thousand words". Then how can we get the rich information out of the image? We argue that by using visual clues to bridge large pretrained vision foundation models and language models, w…
Image Paragraph CaptioningLanguage ModelingLanguage ModellingLarge Language ModelMatching Visual Features to Hierarchical Semantic Topics for Image Paragraph Captioning
Observing a set of images and their corresponding paragraph-captions, a challenging task is to learn how to produce a semantically coherent paragraph to describe the visual content of an image. Inspired by recent success…
Image Paragraph CaptioningLanguage ModelingLanguage ModellingVariational InferenceInteractive Key-Value Memory-augmented Attention for Image Paragraph Captioning
Image paragraph captioning (IPC) aims to generate a fine-grained paragraph to describe the visual content of an image. Significant progress has been made by deep neural networks, in which the attention mechanism plays an…
DecoderImage Paragraph CaptioningWhen an Image Tells a Story: The Role of Visual and Semantic Information for Generating Paragraph Descriptions
Generating multi-sentence image descriptions is a challenging task, which requires a good model to produce coherent and accurate paragraphs, describing salient objects in the image. We argue that multiple sources of info…
Image Paragraph CaptioningSentenceHierarchical Scene Graph Encoder-Decoder for Image Paragraph Captioning
When we humans tell a long paragraph about an image, we usually first implicitly compose a mental “script” and then comply with it to generate the paragraph. Inspired by this, we render the modern encoder-decoder base…
DecoderImage Paragraph CaptioningSentenceImproving Diversity and Reducing Redundancy in Paragraph Captions
The purpose of an image paragraph captioning model is to produce detailed descriptions of the source images. Generally, paragraph captioning models use encoder-decoder based architectures similar to the standard image…
DecoderDense CaptioningDiversityImage Captioning+1Dual-CNN: A Convolutional language decoder for paragraph image captioning
Abstract The task of paragraph image captioning aims to generate a coherent paragraph describing a given image. However, due to their limited ability to capture long-term dependency, recurrent neural network or long-shor…
DecoderDiversityImage CaptioningImage Paragraph CaptioningConvolutional Auto-encoding of Sentence Topics for Image Paragraph Generation
Image paragraph generation is the task of producing a coherent story (usually a paragraph) that describes the visual content of an image. The problem nevertheless is not trivial especially when there are multiple descrip…
DescriptiveImage Paragraph CaptioningSentencevalidContext-Aware Visual Policy Network for Fine-Grained Image Captioning
With the maturity of visual detection techniques, we are more ambitious in describing visual content with open-vocabulary, fine-grained and free-form language, i.e., the task of image captioning. In particular, we are in…
Image CaptioningImage Paragraph CaptioningSentenceText GenerationLook Deeper See Richer: Depth-aware Image Paragraph Captioning
With the widespread availability of image captioning at a sentence level, how to automatically generate image paragraphs is yet well explored. Describing an image by a full paragraph involves organising sentences orderly…
DecoderImage CaptioningImage Paragraph CaptioningSentenceTraining for Diversity in Image Paragraph Captioning
Image paragraph captioning models aim to produce detailed descriptions of a source image. These models use similar techniques as standard image captioning models, but they have encountered issues in text generation, nota…
DiversityImage CaptioningImage Paragraph CaptioningMachine Translation+3Diverse and Coherent Paragraph Generation from Images
Paragraph generation from images, which has gained popularity recently, is an important task for video summarization, editing, and support of the disabled. Traditional image captioning methods fall short on this front, s…
DiversityImage CaptioningImage Paragraph CaptioningVideo SummarizationRecurrent Topic-Transition GAN for Visual Paragraph Generation
A natural image usually conveys rich semantic content and can be viewed from different angles. Existing image description methods are largely restricted by small sets of biased visual paragraph annotations, and fail to c…
Generative Adversarial NetworkImage DescriptionImage Paragraph CaptioningSentenceA Hierarchical Approach for Generating Descriptive Image Paragraphs
Recent progress on image captioning has made it possible to generate novel sentences describing images in natural language, but compressing an image into a single sentence can describe visual content in only coarse detai…
Dense CaptioningDescriptiveImage CaptioningImage Paragraph Captioning+1