Papers controllable image captioning
“controllable image captioning” 태그가 달린 논문 14편 · 필터 해제
From Simple to Professional: A Combinatorial Controllable Image Captioning Agent
The Controllable Image Captioning Agent (CapAgent) is an innovative system designed to bridge the gap between user simplicity and professional-level outputs in image captioning tasks. CapAgent automatically transforms us…
Caption Generationcontrollable image captioningImage Captioningobject-detection+1CIC-BART-SSA: Controllable Image Captioning with Structured Semantic Augmentation
Controllable Image Captioning (CIC) aims at generating natural language descriptions for an image, conditioned on information provided by end users, e.g., regions, entities or events of interest. However, available image…
controllable image captioningData AugmentationDiversityImage CaptioningCaption Anything: Interactive Image Description with Diverse Multimodal Controls
Controllable image captioning is an emerging multimodal topic that aims to describe the image with natural language following human purpose, $\textit{e.g.}$, looking at the specified regions or telling in a particular te…
controllable image captioningImage CaptioningImage DescriptionInstruction FollowingLearning Combinatorial Prompts for Universal Controllable Image Captioning
Controllable Image Captioning (CIC) -- generating natural language descriptions about images under the guidance of given control signals -- is one of the most promising directions towards next-generation captioning syste…
controllable image captioningImage CaptioningLanguage ModelingLanguage Modelling+1Controllable Image Captioning via Prompting
Despite the remarkable progress of image captioning, existing captioners typically lack the controllable capability to generate desired image captions, e.g., describing the image in a rough or detailed manner, in a factu…
controllable image captioningImage CaptioningPrompt EngineeringPrompt LearningCLID: Controlled-Length Image Descriptions with Limited Data
Controllable image captioning models generate human-like image descriptions, enabling some kind of control over the generated captions. This paper focuses on controlling the caption length, i.e. a short and concise descr…
controllable image captioningImage CaptioningControllable Image Captioning
State-of-the-art image captioners can generate accurate sentences to describe images in a sequence to sequence manner without considering the controllability and interpretability. This, however, is far from making image …
controllable image captioningDecoderImage CaptioningPOS+1Self-Annotated Training for Controllable Image Captioning
The Controllable Image Captioning (CIC) task aims to generate captions conditioned on designated control signals. Several structure-related control signals are proposed to control the semantic structure of sentences, suc…
controllable image captioningImage CaptioningSentenceTAGHuman-like Controllable Image Captioning with Verb-specific Semantic Roles
Controllable Image Captioning (CIC) -- generating image descriptions following designated control signals -- has received unprecedented attention over the last few years. To emulate the human ability in controlling capti…
Caption Generationcontrollable image captioningDescriptiveImage Captioning+2Language-Driven Region Pointer Advancement for Controllable Image Captioning
Controllable Image Captioning is a recent sub-field in the multi-modal task of Image Captioning wherein constraints are placed on which regions in an image should be described in the generated natural language caption. T…
controllable image captioningImage CaptioningSentenceLength-Controllable Image Captioning
The last decade has witnessed remarkable progress in the image captioning task; however, most existing methods cannot control their captions, \emph{e.g.}, choosing to describe the image either roughly or in detail. In th…
controllable image captioningDecoderDiversityImage CaptioningCross-modal Coherence Modeling for Caption Generation
We use coherence relations inspired by computational models of discourse to study the information needs and goals of image captioning. Using an annotation protocol specifically devised for capturing image{--}caption cohe…
Caption Generationcontrollable image captioningImage CaptioningRelation+1Clue: Cross-modal Coherence Modeling for Caption Generation
We use coherence relations inspired by computational models of discourse to study the information needs and goals of image captioning. Using an annotation protocol specifically devised for capturing image--caption cohere…
Caption Generationcontrollable image captioningImage CaptioningRelation+1Show, Control and Tell: A Framework for Generating Controllable and Grounded Captions
Current captioning approaches can describe images using black-box architectures whose behavior is hardly controllable and explainable from the exterior. As an image can be described in infinite ways depending on the goal…
controllable image captioningDiversityImage Captioning