Papers image-sentence alignment
“image-sentence alignment” 태그가 달린 논문 3편 · 필터 해제
VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena
2021-12-14 · ACL 2022 5
· Letitia Parcalabescu, Michele Cafagna, Lilitta Muradjan, Anette Frank 외
We propose VALSE (Vision And Language Structured Evaluation), a novel benchmark designed for testing general-purpose pretrained vision and language (V&L) models for their visio-linguistic grounding capabilities on specif…
image-sentence alignmentvalidRemoving Word-Level Spurious Alignment between Images and Pseudo-Captions in Unsupervised Image Captioning
2021-04-28 · EACL 2021 2
· Ukyo Honda, Yoshitaka Ushiku, Atsushi Hashimoto, Taro Watanabe 외
Unsupervised image captioning is a challenging task that aims at generating captions without the supervision of image-sentence pairs, but only with images and sentences drawn from different sources and object labels dete…
Image Captioningimage-sentence alignmentObjectSentenceFrom Images to Sentences through Scene Description Graphs using Commonsense Reasoning and Knowledge
2015-11-10
· Somak Aditya, Yezhou Yang, Chitta Baral, Cornelia Fermuller 외
In this paper we propose the construction of linguistic descriptions of images. This is achieved through the extraction of scene description graphs (SDGs) from visual scenes using an automatically constructed knowledge b…
image-sentence alignmentSentence
1–3 / 3