paper-with-me

Papers Semantic Image-Text Similarity

“Semantic Image-Text Similarity” 태그가 달린 논문 4편 · 필터 해제

Visual-Text Cross Alignment: Refining the Similarity Score in Vision-Language Models

2024-06-05 · Jinhao Li, Haopeng Li, Sarah Erfani, Lei Feng 외

It has recently been discovered that using a pre-trained vision-language model (VLM), e.g., CLIP, to align a whole query image with several finer text descriptions generated by a large language model can significantly en…

Few-Shot LearningLanguage ModelingLanguage ModellingLarge Language Model+3

Linguistic-Aware Patch Slimming Framework for Fine-grained Cross-Modal Alignment

2024-01-01 · CVPR 2024 1 · Zheren Fu, Lei Zhang, Hou Xia, Zhendong Mao

Cross-modal alignment aims to build a bridge connecting vision and language. It is an important multi-modal task that efficiently learns the semantic similarities between images and texts. Traditional fine-grained al…

cross-modal alignmentCross-Modal RetrievalImage RetrievalImage-to-Text Retrieval+4

MURAL: Multimodal, Multitask Retrieval Across Languages

2021-09-10 · Aashi Jain, Mandy Guo, Krishna Srinivasan, Ting Chen 외

Both image-caption pairs and translation pairs provide the means to learn deep representations of and connections between languages. We use both types of pairs in MURAL (MUltimodal, MUltitask Representations Across Langu…

Cross-Modal RetrievalImage-text matchingRetrievalSemantic Image Similarity+4

Learning the Best Pooling Strategy for Visual Semantic Embedding

2020-11-09 · CVPR 2021 1 · Jiacheng Chen, Hexiang Hu, Hao Wu, Yuning Jiang 외

Visual Semantic Embedding (VSE) is a dominant approach for vision-language retrieval, which aims at learning a deep embedding space such that visual data are embedded close to their semantic text labels or descriptions. …

Cross-Modal Information RetrievalImage-text RetrievalRetrievalSemantic Image-Text Similarity+2
1–4 / 4