Papers Text Matching
“Text Matching” 태그가 달린 논문 364편 · 필터 해제
MouSi: Poly-Visual-Expert Vision-Language Models
Current large vision-language models (VLMs) often encounter challenges such as insufficient capabilities of a single visual component and excessively long visual tokens. These issues can limit the model's effectiveness i…
Image SegmentationImage-text matchingOptical Character Recognition (OCR)Semantic Segmentation+2Beyond Image-Text Matching: Verb Understanding in Multimodal Transformers Using Guided Masking
The dominant probing approaches rely on the zero-shot performance of image-text matching tasks to gain a finer-grained understanding of the representations learned by recent multimodal image-language transformer models. …
Image-text matchingText MatchingGPT4Ego: Unleashing the Potential of Pre-trained Models for Zero-Shot Egocentric Action Recognition
Vision-Language Models (VLMs), pre-trained on large-scale datasets, have shown impressive performance in various visual recognition tasks. This advancement paves the way for notable performance in Zero-Shot Egocentric Ac…
Action RecognitionText MatchingEnhancing Image-Text Matching with Adaptive Feature Aggregation
Image-text matching aims to find matched cross-modal pairs accurately. While current methods often rely on projecting cross-modal features into a common embedding space, they frequently suffer from imbalanced feature rep…
Image-text matchingImage-text RetrievalRetrievalText Matching+2Contrastive Learning With Audio Discrimination For Customizable Keyword Spotting In Continuous Speech
Customizable keyword spotting (KWS) in continuous speech has attracted increasing attention due to its real-world application potential. While contrastive learning (CL) has been widely used to extract keyword representat…
Contrastive LearningKeyword SpottingText MatchingCoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs
When exploring the development of Artificial General Intelligence (AGI), a critical task for these models involves interpreting and processing information from multiple image inputs. However, Large Multimodal Models (LMM…
Image ComprehensionImage to textText MatchingVisual ReasoningBackdoor Attack on Unpaired Medical Image-Text Foundation Models: A Pilot Study on MedCLIP
In recent years, foundation models (FMs) have solidified their role as cornerstone advancements in the deep learning domain. By extracting intricate patterns from vast datasets, these models consistently achieve state-of…
Backdoor AttackContrastive LearningImage-text matchingText MatchingSRTube: Video-Language Pre-Training with Action-Centric Video Tube Features and Semantic Role Labeling
In recent years large-scale video-language pre-training (VidLP) has received considerable attention for its effectiveness in relevant tasks. In this paper we propose a novel action-centric VidLP framework that employ…
Semantic Role LabelingText MatchingA Dual-way Enhanced Framework from Text Matching Point of View for Multimodal Entity Linking
Multimodal Entity Linking (MEL) aims at linking ambiguous mentions with multimodal information to entity in Knowledge Graph (KG) such as Wikipedia, which plays a key role in many applications. However, existing methods s…
Entity LinkingText MatchingOT-Attack: Enhancing Adversarial Transferability of Vision-Language Models via Optimal Transport Optimization
Vision-language pre-training (VLP) models demonstrate impressive abilities in processing both images and text. However, they are vulnerable to multi-modal adversarial examples (AEs). Investigating the generation of high-…
Adversarial AttackData AugmentationImage-text matchingText MatchingCILF-CIAE: CLIP-driven Image-Language Fusion for Correcting Inverse Age Estimation
The age estimation task aims to predict the age of an individual by analyzing facial features in an image. The development of age estimation can improve the efficiency and accuracy of various applications (e.g., age veri…
Age EstimationImage-text matchingText MatchingZero-Shot LearningEmergent Open-Vocabulary Semantic Segmentation from Off-the-shelf Vision-Language Models
From image-text pairs, large-scale vision-language models (VLMs) learn to implicitly associate image regions with words, which prove effective for tasks like visual question answering. However, leveraging the learned ass…
Image CaptioningImage-text matchingOpen Vocabulary Semantic SegmentationOpen-Vocabulary Semantic Segmentation+5Tracing Influence at Scale: A Contrastive Learning Approach to Linking Public Comments and Regulator Responses
U.S. Federal Regulators receive over one million comment letters each year from businesses, interest groups, and members of the public, all advocating for changes to proposed regulations. These comments are believed to h…
Contrastive LearningLanguage ModelingLanguage ModellingText MatchingMMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts
Advances in multimodal models have greatly improved how interactions relevant to various tasks are modeled. Today's multimodal models mainly focus on the correspondence between images and text, using this for tasks like …
Binary ClassificationDescriptiveHumor DetectionImage-text matching+3Active Mining Sample Pair Semantics for Image-text Matching
Recently, commonsense learning has been a hot topic in image-text matching. Although it can describe more graphic correlations, commonsense learning still has some shortcomings: 1) The existing methods are based on tripl…
Active LearningImage-text matchingSemantic SimilaritySemantic Textual Similarity+2A New Fine-grained Alignment Method for Image-text Matching
Image-text retrieval is a widely studied topic in the field of computer vision due to the exponential growth of multimedia data, whose core concept is to measure the similarity between images and text. However, most exis…
Image-text matchingImage-text RetrievalRetrievalText Matching+1Text Augmented Spatial-aware Zero-shot Referring Image Segmentation
In this paper, we study a challenging task of zero-shot referring image segmentation. This task aims to identify the instance mask that is most related to a referring expression without training on pixel-level annotation…
Image SegmentationReferring ExpressionSegmentationSemantic Segmentation+2Cross-modal Active Complementary Learning with Self-refining Correspondence
Recently, image-text matching has attracted more and more attention from academia and industry, which is fundamental to understanding the latent correspondence across visual and textual modalities. However, most existing…
Cross-modal retrieval with noisy correspondenceImage-text matchingText MatchingCPSeg: Finer-grained Image Semantic Segmentation via Chain-of-Thought Language Prompting
Natural scene analysis and remote sensing imagery offer immense potential for advancements in large-scale language-guided context-aware data utilization. This potential is particularly significant for enhancing performan…
Image Segmentationobject-detectionObject DetectionSegmentation+2Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification
Text-to-image person re-identification (TIReID) retrieves pedestrian images of the same identity based on a query text. However, existing methods for TIReID typically treat it as a one-to-one image-text matching problem,…
Image RetrievalImage-text matchingPerson Re-IdentificationText Matching