Papers Text Matching
“Text Matching” 태그가 달린 논문 364편 · 필터 해제
RETTA: Retrieval-Enhanced Test-Time Adaptation for Zero-Shot Video Captioning
Despite the significant progress of fully-supervised video captioning, zero-shot methods remain much less explored. In this paper, we propose a novel zero-shot video captioning framework named Retrieval-Enhanced Test-Tim…
Image-text matchingRetrievalTest-time AdaptationText Generation+5COM3D: Leveraging Cross-View Correspondence and Cross-Modal Mining for 3D Retrieval
In this paper, we investigate an open research task of cross-modal retrieval between 3D shapes and textual descriptions. Previous approaches mainly rely on point cloud encoders for feature extraction, which may ignore ke…
Cross-Modal RetrievalRetrievalText MatchingBreaking Through the Noisy Correspondence: A Robust Model for Image-Text Matching
Unleashing the power of image-text matching in real-world applications is hampered by noisy correspondence. Manually curating high-quality datasets is expensive and time-consuming, and datasets generated using diffusion …
Cross-modal retrieval with noisy correspondenceImage-text matchingText MatchingDeep Boosting Learning: A Brand-new Cooperative Approach for Image-Text Matching
Image-text matching remains a challenging task due to heterogeneous semantic diversity across modalities and insufficient distance separability within triplets. Different from previous approaches focusing on enhancing mu…
Contrastive LearningImage-text matchingText MatchingTransfer LearningModeling Selective Feature Attention for Representation-based Siamese Text Matching
Representation-based Siamese networks have risen to popularity in lightweight text matching due to their low deployment and inference costs. While word-level attention mechanisms have been implemented within Siamese netw…
Text MatchingFINEMATCH: Aspect-based Fine-grained Image and Text Mismatch Detection and Correction
Recent progress in large-scale pre-training has led to the development of advanced vision-language models (VLMs) with remarkable proficiency in comprehending and generating multimodal content. Despite the impressive abil…
HallucinationImage GenerationIn-Context LearningText Matching+2Narrative Action Evaluation with Prompt-Guided Multimodal Interaction
In this paper, we investigate a new problem called narrative action evaluation (NAE). NAE aims to generate professional commentary that evaluates the execution of an action. Unlike traditional tasks such as score-based a…
Action Quality Assessmentmultimodal interactionMulti-Task LearningText Matching+1Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
There has been significant attention to the research on dense video captioning, which aims to automatically localize and caption all events within untrimmed video. Several studies introduce methods by designing dense vid…
DecoderDense Video CaptioningRetrievalText Matching+1Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems
Large language models (LLMs) are trained on text-only data that go far beyond the languages with paired speech and text data. At the same time, Dual Encoder (DE) based retrieval systems project queries and documents into…
Machine TranslationRetrievalText MatchingSyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining
Vision-language models (VLMs) have made significant strides in cross-modal understanding through large-scale paired datasets. However, in fashion domain, datasets often exhibit a disparity between the information conveye…
Contrastive LearningImage-text matchingLanguage ModelingLanguage Modelling+2FSMR: A Feature Swapping Multi-modal Reasoning Approach with Joint Textual and Visual Clues
Multi-modal reasoning plays a vital role in bridging the gap between textual and visual information, enabling a deeper understanding of the context. This paper presents the Feature Swapping Multi-modal Reasoning (FSMR) m…
Image-text matchingLanguage ModelingLanguage ModellingText MatchingAre LLMs Effective Backbones for Fine-tuning? An Experimental Investigation of Supervised LLMs on Chinese Short Text Matching
The recent success of Large Language Models (LLMs) has garnered significant attention in both academia and industry. Prior research on LLMs has primarily focused on enhancing or leveraging their generalization capabiliti…
Natural Language UnderstandingText MatchingConstructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models
Large language models (LLMs) have increased interest in vision language models (VLMs), which process image-text pairs as input. Studies investigating the visual understanding ability of VLMs have been proposed, but such …
Image-text matchingObject RecognitionText MatchingPointCloud-Text Matching: Benchmark Datasets and a Baseline
In this paper, we present and study a new instance-level retrieval task: PointCloud-Text Matching~(PTM), which aims to find the exact cross-modal instance that matches a given point-cloud query or text query. PTM could b…
Contrastive LearningRetrievalText MatchingRadCLIP: Enhancing Radiologic Image Analysis through Contrastive Language-Image Pre-training
The integration of artificial intelligence (AI) with radiology marks a transformative era in medicine. Vision foundation models have been adopted to enhance radiologic imaging analysis. However, the distinct complexities…
Diagnosticimage-classificationImage ClassificationImage-text matching+1MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasets
Development of multimodal interactive systems is hindered by the lack of rich, multimodal (text, images) conversational data, which is needed in large quantities for LLMs. Previous approaches augment textual dialogues wi…
DiversityImage DescriptionImage-text matchingRetrieval+1Best of Both Worlds: A Pliable and Generalizable Neuro-Symbolic Approach for Relation Classification
This paper introduces a novel neuro-symbolic architecture for relation classification (RC) that combines rule-based methods with contemporary deep learning techniques. This approach capitalizes on the strengths of both p…
Few-Shot Relation ClassificationRelationRelation ClassificationSemantic Text Matching+1Image-Text Matching with Multi-View Attention
Existing two-stream models for image-text matching show good performance while ensuring retrieval speed and have received extensive attention from industry and academia. These methods use a single representation to encod…
DiversityImage-text matchingRetrievalText MatchingMulti-Intent Attribute-Aware Text Matching in Searching
Text matching systems have become a fundamental service in most searching platforms. For instance, they are responsible for matching user queries to relevant candidate items, or rewriting the user-input query to a pre-se…
AttributeText MatchingColorSwap: A Color and Word Order Dataset for Multimodal Evaluation
This paper introduces the ColorSwap dataset, designed to assess and improve the proficiency of multimodal models in matching objects with their colors. The dataset is comprised of 2,000 unique image-caption pairs, groupe…
Image GenerationImage-text matchingText Matching