Papers Text Matching
“Text Matching” 태그가 달린 논문 364편 · 필터 해제
Towards Deconfounded Image-Text Matching with Causal Inference
Prior image-text matching methods have shown remarkable performance on many benchmark datasets, but most of them overlook the bias in the dataset, which exists in intra-modal and inter-modal, and tend to learn the spurio…
Causal InferenceImage-text matchingText MatchingDynamic and Compressive Adaptation of Transformers From Images to Videos
Recently, the remarkable success of pre-trained Vision Transformers (ViTs) from image-text matching has sparked an interest in image-to-video adaptation. However, most current approaches retain the full forward pass for …
Image-text matchingText MatchingTeach CLIP to Develop a Number Sense for Ordinal Regression
Ordinal regression is a fundamental problem within the field of computer vision, with customised well-trained models on specific tasks. While pre-trained vision-language models (VLMs) have exhibited impressive performanc…
regressionText MatchingQAEA-DR: A Unified Text Augmentation Framework for Dense Retrieval
In dense retrieval, embedding long texts into dense vectors can result in information loss, leading to inaccurate query-text matching. Additionally, low-quality texts with excessive noise or sparse key information are un…
Answer GenerationEvent ExtractionQuestion-Answer-GenerationRetrieval+5Image-text matching for large-scale book collections
We address the problem of detecting and mapping all books in a collection of images to entries in a given book catalogue. Instead of performing independent retrieval for each book detected, we treat the image-text mappin…
Image-text matchingOptical Character Recognition (OCR)Text MatchingDeep Bag-of-Words Model: An Efficient and Interpretable Relevance Architecture for Chinese E-Commerce
Text relevance or text matching of query and product is an essential technique for the e-commerce search system to ensure that the displayed products can match the intent of the query. Many studies focus on improving the…
Computational EfficiencyLanguage ModellingText MatchingColPali: Efficient Document Retrieval with Vision Language Models
Documents are visually rich structures that convey information through text, but also figures, page layouts, tables, or even fonts. Since modern retrieval systems mainly rely on the textual information they extract from …
document understandingRAGRetrievalRetrieval-augmented Generation+1Efficient and Long-Tailed Generalization for Pre-trained Vision-Language Model
Pre-trained vision-language models like CLIP have shown powerful zero-shot inference ability via image-text matching and prove to be strong few-shot learners in various downstream tasks. However, in real-world scenarios,…
Image-text matchingLanguage ModelingLanguage ModellingText MatchingComposing Object Relations and Attributes for Image-Text Matching
We study the visual semantic embedding problem for image-text matching. Most existing work utilizes a tailored cross-attention mechanism to perform local alignment across the two image and text modalities. This is comput…
AttributeGraph AttentionImage-text matchingImage-text Retrieval+4Generative Visual Instruction Tuning
We propose to use automatically generated instruction-following data to improve the zero-shot capabilities of a large multimodal model with additional support for generative and image editing tasks. We achieve this by cu…
Image GenerationImage-text matchingInstruction FollowingLanguage Modeling+4Advanced Multimodal Deep Learning Architecture for Image-Text Matching
Image-text matching is a key multimodal task that aims to model the semantic association between images and text as a matching relationship. With the advent of the multimedia information age, image, and text data show ex…
Deep LearningImage-text matchingMultimodal Deep LearningSemantic correspondence+1Hire: Hybrid-modal Interaction with Multiple Relational Enhancements for Image-Text Matching
Image-text matching (ITM) is a fundamental problem in computer vision. The key issue lies in jointly learning the visual and textual representation to estimate their similarity accurately. Most existing methods focus on …
cross-modal alignmentImage-text matchingRelationship DetectionText MatchingRobust Interaction-Based Relevance Modeling for Online e-Commerce Search
Semantic relevance calculation is crucial for e-commerce search engines, as it ensures that the items selected closely align with customer intent. Inadequate attention to this aspect can detrimentally affect user experie…
RetrievalSentenceText MatchingHybrid-Learning Video Moment Retrieval across Multi-Domain Labels
Video moment retrieval (VMR) is to search for a visual temporal moment in an untrimmed raw video by a given text query description (sentence). Existing studies either start from collecting exhaustive frame-wise annotatio…
Moment RetrievalRetrievalSentenceText Matching+1FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs
Fact-checking is a crucial natural language processing (NLP) task that verifies the truthfulness of claims by considering reliable evidence. Traditional methods are often limited by labour-intensive data curation and rul…
Fact CheckingFact VerificationKnowledge GraphsText MatchingLLMs and Memorization: On Quality and Specificity of Copyright Compliance
Memorization in large language models (LLMs) is a growing concern. LLMs have been shown to easily reproduce parts of their training data, including copyrighted work. This is an important problem to solve, as it may viola…
HallucinationMemorizationSpecificityText MatchingDEMO: A Statistical Perspective for Efficient Image-Text Matching
Image-text matching has been a long-standing problem, which seeks to connect vision and language through semantic understanding. Due to the capability to manage large-scale raw data, unsupervised hashing-based approaches…
Image-text matchingModel OptimizationSemantic SimilaritySemantic Textual Similarity+1Revisiting Deep Audio-Text Retrieval Through the Lens of Transportation
The Learning-to-match (LTM) framework proves to be an effective inverse optimal transport approach for learning the underlying ground metric between two sources of data, facilitating subsequent matching. However, the con…
AudioCapsEvent DetectionRetrievalSound Event Detection+3Content-Based Image Retrieval for Multi-Class Volumetric Radiology Images: A Benchmark Study
While content-based image retrieval (CBIR) has been extensively studied in natural image retrieval, its application to medical images presents ongoing challenges, primarily due to the 3D nature of medical images. Recent …
Content-Based Image RetrievalImage RetrievalRe-RankingRetrieval+1CLIP-Powered TASS: Target-Aware Single-Stream Network for Audio-Visual Question Answering
While vision-language pretrained models (VLMs) excel in various multimodal understanding tasks, their potential in fine-grained audio-visual reasoning, particularly for audio-visual question answering (AVQA), remains lar…
Audio-visual Question AnsweringAudio-Visual Question Answering (AVQA)Image-text matchingQuestion Answering+3