Papers Cross-modal retrieval with noisy correspondence
“Cross-modal retrieval with noisy correspondence” 태그가 달린 논문 20편 · 필터 해제
ReCon: Enhancing True Correspondence Discrimination through Relation Consistency for Robust Noisy Correspondence Learning
Can we accurately identify the true correspondences from multimodal datasets containing mismatched data pairs? Existing methods primarily emphasize the similarity matching between the representations of objects across mo…
Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceImage-text matchingImage-text Retrieval+1PC$^2$: Pseudo-Classification Based Pseudo-Captioning for Noisy Correspondence Learning in Cross-Modal Retrieval
In the realm of cross-modal retrieval, seamlessly integrating diverse modalities within multimedia remains a formidable challenge, especially given the complexities introduced by noisy correspondence learning (NCL). Such…
Cross-modal retrieval with noisy correspondenceImage-text RetrievalUGNCL: Uncertainty-Guided Noisy Correspondence Learning for Efficient Cross-Modal Matching
Cross-modal matching has recently gained significant popularity to facilitate retrieval across multi-modal data, and existing works are highly relied on an implicit assumption that the training data pairs are perfectly a…
Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceImage-text matchingImage-text RetrievalMitigating Noisy Correspondence by Geometrical Structure Consistency Learning
Noisy correspondence that refers to mismatches in cross-modal data pairs, is prevalent on human-annotated or web-crawled datasets. Prior approaches to leverage such data mainly consider the application of uni-modal noisy…
Cross-modal retrieval with noisy correspondenceBreaking Through the Noisy Correspondence: A Robust Model for Image-Text Matching
Unleashing the power of image-text matching in real-world applications is hampered by noisy correspondence. Manually curating high-quality datasets is expensive and time-consuming, and datasets generated using diffusion …
Cross-modal retrieval with noisy correspondenceImage-text matchingText MatchingLearning with Noisy Correspondence
This paper studies a new learning paradigm for noisy labels, i.e., noisy correspondence (NC). Unlike the well-studied noisy labels that consider the errors in the category annotation of a sample, the NC refers to the err…
Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceRetrievalText Retrieval+2Cross-modal Retrieval with Noisy Correspondence via Consistency Refining and Mining
The success of existing cross-modal retrieval (CMR) methods heavily rely on the assumption that the annotated cross-modal correspondence is faultless. In practice, however, the correspondence of some pairs would be inevi…
Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceGraph MatchingRetrievalNAC: Mitigating Noisy Correspondence in Cross-Modal Matching Via Neighbor Auxiliary Corrector
The presence of noisy correspondence within cross-modal matching has significantly undermined the performance of existing matching methods. In this paper, we introduce a robust framework named Neighbor Auxiliary Correcto…
Cross-modal retrieval with noisy correspondenceREPAIR: Rank Correlation and Noisy Pair Half-replacing with Memory for Noisy Correspondence
The presence of noise in acquired data invariably leads to performance degradation in cross-modal matching. Unfortunately, obtaining precise annotations in the multimodal field is expensive, which has prompted some metho…
Cross-modal retrieval with noisy correspondenceLearning to Rematch Mismatched Pairs for Robust Cross-Modal Retrieval
Collecting well-matched multimedia datasets is crucial for training cross-modal retrieval models. However, in real-world scenarios, massive multimodal data are harvested from the Internet, which inevitably contains Parti…
Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceRetrievalSemantic Similarity+1Noisy Correspondence Learning with Self-Reinforcing Errors Mitigation
Cross-modal retrieval relies on well-matched large-scale datasets that are laborious in practice. Recently, to alleviate expensive data collection, co-occurring pairs from the Internet are automatically harvested for tra…
Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceMemorizationModel Optimization+1Negative Pre-aware for Noisy Cross-modal Matching
Cross-modal noise-robust learning is a challenging task since noisy correspondence is hard to recognize and rectify. Due to the cumulative and unavoidable negative impact of unresolved noise, existing methods cannot main…
Cross-modal retrieval with noisy correspondenceImage-text matchingImage-to-Text RetrievalLanguage Modelling+1Cross-modal Active Complementary Learning with Self-refining Correspondence
Recently, image-text matching has attracted more and more attention from academia and industry, which is fundamental to understanding the latent correspondence across visual and textual modalities. However, most existing…
Cross-modal retrieval with noisy correspondenceImage-text matchingText MatchingLearning From Noisy Correspondence With Tri-Partition for Cross-Modal Matching
Due to high labeling cost, it is inevitable to introduce a certain proportion of noisy correspondence into visual-text datasets, resulting in poor model robustness for cross-modal matching. Although recent methods divide…
Cross-modal retrieval with noisy correspondenceMemorizationSemantic correspondenceText Matching+1Noisy Correspondence Learning with Meta Similarity Correction
Despite the success of multimodal learning in cross-modal retrieval task, the remarkable progress relies on the correct correspondence among multimedia data. However, collecting such ideal data is expensive and time-cons…
Binary ClassificationCross-Modal RetrievalCross-modal retrieval with noisy correspondenceRetrievalIntegrating Language Guidance Into Image-Text Matching for Correcting False Negatives
Image-Text Matching (ITM) aims to establish the correspondence between images and sentences. ITM is fundamental to various vision and language understanding tasks. However, there are limitations in the way existing ITM b…
Cross-modal retrieval with noisy correspondenceImage-text matchingSentenceText MatchingBiCro: Noisy Correspondence Rectification for Multi-modality Data via Bi-directional Cross-modal Similarity Consistency
As one of the most fundamental techniques in multimodal learning, cross-modal matching aims to project various sensory modalities into a shared feature space. To achieve this, massive and correctly aligned data pairs are…
Cross-modal retrieval with noisy correspondenceImage-text matchingText MatchingCross-Modal Retrieval with Partially Mismatched Pairs
In this paper, we study a challenging but less-touched problem in cross-modal retrieval, i.e., partially mismatched pairs (PMPs). Specifically, in real-world scenarios, a huge number of multimedia data (e.g., the Concept…
Contrastive LearningCross-Modal RetrievalCross-modal retrieval with noisy correspondenceRetrieval+2Deep Evidential Learning with Noisy Correspondence for Cross-Modal Retrieval
Cross-modal retrieval has been a compelling topic in the multimodal community. Recently, to mitigate the high cost of data collection, the co-occurred pairs (e.g., image and text) could be collected from the Internet as …
Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceRetrievalText-based Person Retrieval with Noisy CorrespondenceLearning with Noisy Correspondence for Cross-modal Matching
Cross-modal matching, which aims to establish the correspondence between two different modalities, is fundamental to a variety of tasks such as cross-modal retrieval and vision-and-language understanding. Although a huge…
Cross-Modal RetrievalCross-modal retrieval with noisy correspondenceImage-text matchingMemorization+2