Extending Cross-Modal Retrieval with Interactive Learning to Improve Image Retrieval Performance in Forensics
Nowadays, one of the critical challenges in forensics is analyzing the enormous amounts of unstructured digital evidence, such as images. Often, unstructured digital evidence contains precious information for forensic investigations. Therefore, a retrieval system that can effectively identify forensically relevant images is paramount. In this work, we explored the effectiveness of interactive learning in improving image retrieval performance in the forensic domain by proposing Excalibur - a zero-shot cross-modal image retrieval system extended with interactive learning. Excalibur was evaluated using both simulations and a user study. The simulations reveal that interactive learning is highly effective in improving retrieval performance in the forensic domain. Furthermore, user study participants could effectively leverage the power of interactive learning. Finally, they considered Excalibur effective and straightforward to use and expressed interest in using it in their daily practice.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Modal RetrievalImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
Omni-Interactive Universal Embedder
Multimodal representation learning has been shifting from traditional two-tower architectures to large language model (LLM)-based embedders due to their strong instruction-following capabilities. Despite this progress, e…
Representation LearningThe AI Hippocampus: How Far are We From Human Memory?
Memory plays a foundational role in augmenting the reasoning, adaptability, and contextual fidelity of modern Large Language Models and Multi-Modal LLMs. As these models transition from static predictors to interactive s…
Continual LearningCross-Modal Coordination Across a Diverse Set of Input Modalities
Cross-modal retrieval is the task of retrieving samples of a given modality by using queries of a different one. Due to the wide range of practical applications, the problem has been mainly focused on the vision and lang…
Cross-Modal RetrievalImage RetrievalRetrievalCross-modal Retrieval with Improved Graph Convolution
Aiming at the problem that existing image text cross-modal retrieval is difficult to fully exploit the local consistency in the mode in the common subspace, a cross-modal retrieval method based on improved graph convolu…
Cross-Modal RetrievalRepresentation LearningRetrievalSentenceCross-modal Semantic Enhanced Interaction for Image-Sentence Retrieval
Image-sentence retrieval has attracted extensive research attention in multimedia and computer vision due to its promising application. The key issue lies in jointly learning the visual and textual representation to accu…
cross-modal alignmentObjectRetrievalSentence+1