Papers Multimodal Association
“Multimodal Association” 태그가 달린 논문 7편 · 필터 해제
MASS: Overcoming Language Bias in Image-Text Matching
Pretrained visual-language models have made significant advancements in multimodal tasks, including image-text retrieval. However, a major challenge in image-text matching lies in language bias, where models predominantl…
Image-text matchingImage-text RetrievalMultimodal AssociationRetrieval+2Personalized 2D Binary Patient Codes of Tissue Images and Immunogenomic Data Through Multimodal Self-Supervised Fusion
The field of medical diagnostics has witnessed a transformative convergence of artificial intelligence (AI) and healthcare data, offering promising avenues for enhancing patient care and disease comprehension. However, t…
Multimodal Associationwhole slide imagesViTag: Online WiFi Fine Time Measurements Aided Vision-Motion Identity Association in Multi-person Environments
In this paper, we present ViTag to associate user identities across multimodal data, particularly those obtained from cameras and smartphones. ViTag associates a sequence of vision tracker generated bounding boxes with I…
DecoderMultimodal AssociationTranslationWinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
While vision-and-language models perform well on tasks such as visual question answering, they struggle when it comes to basic human commonsense reasoning skills. In this work, we introduce WinoGAViL: an online game of v…
Common Sense ReasoningGeneral KnowledgeMultimodal AssociationQuestion Answering+3Vi-Fi: Associating Moving Subjects across Vision and Wireless Sensors
In this paper, we present Vi-Fi, a multi-modal system that leverages a user’s smartphone WiFi Fine Timing Measurements (FTM) and inertial measurement unit (IMU) sensor data to associate the user detected on a camera foot…
Graph MatchingMultimodal AssociationA unified software/hardware scalable architecture for brain-inspired computing based on self-organizing neural models
The field of artificial intelligence has significantly advanced over the past decades, inspired by discoveries from the fields of biology and neuroscience. The idea of this work is inspired by the process of self-organiz…
GPUMultimodal AssociationBrain-inspired self-organization with cellular neuromorphic computing for multimodal unsupervised learning
Cortical plasticity is one of the main features that enable our ability to learn and adapt in our environment. Indeed, the cerebral cortex self-organizes itself through structural and synaptic plasticity mechanisms that …
Distributed ComputingMultimodal Association