paper-with-me

Papers

Dynamic Cross-Modal Alignment for Robust Semantic Location Prediction

2024-12-13 · Liu Jing, Amirul Rahman

Semantic location prediction from multimodal social media posts is a critical task with applications in personalized services and human mobility analysis. This paper introduces \textit{Contextualized Vision-Language Alignment (CoVLA)}, a discriminative framework designed to address the challenges of contextual ambiguity and modality discrepancy inherent in this task. CoVLA leverages a Contextual Alignment Module (CAM) to enhance cross-modal feature alignment and a Cross-modal Fusion Module (CMF) to dynamically integrate textual and visual information. Extensive experiments on a benchmark dataset demonstrate that CoVLA significantly outperforms state-of-the-art methods, achieving improvements of 2.3\% in accuracy and 2.5\% in F1-score. Ablation studies validate the contributions of CAM and CMF, while human evaluations highlight the contextual relevance of the predictions. Additionally, robustness analysis shows that CoVLA maintains high performance under noisy conditions, making it a reliable solution for real-world applications. These results underscore the potential of CoVLA in advancing semantic location prediction research.

📄 PDF Abstract BibTeX arXiv:2412.09870

Code (0)

등록된 구현이 없습니다.

Tasks

cross-modal alignmentPrediction

Methods 이 논문이 사용한 방법론

CAM Class activation maps could be used to interpret the prediction decision made by the convolutional neural network (CNN). Image source: [Learning Deep Features for…

Similar Papers 제목 키워드 기반

Learning Multi-Modal Mobility Dynamics for Generalized Next Location Recommendation

2025-12-27 · Junshu Dai, Yu Wang, Tongya Zheng, Wei Ji 외 arxiv

The precise prediction of human mobility has produced significant socioeconomic impacts, such as location recommendations and evacuation suggestions. However, existing methods suffer from limited generalization capabilit…

Disentangle and denoise: Tackling context misalignment for video moment retrieval

2024-08-14 · Kaijing Ma, Han Fang, Xianghao Zang, Chao Ban 외

Video Moment Retrieval, which aims to locate in-context video moments according to a natural language query, is an essential task for cross-modal grounding. Existing methods focus on enhancing the cross-modal interaction…

DenoisingDisentanglementMoment RetrievalRetrieval+1

Asymmetric Hierarchical Anchoring for Robust Audio-Visual Cross-Modal Generalization

2026-02-03 · Bixing Wu, Yuhong Zhao, Zongli Ye, Jiachen Lian 외 arxiv

Audio-visual joint representation learning under Cross-Modal Generalization (CMG) aims to transfer knowledge from a labeled source modality to an unlabeled target modality through a unified discrete representation space.…

Representation Learning

Empower Low-Altitude Economy: A Reliability-Aware Dynamic Weighting Allocation for Multi-modal UAV Beam Prediction

2025-12-30 · Haojin Li, Anbang Zhang, Chen Sun, Chenyuan Feng 외 arxiv

The low-altitude economy (LAE) is rapidly expanding driven by urban air mobility, logistics drones, and aerial sensing, while fast and accurate beam prediction in uncrewed aerial vehicles (UAVs) communications is crucial…

Contrastive LearningBeam Prediction

Learning to Model Multimodal Semantic Alignment for Story Visualization

2022-11-14 · Bowen Li, Thomas Lukasiewicz

Story visualization aims to generate a sequence of images to narrate each sentence in a multi-sentence story, where the images should be realistic and keep global consistency across dynamic scenes and characters. Current…

DiversitySentenceStory Visualization