paper-with-me

홈 › Papers

CureGraph: Contrastive Multi-Modal Graph Representation Learning for Urban Living Circle Health Profiling and Prediction

2025-01-13 · Jinlin Li, Xiao Zhou

The early detection and prediction of health status decline among the elderly at the neighborhood level are of great significance for urban planning and public health policymaking. While existing studies affirm the connection between living environments and health outcomes, most rely on single data modalities or simplistic feature concatenation of multi-modal information, limiting their ability to comprehensively profile the health-oriented urban environments. To fill this gap, we propose CureGraph, a contrastive multi-modal representation learning framework for urban health prediction that employs graph-based techniques to infer the prevalence of common chronic diseases among the elderly within the urban living circles of each neighborhood. CureGraph leverages rich multi-modal information, including photos and textual reviews of residential areas and their surrounding points of interest, to generate urban neighborhood embeddings. By integrating pre-trained visual and textual encoders with graph modeling techniques, CureGraph captures cross-modal spatial dependencies, offering a comprehensive understanding of urban environments tailored to elderly health considerations. Extensive experiments on real-world datasets demonstrate that CureGraph improves the best baseline by $28\%$ on average in terms of $R^2$ across elderly disease risk prediction tasks. Moreover, the model enables the identification of stage-wise chronic disease progression and supports comparative public health analysis across neighborhoods, offering actionable insights for sustainable urban development and enhanced quality of life. The code is publicly available at https://github.com/jinlin2021/CureGraph.

📄 PDF Abstract BibTeX arXiv:2501.07157

Code (1)

jinlin2021/curegraph 공식 구현 pytorch

Tasks

Graph Representation LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis

2022-10-01 · COLING 2022 10 · Zijie Lin, Bin Liang, Yunfei Long, Yixue Dang 외

The existing research efforts in Multimodal Sentiment Analysis (MSA) have focused on developing the expressive ability of neural networks to fuse information from different modalities. However, these approaches lack a me…

Contrastive LearningMultimodal Sentiment AnalysisSentiment Analysis

Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition

2023-11-18 · Dongyuan Li, Yusong Wang, Kotaro Funakoshi, Manabu Okumura

Multimodal emotion recognition aims to recognize emotions for each utterance of multiple modalities, which has received increasing attention for its application in human-machine interaction. Current graph-based methods f…

Contrastive LearningEmotion RecognitionEmotion Recognition in ConversationFace Swapping+1

UNIGEOCLIP: Unified Geospatial Contrastive Learning

2026-04-13 · Guillaume Astruc, Eduard Trulls, Jan Hosang, Loic Landrieu 외 arxiv

The growing availability of co-located geospatial data spanning aerial imagery, street-level views, elevation models, text, and geographic coordinates offers a unique opportunity for multimodal representation learning. W…

Representation LearningContrastive Learning

Adversarial Representation with Intra-Modal and Inter-Modal Graph Contrastive Learning for Multimodal Emotion Recognition

2023-12-28 · Yuntao Shou, Tao Meng, Wei Ai, Nan Yin 외

With the release of increasing open-source emotion recognition datasets on social media platforms and the rapid development of computing resources, multimodal emotion recognition tasks (MER) have begun to receive widespr…

Contrastive LearningEmotion RecognitionGraph Representation LearningMultimodal Emotion Recognition+1

Multimodal Representation Learning using Adaptive Graph Construction

2024-10-08 · Weichen Huang

Multimodal contrastive learning train neural networks by levergaing data from heterogeneous sources such as images and text. Yet, many current multimodal learning architectures cannot generalize to an arbitrary number of…

Contrastive Learninggraph constructionRepresentation Learning