paper-with-me

홈 › Papers

Breaking Data Silos: Towards Open and Scalable Mobility Foundation Models via Generative Continual Learning

2025-06-07 · Yuan Yuan, Yukun Liu, Chonghua Han, Jie Feng, Yong Li

Foundation models have revolutionized fields such as natural language processing and computer vision by enabling general-purpose learning across diverse tasks and datasets. However, building analogous models for human mobility remains challenging due to the privacy-sensitive nature of mobility data and the resulting data silos across institutions. To bridge this gap, we propose MoveGCL, a scalable and privacy-preserving framework for training mobility foundation models via generative continual learning. Without sharing raw data, MoveGCL enables decentralized and progressive model evolution by replaying synthetic trajectories generated from a frozen teacher model, and reinforces knowledge retention through a tailored distillation strategy that mitigates catastrophic forgetting. To address the heterogeneity of mobility patterns, MoveGCL incorporates a Mixture-of-Experts Transformer with a mobility-aware expert routing mechanism, and employs a layer-wise progressive adaptation strategy to stabilize continual updates. Experiments on six real-world urban datasets demonstrate that MoveGCL achieves performance comparable to joint training and significantly outperforms federated learning baselines, while offering strong privacy protection. MoveGCL marks a crucial step toward unlocking foundation models for mobility, offering a practical blueprint for open, scalable, and privacy-preserving model development in the era of foundation models.

📄 PDF Abstract BibTeX arXiv:2506.06694

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningFederated LearningMixture-of-ExpertsPrivacy Preserving

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Breaking Data Silos: Cross-Domain Learning for Multi-Agent Perception from Independent Private Sources

2024-02-06 · Jinlong Li, Baolu Li, Xinyu Liu, Runsheng Xu 외

The diverse agents in multi-agent perception systems may be from different companies. Each company might use the identical classic neural network architecture based encoder for feature extraction. However, the data sourc…

3D Object Detectionobject-detectionObject Detection

GeoAI in Social Science

2023-12-19 · Wenwen Li

GeoAI, or geospatial artificial intelligence, is an exciting new area that leverages artificial intelligence (AI), geospatial big data, and massive computing power to solve problems with high automation and intelligence.…

ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localization

2025-05-16 · Bo Du, Xuekang Zhu, Xiaochen Ma, Chenfan Qu 외

The field of Fake Image Detection and Localization (FIDL) is highly fragmented, encompassing four domains: deepfake detection (Deepfake), image manipulation detection and localization (IMDL), artificial intelligence-gene…

AllDeepFake DetectionFace SwappingFake Image Detection+3

When Plausible Is Not Realistic: Evaluating Human Mobility in LLM-Based Urban Simulation

2026-06-11 · Gustavo H. Santos, Aline Carneiro Viana, Thiago H. Silva arxiv

LLM-based generative agents are increasingly used in urban simulators, yet it remains unclear whether they reproduce empirically realistic human mobility patterns or merely generate plausible mobility narratives. We intr…

Unlocking the Potential of Collaborative AI -- On the Socio-technical Challenges of Federated Machine Learning

2023-04-26 · Tobias Müller, Milena Zahn, Florian Matthes

The disruptive potential of AI systems roots in the emergence of big data. Yet, a significant portion is scattered and locked in data silos, leaving its potential untapped. Federated Machine Learning is a novel AI paradi…

Systematic Literature Review