CroTad: A Contrastive Reinforcement Learning Framework for Online Trajectory Anomaly Detection
Detecting trajectory anomalies is a vital task in modern Intelligent Transportation Systems (ITS), enabling the identification of unsafe, inefficient, or irregular travel behaviours. While deep learning has emerged as the dominant approach, several key challenges remain unresolved. First, sub-trajectory anomaly detection, capable of pinpointing the precise segments where anomalies occur, remains underexplored compared to whole-trajectory analysis. Second, many existing methods depend on carefully tuned thresholds, limiting their adaptability in real-world applications. Moreover, the irregular sampling of trajectory data and the presence of noise in training sets further degrade model performance, making it difficult to learn reliable representations of normal routes. To address these challenges, we propose a contrastive reinforcement learning framework for online trajectory anomaly detection, CroTad. Our method is threshold-free and robust to noisy, irregularly sampled data. By incorporating contrastive learning, CroTad learns to extract diverse normal travel patterns for different itineraries and effectively distinguish anomalous behaviours at both sub-trajectory and point levels. The detection module leverages deep reinforcement learning to perform online, real-time anomaly scoring, enabling timely and fine-grained identification of abnormal segments. Extensive experiments on two real-world datasets demonstrate the effectiveness and robustness of our framework across various evaluation scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Reinforcement LearningContrastive LearningAnomaly DetectionSimilar Papers 제목 키워드 기반
RLOMM: An Efficient and Robust Online Map Matching Framework with Reinforcement Learning
Online map matching is a fundamental problem in location-based services, aiming to incrementally match trajectory data step-by-step onto a road network. However, existing methods fail to meet the needs for efficiency, ro…
Contrastive LearningRepresentation LearningAMD: Adaptive Momentum and Decoupled Contrastive Learning Framework for Robust Long-Tail Trajectory Prediction
Accurately predicting the future trajectories of traffic agents is essential in autonomous driving. However, due to the inherent imbalance in trajectory distributions, tail data in natural datasets often represents more …
Trajectory PredictionContrastive LearningAutonomous DrivingImproving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learning
Meta-reinforcement learning typically requires orders of magnitude more samples than single task reinforcement learning methods. This is because meta-training needs to deal with more diverse distributions and train extra…
Contrastive LearningMeta Reinforcement LearningMuJoCoreinforcement-learning+3Approximate Robust NMPC using Reinforcement Learning
We present a Reinforcement Learning-based Robust Nonlinear Model Predictive Control (RL-RNMPC) framework for controlling nonlinear systems in the presence of disturbances and uncertainties. An approximate Robust Nonlinea…
Model Predictive Controlreinforcement-learningReinforcement LearningReinforcement Learning (RL)SOLAR-RL: Semi-Online Long-horizon Assignment Reinforcement Learning
As Multimodal Large Language Models (MLLMs) mature, GUI agents are evolving from static interactions to complex navigation. While Reinforcement Learning (RL) has emerged as a promising paradigm for training MLLM agents o…
Reinforcement LearningOffline RL