paper-with-me

홈 › Papers

Causality-informed Anomaly Detection in Partially Observable Sensor Networks: Moving beyond Correlations

2025-07-13 · Xiaofeng Xiao, Bo Shen, Xubo Yue arxiv

Nowadays, as AI-driven manufacturing becomes increasingly popular, the volume of data streams requiring real-time monitoring continues to grow. However, due to limited resources, it is impractical to place sensors at every location to detect unexpected shifts. Therefore, it is necessary to develop an optimal sensor placement strategy that enables partial observability of the system while detecting anomalies as quickly as possible. Numerous approaches have been proposed to address this challenge; however, most existing methods consider only variable correlations and neglect a crucial factor: Causality. Moreover, although a few techniques incorporate causal analysis, they rely on interventions-artificially creating anomalies-to identify causal effects, which is impractical and might lead to catastrophic losses. In this paper, we introduce a causality-informed deep Q-network (Causal DQ) approach for partially observable sensor placement in anomaly detection. By integrating causal information at each stage of Q-network training, our method achieves faster convergence and tighter theoretical error bounds. Furthermore, the trained causal-informed Q-network significantly reduces the detection time for anomalies under various settings, demonstrating its effectiveness for sensor placement in large-scale, real-world data streams. Beyond the current implementation, our technique's fundamental insights can be applied to various reinforcement learning problems, opening up new possibilities for real-world causality-informed machine learning methods in engineering applications.

📄 PDF Abstract BibTeX arXiv:2507.09742

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningAnomaly Detection

Similar Papers 제목 키워드 기반

Power Interpretable Causal ODE Networks: A Unified Model for Explainable Anomaly Detection and Root Cause Analysis in Power Systems

2026-02-13 · Yue Sun, Likai Wang, Rick S. Blum, Parv Venkitasubramaniam arxiv

Anomaly detection and root cause analysis (RCA) are critical for ensuring the safety and resilience of cyber-physical systems such as power grids. However, existing machine learning models for time series anomaly detecti…

Time Series Anomaly Detection

Actual Causality and Responsibility Attribution in Decentralized Partially Observable Markov Decision Processes

2022-04-01 · Stelios Triantafyllou, Adish Singla, Goran Radanovic

Actual causality and a closely related concept of responsibility attribution are central to accountable decision making. Actual causality focuses on specific outcomes and aims to identify decisions (actions) that were cr…

Decision MakingDecision Making Under UncertaintySequential Decision Making

Outage Detection in Partially Observable Distribution Systems using Smart Meters and Generative Adversarial Networks

2019-12-10

In this paper, we present a novel data-driven approach to detect outage events in partially observable distribution systems by capturing the changes in smart meters' (SMs) data distribution. To achieve this, first, a bre…

Generative Adversarial Network

Online Cyber-Attack Detection in Smart Grid: A Reinforcement Learning Approach

2018-09-14 · Mehmet Necip Kurt, Oyetunji Ogundijo, Chong Li, Xiaodong Wang

Early detection of cyber-attacks is crucial for a safe and reliable operation of the smart grid. In the literature, outlier detection schemes making sample-by-sample decisions and online detection schemes requiring perfe…

Anomaly DetectionCyber Attack DetectionOutlier Detectionreinforcement-learning+2

HSVI-based Online Minimax Strategies for Partially Observable Stochastic Games with Neural Perception Mechanisms

2024-04-16 · Rui Yan, Gabriel Santos, Gethin Norman, David Parker 외

We consider a variant of continuous-state partially-observable stochastic games with neural perception mechanisms and an asymmetric information structure. One agent has partial information, with the observation function …

counterfactualHeuristic Search