Dimension-Calibrated Unexplained Mass: An Interpretable GMM Drift Statistic that Matches Kernel Two-Sample Tests
Drift detectors that work tend not to explain themselves, and drift detectors that explain themselves tend to fail in high dimension. We close that gap for Gaussian mixture models (GMMs). Fitting a GMM to normal data makes each component a named "regime," and the fraction of a stream window matching no regime -- its unexplained mass -- is a drift signal that is simultaneously its own explanation. This statistic degrades as dimension grows; we identify the mechanism and remove it. Under a correct component, a normal point in d dimensions sits at about sqrt(d) sigma from the mean, so the customary fixed 3-sigma radius admits every point once d exceeds about 9, and window-level ROC-AUC collapses to exactly 0.50 on Satellite (d=36) and Optdigits (d=64). Replacing the fixed radius with the dimension-calibrated chi-squared quantile removes the saturation entirely: AUC rises to 1.00 and 0.89 respectively, leaving low-dimensional cases unchanged. The resulting interpretable detector matches a model-free kernel two-sample test (MMD) at every dimension from 3 to 64, across seven public benchmarks and five random splits, while reporting which regime the data left and how far outside it the window lies. We delimit its scope: unexplained mass detects and explains novel-regime drift, but is blind by construction to in-support re-weighting of existing regimes, where MMD is required and supplies no explanation. Two GMM-to-GMM divergences serve as ablations, and the same density model is a competent point-anomaly detector on par with six baselines under EVT-calibrated thresholds. All code and experiments are released.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
PARAFAC2$\times$N: Coupled Decomposition of Multi-modal Data with Drift in N Modes
Reliable analysis of comprehensive two-dimensional gas chromatography - time-of-flight mass spectrometry (GC$\times$GC-TOFMS) data is considered to be a major bottleneck for its widespread application. For multiple sampl…
Characterizing and Measuring Linguistic Dataset Drift
NLP models often degrade in performance when real world data distributions differ markedly from training data. However, existing dataset drift metrics in NLP have generally not considered specific dimensions of linguisti…
Natural Language InferenceSentiment AnalysisSentiment ClassificationRisk-Neutral Market Simulation
We develop a risk-neutral spot and equity option market simulator for a single underlying, under which the joint market process is a martingale. We leverage an efficient low-dimensional representation of the market which…
RAPT: Model-Predictive Out-of-Distribution Detection and Failure Diagnosis for Sim-to-Real Humanoid Robots
Deploying learned control policies on humanoid robots is challenging: policies that appear robust in simulation can execute confidently in out-of-distribution (OOD) states after Sim-to-Real transfer, leading to silent fa…
Out-of-Distribution DetectionAnomaly DetectionEmbracing Anisotropy: Turning Massive Activations into Interpretable Control Knobs for Large Language Models
Large Language Models (LLMs) exhibit highly anisotropic internal representations, often characterized by massive activations, a phenomenon where a small subset of feature dimensions possesses magnitudes significantly lar…
Domain Adaptation