paper-with-me

Papers

PatchAD: A Lightweight Patch-based MLP-Mixer for Time Series Anomaly Detection

2024-01-18 · Zhijie Zhong, Zhiwen Yu, Yiyuan Yang, Weizheng Wang, Kaixiang Yang

Anomaly detection in time series analysis is a pivotal task, yet it poses the challenge of discerning normal and abnormal patterns in label-deficient scenarios. While prior studies have largely employed reconstruction-based approaches, which limits the models' representational capacities. Moreover, existing deep learning-based methods are not sufficiently lightweight. Addressing these issues, we present PatchAD, our novel, highly efficient multiscale patch-based MLP-Mixer architecture that utilizes contrastive learning for representation extraction and anomaly detection. With its four distinct MLP Mixers and innovative dual project constraint module, PatchAD mitigates potential model degradation and offers a lightweight solution, requiring only $3.2$MB. Its efficacy is demonstrated by state-of-the-art results across $9$ datasets sourced from different application scenarios, outperforming over $30$ comparative algorithms. PatchAD significantly improves the classical F1 score by $50.5\%$, the Aff-F1 score by $7.8\%$, and the AUC by $10.0\%$. The code is publicly available. \url{https://github.com/EmorZz1G/PatchAD}

📄 PDF Abstract BibTeX arXiv:2401.09793

Code (1)

emorzz1g/patchad 공식 구현 pytorch

Tasks

Anomaly DetectionContrastive LearningTime SeriesTime Series AnalysisTime Series Anomaly Detection

Methods 이 논문이 사용한 방법론

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Average Pooling 설명 없음
Residual Connection 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
MLP-Mixer 설명 없음

Similar Papers 제목 키워드 기반

TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting

2023-06-14 · Vijay Ekambaram, Arindam Jati, Nam Nguyen, Phanwadee Sinthong 외

Transformers have gained popularity in time series forecasting for their ability to capture long-sequence interactions. However, their high memory and computing requirements pose a critical bottleneck for long-term forec…

Multivariate Time Series ForecastingRepresentation LearningSelf-Supervised LearningTime Series+1

SEMixer: Semantics Enhanced MLP-Mixer for Multiscale Mixing and Long-term Time Series Forecasting

2026-02-18 · Xu Zhang, Qitong Wang, Peng Wang, Wei Wang arxiv

Modeling multiscale patterns is crucial for long-term time series forecasting (TSF). However, redundancy and noise in time series, together with semantic gaps between non-adjacent scales, make the efficient alignment and…

Time Series Forecasting

WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecasting

2024-12-22 · Md Mahmuddun Nabi Murad, Mehmet Aktukmak, Yasin Yilmaz

Time series forecasting is crucial for various applications, such as weather forecasting, power load forecasting, and financial analysis. In recent studies, MLP-mixer models for time series forecasting have been shown as…

Financial AnalysisLoad ForecastingTime SeriesTime Series Forecasting+1

IIP-Mixer:Intra-Inter Patch Mixing Architecture for Battery Remaining Useful Life Prediction

2024-03-27 · Guangzai Ye, Li Feng, Jianlan Guo, Yuqiang Chen

Accurately estimating the Remaining Useful Life (RUL) of lithium-ion batteries is crucial for maintaining the safe and stable operation of rechargeable battery management systems. However, this task is often challenging …

Time SeriesTime Series Forecasting

MSMixer: Learned Multi-Scale Temporal Mixing with Complementary Linear Shortcut for Long-Term Time Series Forecasting

2026-05-04 · Ahmed Cherif arxiv

Long-term time series forecasting requires models that simultaneously capture rapid oscillations, medium-range periodicities, and slowly evolving macro-trends from a fixed look-back window. Existing lightweight MLP-based…

Time Series Forecasting