Moving Metric Detection and Alerting System at eBay
At eBay, there are thousands of product health metrics for different domain teams to monitor. We built a two-phase alerting system to notify users with actionable alerts based on anomaly detection and alert retrieval. In the first phase, we developed an efficient anomaly detection algorithm, called Moving Metric Detector (MMD), to identify potential alerts among metrics with distribution agnostic criteria. In the second alert retrieval phase, we built additional logic with feedbacks to select valid actionable alerts with point-wise ranking model and business rules. Compared with other trend and seasonality decomposition methods, our decomposer is faster and better to detect anomalies in unsupervised cases. Our two-phase approach dramatically improves alert precision and avoids alert spamming in eBay production.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionRetrievalvalidSimilar Papers 제목 키워드 기반
An evaluation metric for object detection algorithms in autonomous navigation systems and its application to a real-time alerting system
An autonomous navigation system relies on a number of sensors including radar, LIDAR and a visible light camera for its operation. We focus our attention on the visible light camera in this work. Object detection is the …
Autonomous NavigationObjectobject-detectionObject DetectionAlerTiger: Deep Learning for AI Model Health Monitoring at LinkedIn
Data-driven companies use AI models extensively to develop products and intelligent business solutions, making the health of these models crucial for business success. Model monitoring and alerting in industries pose uni…
Anomaly DetectionDeep LearningCALIBURN: Operationally Calibrated Streaming Intrusion Detection with Regime-Dependent Conformal Risk Control
Streaming intrusion detection systems must process flows continuously under bounded memory, yet most leave alerting-threshold selection as a post-hoc tuning problem incompatible with production, where operators commit in…
Intrusion DetectionHow Benchmarks and Evaluation Protocols Shape Conclusions in Provenance-Based Intrusion Detection
Provenance-based intrusion detection systems (PIDS) frequently report strong performance, but the conclusions drawn from these results can be highly sensitive to benchmarking choices and evaluation protocols. We investig…
CoActionGraphRec: Sequential Multi-Interest Recommendations Using Co-Action Graphs
There are unique challenges to developing item recommender systems for e-commerce platforms like eBay due to sparse data and diverse user interests. While rich user-item interactions are important, eBay's data sparsity e…
Graph Neural NetworkRecommendation Systems