Conformal Object Detection by Sequential Risk Control
Recent advances in object detectors have led to their adoption for industrial uses. However, their deployment in critical applications is hindered by the inherent lack of reliability of neural networks and the complex structure of object detection models. To address these challenges, we turn to Conformal Prediction, a post-hoc procedure which offers statistical guarantees that are valid for any dataset size, without requiring prior knowledge on the model or data distribution. Our contribution is manifold: first, we formally define the problem of Conformal Object Detection (COD) and introduce a novel method, Sequential Conformal Risk Control (SeqCRC), that extends the statistical guarantees of Conformal Risk Control (CRC) to two sequential tasks with two parameters, as required in the COD setting. Then, we propose loss functions and prediction sets suited to applying CRC to different applications and certification requirements. Finally, we present a conformal toolkit, enabling replication and further exploration of our methods. Using this toolkit, we perform extensive experiments, yielding a benchmark that validates the investigated methods and emphasizes trade-offs and other practical consequences.
Code (0)
등록된 구현이 없습니다.
Tasks
Conformal PredictionObjectobject-detectionObject DetectionvalidSimilar Papers 제목 키워드 기반
Confident Object Detection via Conformal Prediction and Conformal Risk Control: an Application to Railway Signaling
Deploying deep learning models in real-world certified systems requires the ability to provide confidence estimates that accurately reflect their uncertainty. In this paper, we demonstrate the use of the conformal predic…
Conformal Predictionobject-detectionObject DetectionPredictionConformal Risk Control for Ordinal Classification
As a natural extension to the standard conformal prediction method, several conformal risk control methods have been recently developed and applied to various learning problems. In this work, we seek to control the confo…
ClassificationConformal PredictionDiabetic Retinopathy DetectionOrdinal ClassificationDynamic Estimation Loss Control in Variational Quantum Sensing via Online Conformal Inference
Quantum sensing exploits non-classical effects to overcome limitations of classical sensors, with applications ranging from gravitational-wave detection to nanoscale imaging. However, practical quantum sensors built on n…
Gravitational Wave DetectionRobust Vision-Based Runway Detection through Conformal Prediction and Conformal mAP
We explore the use of conformal prediction to provide statistical uncertainty guarantees for runway detection in vision-based landing systems (VLS). Using fine-tuned YOLOv5 and YOLOv6 models on aerial imagery, we apply c…
Conformal Predictionobject-detectionObject DetectionPredictionConformal Loss-Controlling Prediction
Conformal prediction is a learning framework controlling prediction coverage of prediction sets, which can be built on any learning algorithm for point prediction. This work proposes a learning framework named conformal …
Conformal PredictionPredictionWeather Forecasting