Bounding-Box Inference for Error-Aware Model-Based Reinforcement Learning
In model-based reinforcement learning, simulated experiences from the learned model are often treated as equivalent to experience from the real environment. However, when the model is inaccurate, it can catastrophically interfere with policy learning. Alternatively, the agent might learn about the model's accuracy and selectively use it only when it can provide reliable predictions. We empirically explore model uncertainty measures for selective planning and show that best results require distribution insensitive inference to estimate the uncertainty over model-based updates. To that end, we propose and evaluate bounding-box inference, which operates on bounding-boxes around sets of possible states and other quantities. We find that bounding-box inference can reliably support effective selective planning.
Code (1)
Tasks
Model-based Reinforcement Learningreinforcement-learningReinforcement LearningSimilar Papers 제목 키워드 기반
Location-Aware Box Reasoning for Anchor-Based Single-Shot Object Detection
In the majority of object detection frameworks, the confidence of instance classification is used as the quality criterion of predicted bounding boxes, like the confidence-based ranking in non-maximum suppression (NMS). …
General ClassificationObjectobject-detectionObject Detection+1OPA-3D: Occlusion-Aware Pixel-Wise Aggregation for Monocular 3D Object Detection
Despite monocular 3D object detection having recently made a significant leap forward thanks to the use of pre-trained depth estimators for pseudo-LiDAR recovery, such two-stage methods typically suffer from overfitting …
3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+1SAIF: A Stability-Aware Inference Framework for Medical Image Segmentation with Segment Anything Model
Segment Anything Model (SAM) enable scalable medical image segmentation but suffer from inference-time instability when deployed as a frozen backbone. In practice, bounding-box prompts often contain localization errors, …
Medical Image SegmentationTraffic Surveillance Camera Calibration by 3D Model Bounding Box Alignment for Accurate Vehicle Speed Measurement
In this paper, we focus on fully automatic traffic surveillance camera calibration, which we use for speed measurement of passing vehicles. We improve over a recent state-of-the-art camera calibration method for traffic …
Camera CalibrationVehicle Speed EstimationReinforcement Inference: Leveraging Uncertainty for Self-Correcting Language Model Reasoning
Modern large language models (LLMs) are often evaluated and deployed under a one-shot, greedy inference protocol, especially in professional settings that require deterministic behavior. This regime can systematically un…