Ellipse Regression with Predicted Uncertainties for Accurate Multi-View 3D Object Estimation
Convolutional neural network (CNN) based architectures, such as Mask R-CNN, constitute the state of the art in object detection and segmentation. Recently, these methods have been extended for model-based segmentation where the network outputs the parameters of a geometric model (e.g. an ellipse) directly. This work considers objects whose three-dimensional models can be represented as ellipsoids. We present a variant of Mask R-CNN for estimating the parameters of ellipsoidal objects by segmenting each object and accurately regressing the parameters of projection ellipses. We show that model regression is sensitive to the underlying occlusion scenario and that prediction quality for each object needs to be characterized individually for accurate 3D object estimation. We present a novel ellipse regression loss which can learn the offset parameters with their uncertainties and quantify the overall geometric quality of detection for each ellipse. These values, in turn, allow us to fuse multi-view detections to obtain 3D ellipsoid parameters in a principled fashion. The experiments on both synthetic and real datasets quantitatively demonstrate the high accuracy of our proposed method in estimating 3D objects under heavy occlusions compared to previous state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Objectobject-detectionObject DetectionregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ELLIPSE: Evidential Learning for Robust Waypoints and Uncertainties
Robust waypoint prediction is crucial for mobile robots operating in open-world, safety-critical settings. While Imitation Learning (IL) methods have demonstrated great success in practice, they are susceptible to distri…
Ellipse R-CNN: Learning to Infer Elliptical Object from Clustering and Occlusion
Images of heavily occluded objects in cluttered scenes, such as fruit clusters in trees, are hard to segment. To further retrieve the 3D size and 6D pose of each individual object in such cases, bounding boxes are not re…
Clusteringobject-detectionObject DetectionOcclusion Handling+1Leveraging Uncertainties for Deep Multi-modal Object Detection in Autonomous Driving
This work presents a probabilistic deep neural network that combines LiDAR point clouds and RGB camera images for robust, accurate 3D object detection. We explicitly model uncertainties in the classification and regressi…
3D Object DetectionAutonomous Drivingobject-detectionObject Detection+1Exploiting Uncertainty in Regression Forests for Accurate Camera Relocalization
Recent advances in camera relocalization use predictions from a regression forest to guide the camera pose optimization procedure. In these methods, each tree associates one pixel with a point in the scene's 3D world coo…
Camera RelocalizationregressionNon-anchor-based vehicle detection for traffic surveillance using bounding ellipses
Cameras for traffic surveillance are usually pole-mounted and produce images that reflect a birds-eye view. Vehicles in such images, in general, assume an ellipse form. A bounding box for the vehicles usually includes a …
Data Augmentationvehicle detection