paper-with-me

Papers

Ellipse Regression with Predicted Uncertainties for Accurate Multi-View 3D Object Estimation

2020-12-27 · Wenbo Dong, Volkan Isler

Convolutional neural network (CNN) based architectures, such as Mask R-CNN, constitute the state of the art in object detection and segmentation. Recently, these methods have been extended for model-based segmentation where the network outputs the parameters of a geometric model (e.g. an ellipse) directly. This work considers objects whose three-dimensional models can be represented as ellipsoids. We present a variant of Mask R-CNN for estimating the parameters of ellipsoidal objects by segmenting each object and accurately regressing the parameters of projection ellipses. We show that model regression is sensitive to the underlying occlusion scenario and that prediction quality for each object needs to be characterized individually for accurate 3D object estimation. We present a novel ellipse regression loss which can learn the offset parameters with their uncertainties and quantify the overall geometric quality of detection for each ellipse. These values, in turn, allow us to fuse multi-view detections to obtain 3D ellipsoid parameters in a principled fashion. The experiments on both synthetic and real datasets quantitatively demonstrate the high accuracy of our proposed method in estimating 3D objects under heavy occlusions compared to previous state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2101.05212

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject Detectionregression

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

ELLIPSE: Evidential Learning for Robust Waypoints and Uncertainties

2026-03-04 · Zihao Dong, Chanyoung Chung, Dong-Ki Kim, Mukhtar Maulimov 외 arxiv

Robust waypoint prediction is crucial for mobile robots operating in open-world, safety-critical settings. While Imitation Learning (IL) methods have demonstrated great success in practice, they are susceptible to distri…

Ellipse R-CNN: Learning to Infer Elliptical Object from Clustering and Occlusion

2020-01-30 · Wenbo Dong, Pravakar Roy, Cheng Peng, Volkan Isler

Images of heavily occluded objects in cluttered scenes, such as fruit clusters in trees, are hard to segment. To further retrieve the 3D size and 6D pose of each individual object in such cases, bounding boxes are not re…

Clusteringobject-detectionObject DetectionOcclusion Handling+1

Leveraging Uncertainties for Deep Multi-modal Object Detection in Autonomous Driving

2020-02-01 · Di Feng, Yifan Cao, Lars Rosenbaum, Fabian Timm 외

This work presents a probabilistic deep neural network that combines LiDAR point clouds and RGB camera images for robust, accurate 3D object detection. We explicitly model uncertainties in the classification and regressi…

3D Object DetectionAutonomous Drivingobject-detectionObject Detection+1

Exploiting Uncertainty in Regression Forests for Accurate Camera Relocalization

2015-06-01 · CVPR 2015 6 · Julien Valentin, Matthias Niessner, Jamie Shotton, Andrew Fitzgibbon 외

Recent advances in camera relocalization use predictions from a regression forest to guide the camera pose optimization procedure. In these methods, each tree associates one pixel with a point in the scene's 3D world coo…

Camera Relocalizationregression

Non-anchor-based vehicle detection for traffic surveillance using bounding ellipses

2020-10-05 · Byeonghyeop Yu, Johyun Shin, Gyeongjun Kim, Seungbin Roh 외

Cameras for traffic surveillance are usually pole-mounted and produce images that reflect a birds-eye view. Vehicles in such images, in general, assume an ellipse form. A bounding box for the vehicles usually includes a …

Data Augmentationvehicle detection