paper-with-me

Papers

Revisiting 3D Object Detection From an Egocentric Perspective

2021-12-14 · NeurIPS 2021 12 · Boyang Deng, Charles R. Qi, Mahyar Najibi, Thomas Funkhouser, Yin Zhou, Dragomir Anguelov

3D object detection is a key module for safety-critical robotics applications such as autonomous driving. For these applications, we care most about how the detections affect the ego-agent's behavior and safety (the egocentric perspective). Intuitively, we seek more accurate descriptions of object geometry when it's more likely to interfere with the ego-agent's motion trajectory. However, current detection metrics, based on box Intersection-over-Union (IoU), are object-centric and aren't designed to capture the spatio-temporal relationship between objects and the ego-agent. To address this issue, we propose a new egocentric measure to evaluate 3D object detection, namely Support Distance Error (SDE). Our analysis based on SDE reveals that the egocentric detection quality is bounded by the coarse geometry of the bounding boxes. Given the insight that SDE would benefit from more accurate geometry descriptions, we propose to represent objects as amodal contours, specifically amodal star-shaped polygons, and devise a simple model, StarPoly, to predict such contours. Our experiments on the large-scale Waymo Open Dataset show that SDE better reflects the impact of detection quality on the ego-agent's safety compared to IoU; and the estimated contours from StarPoly consistently improve the egocentric detection quality over recent 3D object detectors.

📄 PDF Abstract BibTeX arXiv:2112.07787

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionAutonomous DrivingObjectobject-detectionObject Detection

Similar Papers 제목 키워드 기반

The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-like Domain

2020-10-12 · Francesco Ragusa, Antonino Furnari, Salvatore Livatino, Giovanni Maria Farinella

Wearable cameras allow to collect images and videos of humans interacting with the world. While human-object interactions have been thoroughly investigated in third person vision, the problem has been understudied in ego…

Action RecognitionActive Object DetectionHuman-Object Interaction DetectionObject+3

Object Aware Egocentric Online Action Detection

2024-06-03 · Joungbin An, Yunsu Park, Hyolim Kang, Seon Joo Kim

Advancements in egocentric video datasets like Ego4D, EPIC-Kitchens, and Ego-Exo4D have enriched the study of first-person human interactions, which is crucial for applications in augmented reality and assisted living. D…

Action DetectionObjectOnline Action DetectionScene Understanding

Self-Supervised Object Detection from Egocentric Videos

2023-01-01 · ICCV 2023 1 · Peri Akiva, Jing Huang, Kevin J Liang, Rama Kovvuri 외

Understanding the visual world from the perspective of humans (egocentric) has been a long-standing challenge in computer vision. Egocentric videos exhibit high scene complexity and irregular motion flows compared to…

Class-agnostic Object DetectionObjectobject-detectionObject Detection+2

X-view: Non-egocentric Multi-View 3D Object Detector

2021-03-24 · Liang Xie, Guodong Xu, Deng Cai, Xiaofei He

3D object detection algorithms for autonomous driving reason about 3D obstacles either from 3D birds-eye view or perspective view or both. Recent works attempt to improve the detection performance via mining and fusing f…

3D Object DetectionAutonomous DrivingMULTI-VIEW LEARNINGObject+2

Egocentric Hand-object Interaction Detection

2022-11-16 · Yao Lu, Yanan Liu

In this paper, we propose a method to jointly determine the status of hand-object interaction. This is crucial for egocentric human activity understanding and interaction. From a computer vision perspective, we believe t…

Hand-Object Interaction DetectionHand Pose EstimationObjectPose Estimation