CARLA Drone: Monocular 3D Object Detection from a Different Perspective
Existing techniques for monocular 3D detection have a serious restriction. They tend to perform well only on a limited set of benchmarks, faring well either on ego-centric car views or on traffic camera views, but rarely on both. To encourage progress, this work advocates for an extended evaluation of 3D detection frameworks across different camera perspectives. We make two key contributions. First, we introduce the CARLA Drone dataset, CDrone. Simulating drone views, it substantially expands the diversity of camera perspectives in existing benchmarks. Despite its synthetic nature, CDrone represents a real-world challenge. To show this, we confirm that previous techniques struggle to perform well both on CDrone and a real-world 3D drone dataset. Second, we develop an effective data augmentation pipeline called GroundMix. Its distinguishing element is the use of the ground for creating 3D-consistent augmentation of a training image. GroundMix significantly boosts the detection accuracy of a lightweight one-stage detector. In our expanded evaluation, we achieve the average precision on par with or substantially higher than the previous state of the art across all tested datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object DetectionData AugmentationDiversityMonocular 3D Object Detectionobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Aerial Monocular 3D Object Detection
Drones equipped with cameras can significantly enhance human ability to perceive the world because of their remarkable maneuverability in 3D space. Ironically, object detection for drones has always been conducted in the…
3D Object DetectionAutonomous DrivingMonocular 3D Object DetectionObject+2WildLIFT: Lifting monocular drone video to 3D for species-agnostic wildlife monitoring
Monocular RGB cameras mounted on drones are widely used for wildlife monitoring, yet most analytical pipelines remain confined to two-dimensional image space, leaving geometric information in video underexploited. We pre…
Instance SegmentationEvaluation of Orientation Ambiguity and Detection Rate in April Tag and WhyCode
Fiducial systems provide a computationally cheap way for mobile robots to estimate the pose of objects, or their own pose, using just a monocular camera. However, the orientation component of the pose of fiducial markers…
TAGDroneDAR: Long-Range Drone Distance Estimation Using Monocular Vision and Bounding-Box Features
Accurate distance estimation for small drones in long-range imagery is important for tracking and situational awareness, yet remains challenging due to extreme target scale variation, background clutter, and noisy visual…
DroNeRF: Real-time Multi-agent Drone Pose Optimization for Computing Neural Radiance Fields
We present a novel optimization algorithm called DroNeRF for the autonomous positioning of monocular camera drones around an object for real-time 3D reconstruction using only a few images. Neural Radiance Fields or NeRF,…
3D ReconstructionNeRFNovel View SynthesisObject+1