Real-time Multi-Plane Segmentation Based on GPU Accelerated High-Resolution 3D Voxel Mapping for Legged Robot Locomotion
This paper proposes a real-time multi-plane segmentation method based on GPU-accelerated high-resolution 3D voxel mapping for legged robot locomotion. Existing online planar mapping approaches struggle to balance accuracy and computational efficiency: direct depth image segmentation from specific sensors suffers from poor temporal integration, height map-based methods cannot represent complex 3D structures like overhangs, and voxel-based plane segmentation remains unexplored for real-time applications. To address these limitations, we develop a novel framework that integrates vertex-based connected component labeling with random sample consensus based plane detection and convex hull, leveraging GPU parallel computing to rapidly extract planar regions from point clouds accumulated in high-resolution 3D voxel maps. Experimental results demonstrate that the proposed method achieves fast and accurate 3D multi-plane segmentation at over 30 Hz update rate even at a resolution of 0.01 m, enabling the detected planes to be utilized in real time for locomotion tasks. Furthermore, we validate the effectiveness of our approach through experiments in both simulated environments and physical legged robot platforms, confirming robust locomotion performance when considering 3D planar structures.
Code (0)
등록된 구현이 없습니다.
Tasks
Computational EfficiencyImage SegmentationPoint CloudsSimilar Papers 제목 키워드 기반
Multi-task Planar Reconstruction with Feature Warping Guidance
Piece-wise planar 3D reconstruction simultaneously segments plane instances and recovers their 3D plane parameters from an image, which is particularly useful for indoor or man-made environments. Efficient reconstruction…
3D ReconstructionInstance SegmentationMulti-Task LearningScene Understanding+2TriLift: Interpolation-Free Tri-Plane Lifting for Efficient 3D Perception on Embedded Systems
Dense 3D convolutions provide high accuracy for perception but are too computationally expensive for real-time robotic systems. Existing tri-plane methods rely on 2D image features with interpolation, point-wise queries,…
PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Image
This paper proposes a deep neural architecture, PlaneRCNN, that detects and reconstructs piecewise planar surfaces from a single RGB image. PlaneRCNN employs a variant of Mask R-CNN to detect planes with their plane para…
3D Plane Detection3D ReconstructionSegmentationAnisotropic 3D Multi-Stream CNN for Accurate Prostate Segmentation from Multi-Planar MRI
Background and Objective: Accurate and reliable segmentation of the prostate gland in MR images can support the clinical assessment of prostate cancer, as well as the planning and monitoring of focal and loco-regional th…
Hyperparameter OptimizationSegmentationGndNet: Fast Ground Plane Estimation and Point Cloud Segmentation for Autonomous Vehicles
Ground plane estimation and ground point seg-mentation is a crucial precursor for many applications in robotics and intelligent vehicles like navigable space detection and occupancy grid generation, 3D object detection, …
3D Object DetectionAutonomous Vehiclesobject-detectionObject Detection+3