paper-with-me

홈 › Papers

StairNetV3: Depth-aware Stair Modeling using Deep Learning

2023-08-13 · Chen Wang, Zhongcai Pei, Shuang Qiu, Yachun Wang, Zhiyong Tang

Vision-based stair perception can help autonomous mobile robots deal with the challenge of climbing stairs, especially in unfamiliar environments. To address the problem that current monocular vision methods are difficult to model stairs accurately without depth information, this paper proposes a depth-aware stair modeling method for monocular vision. Specifically, we take the extraction of stair geometric features and the prediction of depth images as joint tasks in a convolutional neural network (CNN), with the designed information propagation architecture, we can achieve effective supervision for stair geometric feature learning by depth information. In addition, to complete the stair modeling, we take the convex lines, concave lines, tread surfaces and riser surfaces as stair geometric features and apply Gaussian kernels to enable the network to predict contextual information within the stair lines. Combined with the depth information obtained by depth sensors, we propose a stair point cloud reconstruction method that can quickly get point clouds belonging to the stair step surfaces. Experiments on our dataset show that our method has a significant improvement over the previous best monocular vision method, with an intersection over union (IOU) increase of 3.4 %, and the lightweight version has a fast detection speed and can meet the requirements of most real-time applications. Our dataset is available at https://data.mendeley.com/datasets/6kffmjt7g2/1.

📄 PDF Abstract BibTeX arXiv:2308.06715

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningPoint cloud reconstruction

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

StairMaster: Learning to Conquer Risky Hollow Stairs for Agile Quadrupedal Robots

2026-06-24 · Xincheng Tang, Youhan Xie, Zhengjie Shu, Wanyu Li 외 arxiv

Climbing hollow stairs remains a challenging problem for quadruped robots due to the high risk of leg trapping, severe depth sparsity, and high-frequency depth-sensing noise. In this paper, we propose StairMaster, a nove…

Reinforcement Learning

TRISTAR: Triple-Signal Stair Recognition and Vision-Only Indoor Navigation for Search-and-Rescue Micro-UAVs

2026-07-04 · Octavian Gîngu, Stelian Spînu arxiv

Indoor search-and-rescue (SAR) operations often require rapid situational awareness where GNSS signals are unavailable and human access is difficult or hazardous. While most autonomous aerial systems rely on LiDAR, stere…

Monocular Depth EstimationScene Understanding

Staircase Attention for Recurrent Processing of Sequences

2021-06-08 · Da Ju, Stephen Roller, Sainbayar Sukhbaatar, Jason Weston

Attention mechanisms have become a standard tool for sequence modeling tasks, in particular by stacking self-attention layers over the entire input sequence as in the Transformer architecture. In this work we introduce a…

Language ModelingLanguage Modelling

RGB-D-based Stair Detection using Deep Learning for Autonomous Stair Climbing

2022-12-02 · Chen Wang, Zhongcai Pei, Shuang Qiu, Zhiyong Tang

Stairs are common building structures in urban environments, and stair detection is an important part of environment perception for autonomous mobile robots. Most existing algorithms have difficulty combining the visual …

Explicit Stair Geometry Conditioning for Robust Humanoid Locomotion

2026-05-11 · Jianguo Zhang, Wentai Xu, Shusheng Ye, Yuxiang He 외 arxiv

Robust humanoid stair climbing remains challenging due to geometric discontinuities, sensitivity to step height variations, and perception uncertainty in real-world environments. Existing learning-based locomotion polici…