paper-with-me

홈 › Papers

TRISTAR: Triple-Signal Stair Recognition and Vision-Only Indoor Navigation for Search-and-Rescue Micro-UAVs

2026-07-04 · Octavian Gîngu, Stelian Spînu arxiv

Indoor search-and-rescue (SAR) operations often require rapid situational awareness where GNSS signals are unavailable and human access is difficult or hazardous. While most autonomous aerial systems rely on LiDAR, stereo vision, or specialized depth cameras, such solutions increase both hardware complexity and deployment costs. This paper presents a complete autonomous indoor navigation framework for low-cost unmanned aerial vehicles based exclusively on monocular vision. Implemented on a DJI Tello platform, the system combines monocular depth estimation using Depth Anything V2 with classical computer vision and lightweight deep learning models for scene understanding, victim detection, and hazard recognition. The framework consists of two independent behaviors: (i) corridor exploration with automatic door detection, room entry, OCR-based room identification, and victim inspection; and (ii) autonomous stair ascent based on TRISTAR (TRI-Signal STair Ascent Recognition), a novel triple-sensor fusion method that integrates structural cues (Sobel filtering), texture analysis (multi-scale Gabor filtering), and geometric depth from monocular depth estimation. Evaluation used real indoor flights in a university building. Depth calibration reduced relative depth error from 27.4% to below 10%, while the door detection algorithm reached a precision of 0.93 and an F1-score of 0.91. A dedicated ablation study shows that multi-sensor fusion significantly improves stair-recognition robustness compared to individual sensing modalities, and a failure-case analysis delineates the limits of monocular perception under challenging lighting and reflective surfaces. The results demonstrate that reliable indoor exploration and stair traversal are achievable on resource-constrained platforms without specialized ranging hardware, a practical, cost-effective solution for rapid SAR deployment.

📄 PDF Abstract BibTeX arXiv:2607.03818

Code (0)

등록된 구현이 없습니다.

Tasks

Monocular Depth EstimationScene Understanding

Similar Papers 제목 키워드 기반

STAIR Actions: A Video Dataset of Everyday Home Actions

2018-04-12 · Yuya Yoshikawa, Jiaqing Lin, Akikazu Takeuchi

A new large-scale video dataset for human action recognition, called STAIR Actions is introduced. STAIR Actions contains 100 categories of action labels representing fine-grained everyday home actions so that it can be a…

Action RecognitionTemporal Action Localization

StairNet: Visual Recognition of Stairs for Human-Robot Locomotion

2023-10-31 · Andrew Garrett Kurbis, Dmytro Kuzmenko, Bogdan Ivanyuk-Skulskiy, Alex Mihailidis 외

Human-robot walking with prosthetic legs and exoskeletons, especially over complex terrains such as stairs, remains a significant challenge. Egocentric vision has the unique potential to detect the walking environment pr…

CPUDeep LearningGPU

StairNetV3: Depth-aware Stair Modeling using Deep Learning

2023-08-13 · Chen Wang, Zhongcai Pei, Shuang Qiu, Yachun Wang 외

Vision-based stair perception can help autonomous mobile robots deal with the challenge of climbing stairs, especially in unfamiliar environments. To address the problem that current monocular vision methods are difficul…

Deep LearningPoint cloud reconstruction

Unsupervised Domain Adaptation Learning Algorithm for RGB-D Staircase Recognition

2019-03-04 · Jing Wang, Kuangen Zhang

Detection and recognition of staircase as upstairs, downstairs and negative (e.g., ladder) are the fundamental of assisting the visually impaired to travel independently in unfamiliar environments. Previous researches ha…

Domain AdaptationGeneral ClassificationUnsupervised Domain Adaptation

Automated speech audiometry: Can it work using open-source pre-trained Kaldi-NL automatic speech recognition?

2023-12-19 · Gloria Araiza-Illan, Luke Meyer, Khiet P. Truong, Deniz Baskent

A practical speech audiometry tool is the digits-in-noise (DIN) test for hearing screening of populations of varying ages and hearing status. The test is usually conducted by a human supervisor (e.g., clinician), who sco…

Automatic Speech Recognitionspeech-recognitionSpeech Recognition