Walking = Traversable? : Traversability Prediction via Multiple Human Object Tracking under Occlusion
The emerging ``Floor plan from human trails (PfH)" technique has great potential for improving indoor robot navigation by predicting the traversability of occluded floors. This study presents an innovative approach that replaces first-person-view sensors with a third-person-view monocular camera mounted on the observer robot. This approach can gather measurements from multiple humans, expanding its range of applications. The key idea is to use two types of trackers, SLAM and MOT, to monitor stationary objects and moving humans and assess their interactions. This method achieves stable predictions of traversability even in challenging visual scenarios, such as occlusions, nonlinear perspectives, depth uncertainty, and intersections involving multiple humans. Additionally, we extend map quality metrics to apply to traversability maps, facilitating future research. We validate our proposed method through fusion and comparison with established techniques.
Code (0)
등록된 구현이 없습니다.
Tasks
Object TrackingRobot NavigationSimilar Papers 제목 키워드 기반
Stereo-based terrain traversability analysis using normal-based segmentation and superpixel surface analysis
In this paper, an stereo-based traversability analysis approach for all terrains in off-road mobile robotics, e.g. Unmanned Ground Vehicles (UGVs) is proposed. This approach reformulates the problem of terrain traversabi…
3D ReconstructionAllImage SegmentationSemantic SegmentationScaTE: A Scalable Framework for Self-Supervised Traversability Estimation in Unstructured Environments
For the safe and successful navigation of autonomous vehicles in unstructured environments, the traversability of terrain should vary based on the driving capabilities of the vehicles. Actual driving experience can be ut…
Autonomous VehiclesTEA-AgriVLN: Traversability Estimation Alarm for Agricultural Vision-and-Language Navigation
Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires an agent to follow a natural language instruction, predicting a sequence of low-level actions to navigate a robot from a starting point to a tar…
WayFAST: Navigation with Predictive Traversability in the Field
We present a self-supervised approach for learning to predict traversable paths for wheeled mobile robots that require good traction to navigate. Our algorithm, termed WayFAST (Waypoint Free Autonomous Systems for Traver…
NavigateSyNeT: Synthetic Negatives for Traversability Learning
Reliable traversability estimation is crucial for autonomous robots to navigate complex outdoor environments safely. Existing self-supervised learning frameworks primarily rely on positive and unlabeled data; however, th…
Self-Supervised Learning