Sixth-Sense: Self-Supervised Learning of Spatial Awareness of Humans from a Planar Lidar
Localizing humans is a key prerequisite for any service robot operating in proximity to people. In these scenarios, robots rely on a multitude of state-of-the-art detectors usually designed to operate with RGB-D cameras or expensive 3D LiDARs. However, most commercially available service robots are equipped with cameras with a narrow field of view, making them blind when a user is approaching from other directions, or inexpensive 1D LiDARs whose readings are difficult to interpret. To address these limitations, we propose a self-supervised approach to detect humans and estimate their 2D pose from 1D LiDAR data, using detections from an RGB-D camera as a supervision source. Our approach aims to provide service robots with spatial awareness of nearby humans. After training on 70 minutes of data autonomously collected in two environments, our model is capable of detecting humans omnidirectionally from 1D LiDAR data in a novel environment, with 71% precision and 80% recall, while retaining an average absolute error of 13 cm in distance and 44{\deg} in orientation.
Code (0)
등록된 구현이 없습니다.
Tasks
Self-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GeoSense: Internalizing Geometric Necessity Perception for Multimodal Reasoning
Advancing towards artificial superintelligence requires rich and intelligent perceptual capabilities. A critical frontier in this pursuit is overcoming the limited spatial understanding of Multimodal Large Language Model…
Multimodal ReasoningSpatial ReasoningVisual ReasoningTIPS: Text-Image Pretraining with Spatial Awareness
While image-text representation learning has become very popular in recent years, existing models tend to lack spatial awareness and have limited direct applicability for dense understanding tasks. For this reason, self-…
Depth EstimationImage CaptioningRepresentation LearningSelf-Supervised Learning+1Self-Organization in Spontaneous Movements of Neonates generates Self-specifying Sensory Experiences
Movement experience and the coordination of perception and action are the basis of developing body awareness, emotion, motivation and cognition and the sense of self. The four limbs play a key role in the developing sens…
Time SeriesTime Series AnalysisEnabling the Sense of Self in a Dual-Arm Robot
While humans are aware of their body and capabilities, robots are not. To address this, we present in this paper a neural network architecture that enables a dual-arm robot to get a sense of itself in an environment. Our…
Self-Supervised Learning Based on Spatial Awareness for Medical Image Analysis
Medical image analysis is one of the research fields that had huge benefits from deep learning in recent years. To earn a good performance, the learning model requires large scale data with full annotation. However, it i…
Medical Image AnalysisOrgan SegmentationSelf-Supervised Learning