Wearable Travel Aid for Environment Perception and Navigation of Visually Impaired People

2019-04-30 · Jinqiang Bai, Zhaoxiang Liu, Yimin Lin, Ye Li, Shiguo Lian, Dijun Liu

This paper presents a wearable assistive device with the shape of a pair of eyeglasses that allows visually impaired people to navigate safely and quickly in unfamiliar environment, as well as perceive the complicated environment to automatically make decisions on the direction to move. The device uses a consumer Red, Green, Blue and Depth (RGB-D) camera and an Inertial Measurement Unit (IMU) to detect obstacles. As the device leverages the ground height continuity among adjacent image frames, it is able to segment the ground from obstacles accurately and rapidly. Based on the detected ground, the optimal walkable direction is computed and the user is then informed via converted beep sound. Moreover, by utilizing deep learning techniques, the device can semantically categorize the detected obstacles to improve the users' perception of surroundings. It combines a Convolutional Neural Network (CNN) deployed on a smartphone with a depth-image-based object detection to decide what the object type is and where the object is located, and then notifies the user of such information via speech. We evaluated the device's performance with different experiments in which 20 visually impaired people were asked to wear the device and move in an office, and found that they were able to avoid obstacle collisions and find the way in complicated scenarios.

📄 PDF Abstract BibTeX arXiv:1904.13037

Code (0)

등록된 구현이 없습니다.

Tasks

NavigateObjectobject-detection Object Detection

Can we cover navigational perception needs of the visually impaired by panoptic segmentation?

2020-07-20 · Wei Mao, Jiaming Zhang, Kailun Yang, Rainer Stiefelhagen

Navigational perception for visually impaired people has been substantially promoted by both classic and deep learning based segmentation methods. In classic visual recognition methods, the segmentation models are mostly…

Deep Learning Instance Segmentation Panoptic Segmentation Segmentation+1

Visual Localization of Key Positions for Visually Impaired People

2018-10-09 · Ruiqi Cheng, Kaiwei Wang, Longqing Lin, Kailun Yang

On the off-the-shelf navigational assistance devices, the localization precision is limited to the signal error of global navigation satellite system (GNSS). During travelling outdoors, the inaccurately localization perp…

Visual Localization

GuideTouch: An Obstacle Avoidance Device with Tactile Feedback for Visually Impaired

2026-01-20 · Timofei Kozlov, Artem Trandofilov, Georgii Gazaryan, Issatay Tokmurziyev 외 arxiv

Safe navigation for the visually impaired individuals remains a critical challenge, especially concerning head-level obstacles, which traditional mobility aids often fail to detect. We introduce GuideTouch, a compact, af…

Perception Framework through Real-Time Semantic Segmentation and Scene Recognition on a Wearable System for the Visually Impaired

2021-03-06 · Yingzhi Zhang, Haoye Chen, Kailun Yang, Jiaming Zhang 외

As the scene information, including objectness and scene type, are important for people with visual impairment, in this work we present a multi-task efficient perception system for the scene parsing and recognition tasks…

Real-Time Semantic Segmentation Scene Parsing Scene Recognition Semantic Segmentation

Deep Learning based Wearable Assistive System for Visually Impaired People

2019-08-09 · Yimin Lin, Kai Wang, Wanxin Yi, Shiguo Lian

In this paper, we propose a deep learning based assistive system to improve the environment perception experience of visually impaired (VI). The system is composed of a wearable terminal equipped with an RGBD camera and …

Deep Learning