paper-with-me

홈 › Papers

Improve accessibility for Low Vision and Blind people using Machine Learning and Computer Vision

2024-03-24 · Jasur Shukurov

With the ever-growing expansion of mobile technology worldwide, there is an increasing need for accommodation for those who are disabled. This project explores how machine learning and computer vision could be utilized to improve accessibility for people with visual impairments. There have been many attempts to develop various software that would improve accessibility in the day-to-day lives of blind people. However, applications on the market have low accuracy and only provide audio feedback. This project will concentrate on building a mobile application that helps blind people to orient in space by receiving audio and haptic feedback, e.g. vibrations, about their surroundings in real-time. The mobile application will have 3 main features. The initial feature is scanning text from the camera and reading it to a user. This feature can be used on paper with text, in the environment, and on road signs. The second feature is detecting objects around the user, and providing audio feedback about those objects. It also includes providing the description of the objects and their location, and giving haptic feedback if the user is too close to an object. The last feature is currency detection which provides a total amount of currency value to the user via the camera.

📄 PDF Abstract BibTeX arXiv:2404.00043

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

AI and Accessibility: A Discussion of Ethical Considerations

2019-08-21 · Meredith Ringel Morris

According to the World Health Organization, more than one billion people worldwide have disabilities. The field of disability studies defines disability through a social lens; people are disabled to the extent that socie…

speech-recognitionSpeech RecognitionTranslation

Understanding the Use of a Large Language Model-Powered Guide to Make Virtual Reality Accessible for Blind and Low Vision People

2026-03-10 · Jazmin Collins, Sharon Y Lin, Tianqi Liu, Andrea Stevenson Won 외 arxiv

As social virtual reality (VR) grows more popular, addressing accessibility for blind and low vision (BLV) users is increasingly critical. Researchers have proposed an AI "sighted guide" to help users navigate VR and ans…

A Light and Smart Wearable Platform with Multimodal Foundation Model for Enhanced Spatial Reasoning in People with Blindness and Low Vision

2025-05-16 · Alexey Magay, Dhurba Tripathi, Yu Hao, Yi Fang

People with blindness and low vision (pBLV) face significant challenges, struggling to navigate environments and locate objects due to limited visual cues. Spatial reasoning is crucial for these individuals, as it enable…

Large Language ModelNavigateObject RecognitionSpatial Reasoning

Investigating Use Cases of AI-Powered Scene Description Applications for Blind and Low Vision People

2024-03-22 · Ricardo Gonzalez, Jazmin Collins, Shiri Azenkot, Cynthia Bennett

"Scene description" applications that describe visual content in a photo are useful daily tools for blind and low vision (BLV) people. Researchers have studied their use, but they have only explored those that leverage r…

ProgramAlly: Creating Custom Visual Access Programs via Multi-Modal End-User Programming

2024-08-20 · Jaylin Herskovitz, Andi Xu, Rahaf Alharbi, Anhong Guo

Existing visual assistive technologies are built for simple and common use cases, and have few avenues for blind people to customize their functionalities. Drawing from prior work on DIY assistive technology, this paper …