A Deformable Interface for Human Touch Recognition using Stretchable Carbon Nanotube Dielectric Elastomer Sensors and Deep Neural Networks
User interfaces provide an interactive window between physical and virtual environments. A new concept in the field of human-computer interaction is a soft user interface; a compliant surface that facilitates touch interaction through deformation. Despite the potential of these interfaces, they currently lack a signal processing framework that can efficiently extract information from their deformation. Here we present OrbTouch, a device that uses statistical learning algorithms, based on convolutional neural networks, to map deformations from human touch to categorical labels (i.e., gestures) and touch location using stretchable capacitor signals as inputs. We demonstrate this approach by using the device to control the popular game Tetris. OrbTouch provides a modular, robust framework to interpret deformation in soft media, laying a foundation for new modes of human computer interaction through shape changing solids.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
The Next Evolution of Artificial Sense of Touch
We propose the next evolution of the artificial sense of touch, including an in-depth examination of the latest advancements in tactile sensing technology and the challenges that remain. We delve into the forefront of DN…
Distributed Gesture Controlled Systems for Human-Machine Interface
This paper presents the design flow of an IoT human machine touchless interface. The device uses embedded computing in conjunction with the Leap Motion Controller to provide an accurate and intuitive touchless interface.…
Advancements in Tactile Hand Gesture Recognition for Enhanced Human-Machine Interaction
Motivated by the growing interest in enhancing intuitive physical Human-Machine Interaction (HRI/HVI), this study aims to propose a robust tactile hand gesture recognition system. We performed a comprehensive evaluation …
Feature EngineeringGesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionStretchable and High-Precision Optical Tactile Sensor for Trajectory Tracking of Parallel Mechanisms
Stretchable sensors indicate promising prospects for soft robotics, medical devices, and human-machine interactions due to the high compliance of soft materials. Discrete sensing strategies, including sensor arrays and d…
Learning to Feel Materials from Multisensory Tactile Data via Interpretable Models
Human tactile perception of materials relies on complex multisensory touch cues, yet the relationship between low-level tactile signals and perceptual representations remains poorly understood. This knowledge gap hinders…