Recognizing Complex Gestures on Minimalistic Knitted Sensors: Toward Real-World Interactive Systems
Developments in touch-sensitive textiles have enabled many novel interactive techniques and applications. Our digitally-knitted capacitive active sensors can be manufactured at scale with little human intervention. Their sensitive areas are created from a single conductive yarn, and they require only few connections to external hardware. This technique increases their robustness and usability, while shifting the complexity of enabling interactivity from the hardware to computational models. This work advances the capabilities of such sensors by creating the foundation for an interactive gesture recognition system. It uses a novel sensor design, and a neural network-based recognition model to classify 12 relatively complex, single touch point gesture classes with 89.8% accuracy, unfolding many possibilities for future applications. We also demonstrate the system's applicability and robustness to real-world conditions through its performance while being worn and the impact of washing and drying on the sensor's resistance.
Code (0)
등록된 구현이 없습니다.
Tasks
Gesture RecognitionSimilar Papers 제목 키워드 기반
Machine Learning Based Compensation for Inconsistencies in Knitted Force Sensors
Knitted sensors frequently suffer from inconsistencies due to innate effects such as offset, relaxation, and drift. These properties, in combination, make it challenging to reliably map from sensor data to physical actua…
Kinect Sensor Based Gesture Recognition for Surveillance Application
Hand gesture recognition has been granted as one of the emerging fields in research today providing a natural way of communication between man and a machine. Gestures are some forms of body motions which a person express…
Gesture RecognitionHand Gesture RecognitionHand-Gesture RecognitionAn Evaluation of Multi-Component Weft-Knitted Twill Structures for Sensing Tensile Force
We present multi-component knitted resistive sensors for tracking tensile force. The knits were fabricated using a Twill structure, which is a simple pattern featuring anisotropic elastic behavior, providing high stabili…
Gesture recognition based mouse events
This paper presents the maneuver of mouse pointer and performs various mouse operations such as left click, right click, double click, drag etc using gestures recognition technique. Recognizing gestures is a complex task…
Gesture RecognitionRecognizing Surgical Activities with Recurrent Neural Networks
We apply recurrent neural networks to the task of recognizing surgical activities from robot kinematics. Prior work in this area focuses on recognizing short, low-level activities, or gestures, and has been based on vari…
Gesture Recognition