paper-with-me

Papers

A temporal-to-spatial deep convolutional neural network for classification of hand movements from multichannel electromyography data

2020-07-16 · Adam Hartwell, Visakan Kadirkamanathan, Sean R. Anderson

Deep convolutional neural networks (CNNs) are appealing for the purpose of classification of hand movements from surface electromyography (sEMG) data because they have the ability to perform automated person-specific feature extraction from raw data. In this paper, we make the novel contribution of proposing and evaluating a design for the early processing layers in the deep CNN for multichannel sEMG. Specifically, we propose a novel temporal-to-spatial (TtS) CNN architecture, where the first layer performs convolution separately on each sEMG channel to extract temporal features. This is motivated by the idea that sEMG signals in each channel are mediated by one or a small subset of muscles, whose temporal activation patterns are associated with the signature features of a gesture. The temporal layer captures these signature features for each channel separately, which are then spatially mixed in successive layers to recognise a specific gesture. A practical advantage is that this approach also makes the CNN simple to design for different sample rates. We use NinaPro database 1 (27 subjects and 52 movements + rest), sampled at 100 Hz, and database 2 (40 subjects and 40 movements + rest), sampled at 2 kHz, to evaluate our proposed CNN design. We benchmark against a feature-based support vector machine (SVM) classifier, two CNNs from the literature, and an additional standard design of CNN. We find that our novel TtS CNN design achieves 66.6% per-class accuracy on database 1, and 67.8% on database 2, and that the TtS CNN outperforms all other compared classifiers using a statistical hypothesis test at the 2% significance level.

📄 PDF Abstract BibTeX arXiv:2007.10879

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Short-Term Temporal Convolutional Networks for Dynamic Hand Gesture Recognition

2019-12-31 · Yi Zhang, Chong Wang, Ye Zheng, Jieyu Zhao 외

The purpose of gesture recognition is to recognize meaningful movements of human bodies, and gesture recognition is an important issue in computer vision. In this paper, we present a multimodal gesture recognition method…

Gesture RecognitionHand Gesture RecognitionHand-Gesture Recognition

Stable Electromyographic Sequence Prediction During Movement Transitions using Temporal Convolutional Networks

2019-01-08 · Joseph L. Betthauser, John T. Krall, Rahul R. Kaliki, Matthew S. Fifer 외

Transient muscle movements influence the temporal structure of myoelectric signal patterns, often leading to unstable prediction behavior from movement-pattern classification methods. We show that temporal convolutional …

ClassificationGeneral Classification

Hand Gesture Classification Based on Forearm Ultrasound Video Snippets Using 3D Convolutional Neural Networks

2024-09-24 · Keshav Bimbraw, Ankit Talele, Haichong K. Zhang

Ultrasound based hand movement estimation is a crucial area of research with applications in human-machine interaction. Forearm ultrasound offers detailed information about muscle morphology changes during hand movement …

Gesture Recognition

Spatial-Temporal Graph Convolutional Networks for Sign Language Recognition

2019-01-31 · Cleison Correia de Amorim, David Macêdo, Cleber Zanchettin

The recognition of sign language is a challenging task with an important role in society to facilitate the communication of deaf persons. We propose a new approach of Spatial-Temporal Graph Convolutional Network to sign …

Sign Language Recognition

Global Temporal Representation based CNNs for Infrared Action Recognition

2019-09-18 · Yang Liu, Zhaoyang Lu, Jing Li, Tao Yang 외

Infrared human action recognition has many advantages, i.e., it is insensitive to illumination change, appearance variability, and shadows. Existing methods for infrared action recognition are either based on spatial or …

Action RecognitionOptical Flow EstimationTemporal Action Localization