paper-with-me

Papers

hear-your-action: human action recognition by ultrasound active sensing

2023-09-15 · Risako Tanigawa, Yasunori Ishii

Action recognition is a key technology for many industrial applications. Methods using visual information such as images are very popular. However, privacy issues prevent widespread usage due to the inclusion of private information, such as visible faces and scene backgrounds, which are not necessary for recognizing user action. In this paper, we propose a privacy-preserving action recognition by ultrasound active sensing. As action recognition from ultrasound active sensing in a non-invasive manner is not well investigated, we create a new dataset for action recognition and conduct a comparison of features for classification. We calculated feature values by focusing on the temporal variation of the amplitude of ultrasound reflected waves and performed classification using a support vector machine and VGG for eight fundamental action classes. We confirmed that our method achieved an accuracy of 97.9% when trained and evaluated on the same person and in the same environment. Additionally, our method achieved an accuracy of 89.5% even when trained and evaluated on different people. We also report the analyses of accuracies in various conditions and limitations.

📄 PDF Abstract BibTeX arXiv:2309.08087

Code (0)

등록된 구현이 없습니다.

Tasks

Action RecognitionPrivacy PreservingTemporal Action Localization

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Hand Gesture Real Time Paint Tool - Box

2017-09-03 · Vandit Gajjar, Viraj Mavani, Ayesha Gurnani

With current development universally in computing, now a days user interaction approaches with mouse, keyboard, touch-pens etc. are not sufficient. Directly using of hands or hand gestures as an input device is a method …

BIG-bench Machine Learning

Watch Your Mouth: Silent Speech Recognition with Depth Sensing

2024-05-11 · Proceedings of the CHI Conference on Human Factors in Computing Systems 2024 5 · Xue Wang, Zixiong Su, Jun Rekimoto, Yang Zhang

Silent speech recognition is a promising technology that decodes human speech without requiring audio signals, enabling private human-computer interactions. In this paper, we propose Watch Your Mouth, a novel method that…

Deep LearningLipreadingSilent Speech Recognitionspeech-recognition+2

Wanna hear your voice? A sample is all we need!

2024-10-01 · The Hieu Pham, Phuong Thanh Tran Nguyen, Xuan Tho Nguyen, Tan Dat Nguyen 외

Research on audio clue-based target speaker extraction (TSE) has focused on modeling mixtures and reference speech, achieving strong results in English due to abundant datasets. However, cross-lingual properties remain u…

AllSpeech SeparationTarget Speaker Extraction

Elaborative Rehearsal for Zero-shot Action Recognition

2021-08-05 · ICCV 2021 10 · ShiZhe Chen, Dong Huang

The growing number of action classes has posed a new challenge for video understanding, making Zero-Shot Action Recognition (ZSAR) a thriving direction. The ZSAR task aims to recognize target (unseen) actions without tra…

Action RecognitionFew-Shot LearningSentenceVideo Understanding+2

Visual Speech Recognition

2014-09-03 · Ahmad B. A. Hassanat

Lip reading is used to understand or interpret speech without hearing it, a technique especially mastered by people with hearing difficulties. The ability to lip read enables a person with a hearing impairment to communi…

Audio-Visual Speech RecognitionLip Readingobject-detectionObject Detection+5