paper-with-me

Papers

Graph Neural Network based Child Activity Recognition

2022-12-18 · Sanka Mohottala, Pradeepa Samarasinghe, Dharshana Kasthurirathna, Charith Abhayaratne

This paper presents an implementation on child activity recognition (CAR) with a graph convolution network (GCN) based deep learning model since prior implementations in this domain have been dominated by CNN, LSTM and other methods despite the superior performance of GCN. To the best of our knowledge, we are the first to use a GCN model in child activity recognition domain. In overcoming the challenges of having small size publicly available child action datasets, several learning methods such as feature extraction, fine-tuning and curriculum learning were implemented to improve the model performance. Inspired by the contradicting claims made on the use of transfer learning in CAR, we conducted a detailed implementation and analysis on transfer learning together with a study on negative transfer learning effect on CAR as it hasn't been addressed previously. As the principal contribution, we were able to develop a ST-GCN based CAR model which, despite the small size of the dataset, obtained around 50% accuracy on vanilla implementations. With feature extraction and fine-tuning methods, accuracy was improved by 20%-30% with the highest accuracy being 82.24%. Furthermore, the results provided on activity datasets empirically demonstrate that with careful selection of pre-train model datasets through methods such as curriculum learning could enhance the accuracy levels. Finally, we provide preliminary evidence on possible frame rate effect on the accuracy of CAR models, a direction future research can explore.

📄 PDF Abstract BibTeX arXiv:2212.09013

Code (0)

등록된 구현이 없습니다.

Tasks

Activity RecognitionGraph Neural NetworkTransfer Learning

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Hybrid Models for Facial Emotion Recognition in Children

2023-08-24 · Rafael Zimmer, Marcos Sobral, Helio Azevedo

This paper focuses on the use of emotion recognition techniques to assist psychologists in performing children's therapy through remotely robot operated sessions. In the field of psychology, the use of agent-mediated the…

Emotion RecognitionFacial Emotion RecognitionOptical Flow Estimation

Activity focused Speech Recognition of Preschool Children in Early Childhood Classrooms

2022-07-01 · NAACL (BEA) 2022 7 · Satwik Dutta, Dwight Irvin, Jay Buzhardt, John H.L. Hansen

A supportive environment is vital for overall cognitive development in children. Challenges with direct observation and limitations of access to data driven approaches often hinder teachers or practitioners in early chil…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Decoding Children's Social Behavior

2013-06-01 · CVPR 2013 6 · J. Rehg, G. Abowd, A. Rozga, M. Romero 외

We introduce a new problem domain for activity recognition: the analysis of children's social and communicative behaviors based on video and audio data. We specifically target interactions between children aged 1-2 years…

Activity Recognition

Language-Assisted Deep Learning for Autistic Behaviors Recognition

2022-11-17 · Andong Deng, Taojiannan Yang, Chen Chen, Qian Chen 외

Correctly recognizing the behaviors of children with Autism Spectrum Disorder (ASD) is of vital importance for the diagnosis of Autism and timely early intervention. However, the observation and recording during the trea…

Action RecognitionDeep LearningMultimodal Deep LearningTemporal Action Localization

Deep Learning Approach for Ear Recognition and Longitudinal Evaluation in Children

2024-08-02 · Afzal Hossain, Tipu Sultan, Stephanie Schuckers

Ear recognition as a biometric modality is becoming increasingly popular, with promising broader application areas. While current applications involve adults, one of the challenges in ear recognition for children is the …

Deep Learning