paper-with-me

Papers

Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the Art

2023-11-21 · Elaheh Hatamimajoumerd, Pooria Daneshvar Kakhaki, Xiaofei Huang, Lingfei Luan, Somaieh Amraee, Sarah Ostadabbas

Automated human action recognition, a burgeoning field within computer vision, boasts diverse applications spanning surveillance, security, human-computer interaction, tele-health, and sports analysis. Precise action recognition in infants serves a multitude of pivotal purposes, encompassing safety monitoring, developmental milestone tracking, early intervention for developmental delays, fostering parent-infant bonds, advancing computer-aided diagnostics, and contributing to the scientific comprehension of child development. This paper delves into the intricacies of infant action recognition, a domain that has remained relatively uncharted despite the accomplishments in adult action recognition. In this study, we introduce a groundbreaking dataset called ``InfActPrimitive'', encompassing five significant infant milestone action categories, and we incorporate specialized preprocessing for infant data. We conducted an extensive comparative analysis employing cutting-edge skeleton-based action recognition models using this dataset. Our findings reveal that, although the PoseC3D model achieves the highest accuracy at approximately 71%, the remaining models struggle to accurately capture the dynamics of infant actions. This highlights a substantial knowledge gap between infant and adult action recognition domains and the urgent need for data-efficient pipeline models.

📄 PDF Abstract BibTeX arXiv:2311.12300

Code (1)

ostadabbas/video-based-infant-action-recognition 공식 구현

Tasks

Action RecognitionSkeleton Based Action RecognitionTemporal Action Localization

Similar Papers 제목 키워드 기반

Localizing Moments of Actions in Untrimmed Videos of Infants with Autism Spectrum Disorder

2024-04-08 · Halil Ismail Helvaci, Sen-ching Samson Cheung, Chen-Nee Chuah, Sally Ozonoff

Autism Spectrum Disorder (ASD) presents significant challenges in early diagnosis and intervention, impacting children and their families. With prevalence rates rising, there is a critical need for accessible and efficie…

Action LocalizationTemporal Action Localization

Automatic Infant Respiration Estimation from Video: A Deep Flow-based Algorithm and a Novel Public Benchmark

2023-07-24 · Sai Kumar Reddy Manne, Shaotong Zhu, Sarah Ostadabbas, Michael Wan

Respiration is a critical vital sign for infants, and continuous respiratory monitoring is particularly important for newborns. However, neonates are sensitive and contact-based sensors present challenges in comfort, hyg…

Optical Flow EstimationRespiratory Rate Estimation

A Video-based End-to-end Pipeline for Non-nutritive Sucking Action Recognition and Segmentation in Young Infants

2023-03-29 · Shaotong Zhu, Michael Wan, Elaheh Hatamimajoumerd, Kashish Jain 외

We present an end-to-end computer vision pipeline to detect non-nutritive sucking (NNS) -- an infant sucking pattern with no nutrition delivered -- as a potential biomarker for developmental delays, using off-the-shelf b…

Action RecognitionBinary ClassificationNutritionPose Estimation

Weakly Supervised Online Action Detection for Infant General Movements

2022-08-07 · Tongyi Luo, Jia Xiao, Chuncao Zhang, Siheng Chen 외

To make the earlier medical intervention of infants' cerebral palsy (CP), early diagnosis of brain damage is critical. Although general movements assessment(GMA) has shown promising results in early CP detection, it is l…

Action DetectionClassificationOnline Action Detection

Evaluating Temporal Patterns in Applied Infant Affect Recognition

2022-09-07 · Allen Chang, Lauren Klein, Marcelo R. Rosales, Weiyang Deng 외

Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification …