paper-with-me

홈 › Papers

Localizing Moments of Actions in Untrimmed Videos of Infants with Autism Spectrum Disorder

2024-04-08 · Halil Ismail Helvaci, Sen-ching Samson Cheung, Chen-Nee Chuah, Sally Ozonoff

Autism Spectrum Disorder (ASD) presents significant challenges in early diagnosis and intervention, impacting children and their families. With prevalence rates rising, there is a critical need for accessible and efficient screening tools. Leveraging machine learning (ML) techniques, in particular Temporal Action Localization (TAL), holds promise for automating ASD screening. This paper introduces a self-attention based TAL model designed to identify ASD-related behaviors in infant videos. Unlike existing methods, our approach simplifies complex modeling and emphasizes efficiency, which is essential for practical deployment in real-world scenarios. Importantly, this work underscores the importance of developing computer vision methods capable of operating in naturilistic environments with little equipment control, addressing key challenges in ASD screening. This study is the first to conduct end-to-end temporal action localization in untrimmed videos of infants with ASD, offering promising avenues for early intervention and support. We report baseline results of behavior detection using our TAL model. We achieve 70% accuracy for look face, 79% accuracy for look object, 72% for smile and 65% for vocalization.

📄 PDF Abstract BibTeX arXiv:2404.05849

Code (0)

등록된 구현이 없습니다.

Tasks

Action LocalizationTemporal Action Localization

Similar Papers 제목 키워드 기반

Learning to Localize Actions from Moments

2020-08-31 · ECCV 2020 8 · Fuchen Long, Ting Yao, Zhaofan Qiu, Xinmei Tian 외

With the knowledge of action moments (i.e., trimmed video clips that each contains an action instance), humans could routinely localize an action temporally in an untrimmed video. Nevertheless, most practical methods sti…

Action LocalizationTransfer Learning

ActionBytes: Learning From Trimmed Videos to Localize Actions

2020-06-01 · CVPR 2020 6 · Mihir Jain, Amir Ghodrati, Cees G. M. Snoek

This paper tackles the problem of localizing actions in long untrimmed videos. Different from existing works, which all use annotated untrimmed videos during training, we learn only from short trimmed videos. This enable…

Action ClassificationAction Localization

Text-based Localization of Moments in a Video Corpus

2020-08-20 · Sudipta Paul, Niluthpol Chowdhury Mithun, Amit K. Roy-Chowdhury

Prior works on text-based video moment localization focus on temporally grounding the textual query in an untrimmed video. These works assume that the relevant video is already known and attempt to localize the moment on…

Moment RetrievalRetrievalSentenceTemporal Localization

Prompting Large Language Models to Reformulate Queries for Moment Localization

2023-06-06 · Wenfeng Yan, Shaoxiang Chen, Zuxuan Wu, Yu-Gang Jiang

The task of moment localization is to localize a temporal moment in an untrimmed video for a given natural language query. Since untrimmed video contains highly redundant contents, the quality of the query is crucial for…

Moment QueriesNatural Language Queries

Fast Temporal Activity Proposals for Efficient Detection of Human Actions in Untrimmed Videos

2016-06-01 · CVPR 2016 6 · Fabian Caba Heilbron, Juan Carlos Niebles, Bernard Ghanem

In many large-scale video analysis scenarios, one is interested in localizing and recognizing human activities that occur in short temporal intervals within long untrimmed videos. Current approaches for activity detectio…

Action DetectionAction RecognitionActivity DetectionTemporal Action Localization