paper-with-me

홈 › Papers

Improving Autism Detection with Multimodal Behavioral Analysis

2025-09-19 · William Saakyan, Matthias Norden, Lola Eversmann, Simon Kirsch, Muyu Lin, Simon Guendelman, Isabel Dziobek, Hanna Drimalla arxiv

Due to the complex and resource-intensive nature of diagnosing Autism Spectrum Condition (ASC), several computer-aided diagnostic support methods have been proposed to detect autism by analyzing behavioral cues in patient video data. While these models show promising results on some datasets, they struggle with poor gaze feature performance and lack of real-world generalizability. To tackle these challenges, we analyze a standardized video dataset comprising 168 participants with ASC (46% female) and 157 non-autistic participants (46% female), making it, to our knowledge, the largest and most balanced dataset available. We conduct a multimodal analysis of facial expressions, voice prosody, head motion, heart rate variability (HRV), and gaze behavior. To address the limitations of prior gaze models, we introduce novel statistical descriptors that quantify variability in eye gaze angles, improving gaze-based classification accuracy from 64% to 69% and aligning computational findings with clinical research on gaze aversion in ASC. Using late fusion, we achieve a classification accuracy of 74%, demonstrating the effectiveness of integrating behavioral markers across multiple modalities. Our findings highlight the potential for scalable, video-based screening tools to support autism assessment.

📄 PDF Abstract BibTeX arXiv:2509.21352

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Human Gesture and Gait Analysis for Autism Detection

2023-04-17 · Sania Zahan, Zulqarnain Gilani, Ghulam Mubashar Hassan, Ajmal Mian

Autism diagnosis presents a major challenge due to the vast heterogeneity of the condition and the elusive nature of early detection. Atypical gait and gesture patterns are dominant behavioral characteristics of autism a…

Autism detectionDiagnostic

Fine-tuning a multimodal large language model for clinician-grade autism behavioral scoring from short home videos

2026-06-25 · Mohammadmahdi Honarmand, Parnian Azizian, Aaron Kline, Kae Nurge 외 arxiv

Autism spectrum disorder (ASD) affects 1 in 31 US children, yet median age at diagnosis exceeds four years. Artificial intelligence pipelines that provide quantified diagnosis using easy to access observational data (e.g…

Human vs. NAO: A Computational-Behavioral Framework for Quantifying Social Orienting in Autism and Typical Development

2026-03-24 · Vartika Narayani Srinet, Anirudha Bhattacharjee, Braj Bhushan, Bishakh Bhattacharya arxiv

Responding to one's name is among the earliest-emerging social orienting behaviors and is one of the most prominent aspects in the detection of Autism Spectrum Disorder (ASD). Typically developing children exhibit near-r…

Face Detection

Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition

2024-03-22 · Shijian Deng, Erin E. Kosloski, Siddhi Patel, Zeke A. Barnett 외

In this article, we introduce a novel problem of audio-visual autism behavior recognition, which includes social behavior recognition, an essential aspect previously omitted in AI-assisted autism screening research. We d…

Language ModellingLarge Language ModelMultimodal Large Language Model

Weakly-supervised Autism Severity Assessment in Long Videos

2024-07-12 · Abid Ali, Mahmoud Ali, Jean-Marc Odobez, Camilla Barbini 외

Autism Spectrum Disorder (ASD) is a diverse collection of neurobiological conditions marked by challenges in social communication and reciprocal interactions, as well as repetitive and stereotypical behaviors. Atypical b…

Autism detection