paper-with-me

Papers

Multi-modal Multi-kernel Graph Learning for Autism Prediction and Biomarker Discovery

2023-03-03 · Junbin Mao, Jin Liu, Hanhe Lin, Hulin Kuang, Shirui Pan, Yi Pan

Due to its complexity, graph learning-based multi-modal integration and classification is one of the most challenging obstacles for disease prediction. To effectively offset the negative impact between modalities in the process of multi-modal integration and extract heterogeneous information from graphs, we propose a novel method called MMKGL (Multi-modal Multi-Kernel Graph Learning). For the problem of negative impact between modalities, we propose a multi-modal graph embedding module to construct a multi-modal graph. Different from conventional methods that manually construct static graphs for all modalities, each modality generates a separate graph by adaptive learning, where a function graph and a supervision graph are introduced for optimization during the multi-graph fusion embedding process. We then propose a multi-kernel graph learning module to extract heterogeneous information from the multi-modal graph. The information in the multi-modal graph at different levels is aggregated by convolutional kernels with different receptive field sizes, followed by generating a cross-kernel discovery tensor for disease prediction. Our method is evaluated on the benchmark Autism Brain Imaging Data Exchange (ABIDE) dataset and outperforms the state-of-the-art methods. In addition, discriminative brain regions associated with autism are identified by our model, providing guidance for the study of autism pathology.

📄 PDF Abstract BibTeX arXiv:2303.03388

Code (0)

등록된 구현이 없습니다.

Tasks

Disease PredictionGraph EmbeddingGraph Learning

Similar Papers 제목 키워드 기반

Autism Spectrum Disorder Classification using Graph Kernels on Multidimensional Time Series

2016-11-29 · Rushil Anirudh, Jayaraman J. Thiagarajan, Irene Kim, Wolfgang Polonik

We present an approach to model time series data from resting state fMRI for autism spectrum disorder (ASD) severity classification. We propose to adopt kernel machines and employ graph kernels that define a kernel dot p…

General ClassificationTime SeriesTime Series Analysis

Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition

2024-03-22 · Shijian Deng, Erin E. Kosloski, Siddhi Patel, Zeke A. Barnett 외

In this article, we introduce a novel problem of audio-visual autism behavior recognition, which includes social behavior recognition, an essential aspect previously omitted in AI-assisted autism screening research. We d…

Language ModellingLarge Language ModelMultimodal Large Language Model

Introducing CALMED: Multimodal Annotated Dataset for Emotion Detection in Children with Autism

2023-07-24 · Annanda Sousa, Karen Young, Mathieu d'Aquin, Manel Zarrouk 외

Automatic Emotion Detection (ED) aims to build systems to identify users' emotions automatically. This field has the potential to enhance HCI, creating an individualised experience for the user. However, ED systems tend …

MMASD: A Multimodal Dataset for Autism Intervention Analysis

2023-06-14 · Jicheng Li, Vuthea Chheang, Pinar Kullu, Eli Brignac 외

Autism spectrum disorder (ASD) is a developmental disorder characterized by significant social communication impairments and difficulties perceiving and presenting communication cues. Machine learning techniques have bee…

Action Quality AssessmentOptical Flow EstimationPrivacy Preserving

Diagnosis and Pathogenic Analysis of Autism Spectrum Disorder Using Fused Brain Connection Graph

2024-09-22 · Lu Wei, Yi Huang, Guosheng Yin, Fode Zhang 외

We propose a model for diagnosing Autism spectrum disorder (ASD) using multimodal magnetic resonance imaging (MRI) data. Our approach integrates brain connectivity data from diffusion tensor imaging (DTI) and functional …

DiagnosticGraph Classification