paper-with-me

Papers

Clinical-Prior Guided Multi-Modal Learning with Latent Attention Pooling for Gait-Based Scoliosis Screening

2026-02-06 · Dong Chen, Zizhuang Wei, Jialei Xu, Xinyang Sun, Zonglin He, Meiru An, Huili Peng, Yong Hu, Kenneth MC Cheung arxiv

Adolescent Idiopathic Scoliosis (AIS) is a prevalent spinal deformity whose progression can be mitigated through early detection. Conventional screening methods are often subjective, difficult to scale, and reliant on specialized clinical expertise. Video-based gait analysis offers a promising alternative, but current datasets and methods frequently suffer from data leakage, where performance is inflated by repeated clips from the same individual, or employ oversimplified models that lack clinical interpretability. To address these limitations, we introduce ScoliGait, a new benchmark dataset comprising 1,572 gait video clips for training and 300 fully independent clips for testing. Each clip is annotated with radiographic Cobb angles and descriptive text based on clinical kinematic priors. We propose a multi-modal framework that integrates a clinical-prior-guided kinematic knowledge map for interpretable feature representation, alongside a latent attention pooling mechanism to fuse video, text, and knowledge map modalities. Our method establishes a new state-of-the-art, demonstrating a significant performance gap on a realistic, non-repeating subject benchmark. Our approach establishes a new state of the art, showing a significant performance gain on a realistic, subject-independent benchmark. This work provides a robust, interpretable, and clinically grounded foundation for scalable, non-invasive AIS assessment.

📄 PDF Abstract BibTeX arXiv:2602.06743

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

MedPatch: Confidence-Guided Multi-Stage Fusion for Multimodal Clinical Data

2025-08-07 · Baraa Al Jorf, Farah Shamout arxiv

Clinical decision-making relies on the integration of information across various data modalities, such as clinical time-series, medical images and textual reports. Compared to other domains, real-world medical data is he…

Mortality Prediction

M$^3$Care: Learning with Missing Modalities in Multimodal Healthcare Data

2022-10-28 · Chaohe Zhang, Xu Chu, Liantao Ma, Yinghao Zhu 외

Multimodal electronic health record (EHR) data are widely used in clinical applications. Conventional methods usually assume that each sample (patient) is associated with the unified observed modalities, and all modaliti…

Enhancing Phenotype Discovery in Electronic Health Records through Prior Knowledge-Guided Unsupervised Learning

2025-11-03 · Melanie Mayer, Kimberly Lactaoen, Gary E. Weissman, Blanca E. Himes 외 arxiv

Objectives: Unsupervised learning with electronic health record (EHR) data has shown promise for phenotype discovery, but approaches typically disregard existing clinical information, limiting interpretability. We operat…

Clinical Knowledge

MMFusion: Multi-modality Diffusion Model for Lymph Node Metastasis Diagnosis in Esophageal Cancer

2024-05-15 · Chengyu Wu, Chengkai Wang, Yaqi Wang, Huiyu Zhou 외

Esophageal cancer is one of the most common types of cancer worldwide and ranks sixth in cancer-related mortality. Accurate computer-assisted diagnosis of cancer progression can help physicians effectively customize pers…

Representation Learning

Learning Dynamic Representations and Policies from Multimodal Clinical Time-Series with Informative Missingness

2026-04-23 · Zihan Liang, Ziwen Pan, Ruoxuan Xiong arxiv

Multimodal clinical records contain structured measurements and clinical notes recorded over time, offering rich temporal information about the evolution of patient health. Yet these observations are sparse, and whether …

Representation LearningMortality Prediction