paper-with-me

홈 › Papers

Foundation Artificial Intelligence Models for Health Recognition Using Face Photographs (FAHR-Face)

2025-06-17 · Fridolin Haugg, Grace Lee, John He, Leonard Nürnberg, Dennis Bontempi, Danielle S. Bitterman, Paul Catalano, Vasco Prudente, Dmitrii Glubokov, Andrew Warrington, Suraj Pai, Dirk De Ruysscher, Christian Guthier, Benjamin H. Kann, Vadim N. Gladyshev, Hugo JWL Aerts, Raymond H. Mak

Background: Facial appearance offers a noninvasive window into health. We built FAHR-Face, a foundation model trained on >40 million facial images and fine-tuned it for two distinct tasks: biological age estimation (FAHR-FaceAge) and survival risk prediction (FAHR-FaceSurvival). Methods: FAHR-FaceAge underwent a two-stage, age-balanced fine-tuning on 749,935 public images; FAHR-FaceSurvival was fine-tuned on 34,389 photos of cancer patients. Model robustness (cosmetic surgery, makeup, pose, lighting) and independence (saliency mapping) was tested extensively. Both models were clinically tested in two independent cancer patient datasets with survival analyzed by multivariable Cox models and adjusted for clinical prognostic factors. Findings: For age estimation, FAHR-FaceAge had the lowest mean absolute error of 5.1 years on public datasets, outperforming benchmark models and maintaining accuracy across the full human lifespan. In cancer patients, FAHR-FaceAge outperformed a prior facial age estimation model in survival prognostication. FAHR-FaceSurvival demonstrated robust prediction of mortality, and the highest-risk quartile had more than triple the mortality of the lowest (adjusted hazard ratio 3.22; P<0.001). These findings were validated in the independent cohort and both models showed generalizability across age, sex, race and cancer subgroups. The two algorithms provided distinct, complementary prognostic information; saliency mapping revealed each model relied on distinct facial regions. The combination of FAHR-FaceAge and FAHR-FaceSurvival improved prognostic accuracy. Interpretation: A single foundation model can generate inexpensive, scalable facial biomarkers that capture both biological ageing and disease-related mortality risk. The foundation model enabled effective training using relatively small clinical datasets.

📄 PDF Abstract BibTeX arXiv:2506.14909

Code (0)

등록된 구현이 없습니다.

Tasks

Age Estimation

Similar Papers 제목 키워드 기반

Benchmarking Foundation Models for Zero-Shot Biometric Tasks

2025-05-30 · Redwan Sony, Parisa Farmanifard, Hamzeh Alzwairy, Nitish Shukla 외

The advent of foundation models, particularly Vision-Language Models (VLMs) and Multi-modal Large Language Models (MLLMs), has redefined the frontiers of artificial intelligence, enabling remarkable generalization across…

AttributeBenchmarkingDeepFake DetectionFace Swapping+2

Artificial Behavior Intelligence: Technology, Challenges, and Future Directions

2025-05-06 · KangHyun Jo, Jehwan Choi, Kwanho Kim, Seongmin Kim 외

Understanding and predicting human behavior has emerged as a core capability in various AI application domains such as autonomous driving, smart healthcare, surveillance systems, and social robotics. This paper defines t…

Autonomous DrivingEmotion RecognitionKnowledge DistillationPose Estimation

Emotion Recognition and Generation: A Comprehensive Review of Face, Speech, and Text Modalities

2025-02-02 · Rebecca Mobbs, Dimitrios Makris, Vasileios Argyriou

Emotion recognition and generation have emerged as crucial topics in Artificial Intelligence research, playing a significant role in enhancing human-computer interaction within healthcare, customer service, and other fie…

Emotion Recognition

On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligence

2023-04-13 · Gengchen Mai, Weiming Huang, Jin Sun, Suhang Song 외

Large pre-trained models, also known as foundation models (FMs), are trained in a task-agnostic manner on large-scale data and can be adapted to a wide range of downstream tasks by fine-tuning, few-shot, or even zero-sho…

Few-Shot LearningScene ClassificationTime Series ForecastingToponym Recognition+1

Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

2024-10-30 · Keyu Chen, Cheng Fei, Ziqian Bi, Junyu Liu 외

With a focus on natural language processing (NLP) and the role of large language models (LLMs), we explore the intersection of machine learning, deep learning, and artificial intelligence. As artificial intelligence cont…

text-classificationText Classification