paper-with-me

홈 › Papers

HealthCAT: An Interpretable Encoder-only Transformer Framework for Health Indicator Prediction and Temporal Interpretation of Wearable Sensor Data

2026-07-30 · Xiaotong Yu, Joshua Y. Kim, HaeJin Lee, Kalina Yacef arxiv

Wearable sensors continuously capture fine-grained multivariate time-series data, providing opportunities to model behavioural patterns associated with health outcomes. However, existing deep learning methods prioritise predictive accuracy over interpretability, limiting their application in health research. In this study, we present HealthCAT, a flexible framework that integrates an Encoder-only Transformer with an Attentive Class Activation Token (AttentiveCAT) to generate class-specific, time-step-level interpretations. These interpretations can be mapped back onto behavioural cycles that are relevant to the domain (e.g., time-of-day), supporting individual-level analysis of wearable sensor data. We evaluated HealthCAT using two real-world wearable sensor datasets (306 participants in total). HealthCAT outperformed deep learning baselines by up to 17\% in F1-score and 12\% in accuracy on both datasets ($p<0.05$). In masking experiments, the time steps identified by HealthCAT carried significantly more predictive value than random selection across all masking conditions ($p<0.05$), indicating that the identified time steps are predictively informative. By coupling predictive performance with validated time-step-level interpretability, HealthCAT moves wearable sensor analysis beyond aggregated metrics towards temporal patterns that support health monitoring, behavioural pattern analysis, and intervention design in health research. The significance of this work is that it enables accurate prediction of health indicators from wearable sensor data while providing insights into when and how physical activity patterns occur, rather than relying solely on aggregated summary measures.

📄 PDF Abstract BibTeX arXiv:2607.27635

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DecoderLens: Layerwise Interpretation of Encoder-Decoder Transformers

2023-10-05 · Anna Langedijk, Hosein Mohebbi, Gabriele Sarti, Willem Zuidema 외

In recent years, many interpretability methods have been proposed to help interpret the internal states of Transformer-models, at different levels of precision and complexity. Here, to analyze encoder-decoder Transformer…

DecoderLogical ReasoningMachine TranslationQuestion Answering+2

TIDE : Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation

2025-03-10 · Victor Shea-Jay Huang, Le Zhuo, Yi Xin, Zhaokai Wang 외

Diffusion Transformers (DiTs) are a powerful yet underexplored class of generative models compared to U-Net-based diffusion models. To bridge this gap, we introduce TIDE (Temporal-aware Sparse Autoencoders for Interpreta…

DenoisingImage GenerationStyle Transfer

Transformers in Medicine: Improving Vision-Language Alignment for Medical Image Captioning

2025-10-29 · Yogesh Thakku Suresh, Vishwajeet Shivaji Hogale, Luca-Alexandru Zamfira, Anandavardhana Hegde arxiv

We present a transformer-based multimodal framework for generating clinically relevant captions for MRI scans. Our system combines a DEiT-Small vision transformer as an image encoder, MediCareBERT for caption embedding, …

Image Captioning

Interpreting vision transformers via residual replacement model

2025-09-22 · Jinyeong Kim, Junhyeok Kim, Yumin Shim, Joohyeok Kim 외 arxiv

How do vision transformers (ViTs) represent and process the world? This paper addresses this long-standing question through the first systematic analysis of 6.6K features across all layers, extracted via sparse autoencod…

DifFRACT: Diffusion Feature Reconstruction and Attribution for Circuit Tracing

2026-06-14 · Artyom Mazur, Nina Konovalova, Aibek Alanov arxiv

Mechanistic interpretability seeks to explain neural network behavior by decomposing model computations into interpretable features and circuits. While transcoder-based circuit tracing has recently enabled detailed causa…

Image Generation