paper-with-me

홈 › Papers

Causal-Transformer with Adaptive Mutation-Locking for Early Prediction of Acute Kidney Injury

2026-04-22 · Weizhi Nie, Haolin Chen arxiv

Accurate early prediction of Acute Kidney Injury (AKI) is critical for timely clinical intervention. However, existing deep learning models struggle with irregularly sampled data and suffer from the opaque "black-box" nature of sequential architectures, strictly limiting clinical trust. To address these challenges, we propose CT-Former, integrating continuous-time modeling with a Causal-Transformer. To handle data irregularity without biased artificial imputation, our framework utilizes a continuous-time state evolution mechanism to naturally track patient temporal trajectories. To resolve the black-box problem, our Causal-Attention module abandons uninterpretable hidden state aggregation. Instead, it generates a directed structural causal matrix to identify and trace the exact historical onset of severe physiological shocks. By establishing clear causal pathways between historical anomalies and current risk predictions, CT-Former provides native clinical interpretability. Training follows a decoupled two-stage protocol to optimize the causal-fusion process independently. Extensive experiments on the MIMIC-IV cohort (N=18,419) demonstrate that CT-Former significantly outperforms state-of-the-art baselines. The results confirm that our explicitly transparent architecture offers an accurate and trustworthy tool for clinical decision-making.

📄 PDF Abstract BibTeX arXiv:2604.20259

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Identification of a DAGLB Mutation in a Non-Chinese Patient with Parkinson's Disease

2023-10-19 · Christelle Tesson, Mohamed Sofiane Bouchetara, Mélanie Ferrien, Suzanne Lesage 외

Liu et al. recently reported that biallelic mutations in DAGLB are responsible for autosomal recessive early-onset Parkinson's disease. They identified six patients carrying DAGLB mutations, all of Chinese origin and pre…

Breaking Symmetry When Training Transformers

2024-02-06 · Chunsheng Zuo, Michael Guerzhoy

As we show in this paper, the prediction for output token $n+1$ of Transformer architectures without one of the mechanisms of positional encodings and causal attention is invariant to permutations of input tokens $1, 2, …

The Impossibility of Inverse Permutation Learning in Transformer Models

2025-09-28 · Rohan Alur, Chris Hays, Manish Raghavan, Devavrat Shah arxiv

In this technical note, we study the problem of inverse permutation learning in decoder-only transformers. Given a permutation and a string to which that permutation has been applied, the model is tasked with producing t…

Causal Drawbridges: Characterizing Gradient Blocking of Syntactic Islands in Transformer LMs

2026-04-15 · Sasha Boguraev, Kyle Mahowald arxiv

We show how causal interventions in Transformer models provide insights into English syntax by focusing on a long-standing challenge for syntactic theory: syntactic islands. Extraction from coordinated verb phrases is of…

Topological data analysis identifies emerging adaptive mutations in SARS-CoV-2

2021-06-14 · Michael Bleher, Lukas Hahn, Maximilian Neumann, Juan Angel Patino-Galindo 외

The COVID-19 pandemic has initiated an unprecedented worldwide effort to characterize its evolution through the mapping of mutations of the coronavirus SARS-CoV-2. The early identification of mutations that could confer …

Topological Data Analysis