paper-with-me

홈 › Papers

Amortized In-Context Mixed Effect Transformer Models: A Zero-Shot Approach for Pharmacokinetics

2025-08-21 · César Ali Ojeda Marin, Wilhelm Huisinga, Purity Kavwele, Ramsés J. Sánchez, Niklas Hartung arxiv

Accurate dose-response forecasting under sparse sampling is central to precision pharmacotherapy. We present the Amortized In-Context Mixed-Effect Transformer (AICMET) model, a transformer-based latent-variable framework that unifies mechanistic compartmental priors with amortized in-context Bayesian inference. AICMET is pre-trained on hundreds of thousands of synthetic pharmacokinetic trajectories with Ornstein-Uhlenbeck priors over the parameters of compartment models, endowing the model with strong inductive biases and enabling zero-shot adaptation to new compounds. At inference time, the decoder conditions on the collective context of previously profiled trial participants, generating calibrated posterior predictions for newly enrolled patients after a few early drug concentration measurements. This capability collapses traditional model-development cycles from weeks to hours while preserving some degree of expert modelling. Experiments across public datasets show that AICMET attains state-of-the-art predictive accuracy and faithfully quantifies inter-patient variability -- outperforming both nonlinear mixed-effects baselines and recent neural ODE variants. Our results highlight the feasibility of transformer-based, population-aware neural architectures as offering a new alternative for bespoke pharmacokinetic modeling pipelines, charting a path toward truly population-aware personalized dosing regimens.

📄 PDF Abstract BibTeX arXiv:2508.15659

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian Inference

Similar Papers 제목 키워드 기반

Amortized Active Causal Induction with Deep Reinforcement Learning

2024-05-26 · Yashas Annadani, Panagiotis Tigas, Stefan Bauer, Adam Foster

We present Causal Amortized Active Structure Learning (CAASL), an active intervention design policy that can select interventions that are adaptive, real-time and that does not require access to the likelihood. This poli…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningZero-shot Generalization

Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation

2026-06-30 · Jiachun Li, David Simchi-Levi arxiv

Adaptive experiments for average treatment effects (ATE) require randomized allocations balancing valid inference with statistical efficiency. The oracle design is a covariate-dependent Neyman rule governed by unknown ar…

Amortized Molecular Optimization via Group Relative Policy Optimization

2026-02-12 · Muhammad bin Javaid, Hasham Hussain, Ashima Khanna, Berke Kisin 외 arxiv

In structurally constrained molecular optimization, state-of-the-art methods restart an expensive oracle-driven search from scratch for every new input structure, scaling poorly to settings with many starting structures …

Reinforcement Learning

Beyond Token Eviction: Mixed-Dimension Budget Allocation for Efficient KV Cache Compression

2026-03-21 · Ruijie Miao, Zhiming Wang, Wang Li, Shiwei Wu 외 arxiv

Key-value (KV) caching is widely used to accelerate transformer inference, but its memory cost grows linearly with input length, limiting long-context deployment. Existing token eviction methods reduce memory by discardi…

Dimensionality Reduction

Mixed-effects transformers for hierarchical adaptation

2022-05-03 · Julia White, Noah Goodman, Robert Hawkins

Language use differs dramatically from context to context. To some degree, modern language models like GPT-3 are able to account for such variance by conditioning on a string of previous input text, or prompt. Yet prompt…

Domain Adaptation