Closed-loop coupling of personalised and foundation models for real-time treatment guidance with MRI
Image-guided therapies, including radiotherapy, biopsy and deep brain stimulation, rely on real-time targeting of anatomical structures. However, in the presence of motion, imaging latencies create a temporal misalignment between observed and true anatomy, compromising treatment accuracy. Artificial intelligence-based frameworks have increasingly been presented to close this latency gap, but leading personalised models can fail due to a lack of stable anatomical grounding. Foundation models can provide grounded behaviour, but they do not adapt to real-time, individual patient dynamics. Here we introduce a closed-loop coupling framework that synergises patient-specific temporal prediction with continuous segmentation-based anatomical interpretation from a foundation model. A personalised model predicts future anatomy to compensate for system latency, while a streaming foundation model provides anatomical supervision used to continuously update the temporal predictor in real time during treatment. We validate the framework using a digital phantom and intrafraction magnetic resonance imaging (MRI) from patients undergoing MRI-guided radiotherapy. For a prediction horizon of 400 ms, the proposed method improves anatomical prediction and reduces dosimetric error compared with existing approaches, within clinically relevant latency constraints. These results establish closed-loop coupling as a general strategy for real-time image-guided intervention.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
DeCoDrift: Stabilizing Decoder Coupling in Closed-Loop Foundation Segmentation
Foundation segmentation models such as Segment Anything Model (SAM) are now routinely used in iterative pipelines, where each predicted mask is fed back as the next prompt. This practice turns segmentation into a closed-…
Quasi-static closed-loop wind-farm control for combined power and fatigue optimization
We develop a methodology for combined power and loads optimization by coupling a surrogate loads model with an analytical quasi-static Gaussian wake merging model. The look-up table based fatigue model is developed offli…
Arcadia: Toward a Full-Lifecycle Framework for Embodied Lifelong Learning
We contend that embodied learning is fundamentally a lifecycle problem rather than a single-stage optimization. Systems that optimize only one link (data collection, simulation, learning, or deployment) rarely sustain im…
Representation LearningNear-optimal Closed-loop Method via Lyapunov Damping for Convex Optimization
We introduce an autonomous system with closed-loop damping for first-order convex optimization. While, to this day, optimal rates of convergence are almost exclusively achieved by non-autonomous methods via open-loop dam…
A novel parameter decoupling approach of personalized federated learning for image analysis
Given the importance of privacy protection in databases and other institutions, federated learning (FL) is used to benefit training machine learning models based on these decentralised and private data so as to address t…
Federated LearningPersonalized Federated Learning