paper-with-me

Papers

Stochastic Planner-Actor-Critic for Unsupervised Deformable Image Registration

2021-12-14 · Ziwei Luo, Jing Hu, Xin Wang, Shu Hu, Bin Kong, Youbing Yin, Qi Song, Xi Wu, Siwei Lyu

Large deformations of organs, caused by diverse shapes and nonlinear shape changes, pose a significant challenge for medical image registration. Traditional registration methods need to iteratively optimize an objective function via a specific deformation model along with meticulous parameter tuning, but which have limited capabilities in registering images with large deformations. While deep learning-based methods can learn the complex mapping from input images to their respective deformation field, it is regression-based and is prone to be stuck at local minima, particularly when large deformations are involved. To this end, we present Stochastic Planner-Actor-Critic (SPAC), a novel reinforcement learning-based framework that performs step-wise registration. The key notion is warping a moving image successively by each time step to finally align to a fixed image. Considering that it is challenging to handle high dimensional continuous action and state spaces in the conventional reinforcement learning (RL) framework, we introduce a new concept `Plan' to the standard Actor-Critic model, which is of low dimension and can facilitate the actor to generate a tractable high dimensional action. The entire framework is based on unsupervised training and operates in an end-to-end manner. We evaluate our method on several 2D and 3D medical image datasets, some of which contain large deformations. Our empirical results highlight that our work achieves consistent, significant gains and outperforms state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2112.07415

Code (1)

Algolzw/SPAC-Deformable-Registration 공식 구현 pytorch

Tasks

Deformable Medical Image RegistrationImage RegistrationMedical Image Registrationreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Average Pooling 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dilated Convolution 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
SAC 설명 없음

Similar Papers 제목 키워드 기반

Coordinated Manipulation of Hybrid Deformable-Rigid Objects in Constrained Environments

2026-03-13 · Anees Peringal, Anup Teejo Mathew, Panagiotis liatsis, Federico Renda arxiv

Coordinated robotic manipulation of deformable linear objects (DLOs), such as ropes and cables, has been widely studied; however, handling hybrid assemblies composed of both deformable and rigid elements in constrained e…

Multi-agent Soft Actor-Critic Based Hybrid Motion Planner for Mobile Robots

2021-12-13 · Zichen He, Lu Dong, Chunwei Song, Changyin Sun

In this paper, a novel hybrid multi-robot motion planner that can be applied under non-communication and local observable conditions is presented. The planner is model-free and can realize the end-to-end mapping of multi…

From Idea to Co-Creation: A Planner-Actor-Critic Framework for Agent Augmented 3D Modeling

2026-01-08 · Jin Gao, Saichandu Juluri arxiv

We present a framework that extends the Actor-Critic architecture to creative 3D modeling through multi-agent self-reflection and human-in-the-loop supervision. While existing approaches rely on single-prompt agents that…

Unsupervised Deep-Learning Based Deformable Image Registration: A Bayesian Framework

2020-08-10 · Samah Khawaled, Moti Freiman

Unsupervised deep-learning (DL) models were recently proposed for deformable image registration tasks. In such models, a neural-network is trained to predict the best deformation field by minimizing some dissimilarity fu…

Deep LearningImage Registration

GEM: Generating LiDAR World Model via Deformable Mamba

2026-05-08 · Yang Wu, Zhaojiang Liu, Qiang Meng, Youquan Liu 외 arxiv

World models, which simulate environmental dynamics and generate sensor observations, are gaining increasing attention in autonomous driving. However, progress in LiDAR-based world models has lagged behind those built on…

Autonomous DrivingPoint Clouds