rNCA: Self-Repairing Segmentation Masks
Accurately predicting topologically correct masks remains a difficult task for general segmentation models, which often produce fragmented or disconnected outputs. Fixing these artifacts typically requires hand-crafted refinement rules or architectures specialized to a particular task. Here, we show that Neural Cellular Automata (NCA) can be directly re-purposed as an effective refinement mechanism, using local, iterative updates guided by image context to repair segmentation masks. By training on imperfect masks and ground truths, the automaton learns the structural properties of the target shape while relying solely on local information. When applied to coarse, globally predicted masks, the learned dynamics progressively reconnect broken regions, prune loose fragments and converge towards stable, topologically consistent results. We show how refinement NCA (rNCA) can be easily applied to repair common topological errors produced by different base segmentation models and tasks: for fragmented retinal vessels, it yields 2-3% gains in Dice/clDice and improves Betti errors, reducing $β_0$ errors by 60% and $β_1$ by 20%; for myocardium, it repairs 61.5% of broken cases in a zero-shot setting while lowering ASSD and HD by 19% and 16%, respectively. This showcases NCA as effective and broadly applicable refiners.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
HyperNCA: Growing Developmental Networks with Neural Cellular Automata
In contrast to deep reinforcement learning agents, biological neural networks are grown through a self-organized developmental process. Here we propose a new hypernetwork approach to grow artificial neural networks based…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Self-repairing Classification Algorithms for Chemical Sensor Array
Chemical sensors are usually affected by drift, have low fabrication reproducibility and can experience failure or breaking events over the long term. Albeit improvements in fabrication processes are often slow and inade…
ClassificationMaskSplit: Self-supervised Meta-learning for Few-shot Semantic Segmentation
Just like other few-shot learning problems, few-shot segmentation aims to minimize the need for manual annotation, which is particularly costly in segmentation tasks. Even though the few-shot setting reduces this cost fo…
Few-Shot LearningFew-Shot Semantic SegmentationMeta-LearningSaliency Prediction+2Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking
Multi-object tracking (MOT) methods often rely on Intersection-over-Union (IoU) for association. However, this becomes unreliable when objects are similar or occluded. Also, computing IoU for segmentation masks is comput…
Multi-Object TrackingA Three-Stage Self-Training Framework for Semi-Supervised Semantic Segmentation
Semantic segmentation has been widely investigated in the community, in which the state of the art techniques are based on supervised models. Those models have reported unprecedented performance at the cost of requiring …
SegmentationSemantic SegmentationSemi-Supervised Semantic Segmentation