paper-with-me

홈 › Papers

SegNAS3D: Network Architecture Search with Derivative-Free Global Optimization for 3D Image Segmentation

2019-09-12 · Ken C. L. Wong, Mehdi Moradi

Deep learning has largely reduced the need for manual feature selection in image segmentation. Nevertheless, network architecture optimization and hyperparameter tuning are mostly manual and time consuming. Although there are increasing research efforts on network architecture search in computer vision, most works concentrate on image classification but not segmentation, and there are very limited efforts on medical image segmentation especially in 3D. To remedy this, here we propose a framework, SegNAS3D, for network architecture search of 3D image segmentation. In this framework, a network architecture comprises interconnected building blocks that consist of operations such as convolution and skip connection. By representing the block structure as a learnable directed acyclic graph, hyperparameters such as the number of feature channels and the option of using deep supervision can be learned together through derivative-free global optimization. Experiments on 43 3D brain magnetic resonance images with 19 structures achieved an average Dice coefficient of 82%. Each architecture search required less than three days on three GPUs and produced architectures that were much smaller than the state-of-the-art manually created architectures.

📄 PDF Abstract BibTeX arXiv:1909.05962

Code (0)

등록된 구현이 없습니다.

Tasks

feature selectionglobal-optimizationimage-classificationImage ClassificationImage SegmentationMedical Image SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

HyperSegNAS: Bridging One-Shot Neural Architecture Search with 3D Medical Image Segmentation using HyperNet

2021-12-20 · CVPR 2022 1 · Cheng Peng, Andriy Myronenko, Ali Hatamizadeh, Vish Nath 외

Semantic segmentation of 3D medical images is a challenging task due to the high variability of the shape and pattern of objects (such as organs or tumors). Given the recent success of deep learning in medical image segm…

Image SegmentationMedical Image SegmentationNeural Architecture SearchSegmentation+1

Enhancing Optimization Performance: A Novel Hybridization of Gaussian Crunching Search and Powell's Method for Derivative-Free Optimization

2023-08-09 · Benny Wong

This research paper presents a novel approach to enhance optimization performance through the hybridization of Gaussian Crunching Search (GCS) and Powell's Method for derivative-free optimization. While GCS has shown pro…

Derivative-Free Global Optimization Algorithms: Population based Methods and Random Search Approaches

2019-04-19 · Jiawei Zhang

In this paper, we will provide an introduction to the derivative-free optimization algorithms which can be potentially applied to train deep learning models. Existing deep learning model training is mostly based on the b…

Deep Learningglobal-optimization

Neural Global Optimization via Iterative Refinement from Noisy Samples

2026-04-04 · Qusay Muzaffar, David Levin, Michael Werman arxiv

Global optimization of black-box functions from noisy samples is a fundamental challenge in machine learning and scientific computing. Traditional methods such as Bayesian Optimization often converge to local minima on m…

ZOOpt: Toolbox for Derivative-Free Optimization

2017-12-31 · Yu-Ren Liu, Yi-Qi Hu, Hong Qian, Chao Qian 외

Recent advances in derivative-free optimization allow efficient approximation of the global-optimal solutions of sophisticated functions, such as functions with many local optima, non-differentiable and non-continuous fu…

BIG-bench Machine LearningDistributed Optimization