paper-with-me

Papers

One Kernel to Solve Nearly Everything: Unified 3D Binary Convolutions for Image Analysis

2018-04-11 · MIDL 2018 4 · MP Heinrich, O Oktay, N Bouteldja

Deep networks have set the state-of-the-art in most image analysis tasks by replacing handcrafted features with learned convolution filters within end-to-end trainable architectures. Still, the specifications of a convolutional network are subject to much manual design - the shape and size of the receptive field for convolutional operations is a very sensitive part that has to be tuned for different image analysis applications. 3D fully-convolutional multi-scale architectures with skip-connection that excel at semantic segmentation and landmark localisation have huge memory requirements and rely on large annotated datasets - an important limitation for wider adaptation in medical image analysis. We propose a novel and effective method based on a single trainable 3D convolution kernel that addresses these issues and enables high quality results with a compact four-layer architecture and without sensitive hyperparameters for convolutions and architectural design. Instead of a manual choice of filter size, dilation of weights, and number of scales, our one binary extremely large and inflecting sparse kernel (OBELISK) automatically learns filter offsets in a differentiable continuous space together with weight coefficients. Geometric data augmentation can be directly incorporated into the training by simple coordinate transforms. This powerful new architecture has less than 130'000 parameters, can be trained in few minutes with only 700 MBytes of memory and achieves an increase of Dice overlap of +5.5\% compared to the U-Net for CT multi-organ segmentation.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationMedical Image AnalysisOrgan SegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
U-Net 설명 없음
3D Convolution A 3D Convolution is a type of convolution where the kernel slides in 3 dimensions as opposed to 2 dimensions with 2D…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Compacting Binary Neural Networks by Sparse Kernel Selection

2023-03-25 · CVPR 2023 1 · Yikai Wang, Wenbing Huang, Yinpeng Dong, Fuchun Sun 외

Binary Neural Network (BNN) represents convolution weights with 1-bit values, which enhances the efficiency of storage and computation. This paper is motivated by a previously revealed phenomenon that the binary kernels …

Binarization

Sparse Universum Quadratic Surface Support Vector Machine Models for Binary Classification

2021-04-03 · Hossein Moosaei, Ahmad Mousavi, Milan Hladík, Zheming Gao

In binary classification, kernel-free linear or quadratic support vector machines are proposed to avoid dealing with difficulties such as finding appropriate kernel functions or tuning their hyper-parameters. Furthermore…

Binary ClassificationGeneral Classification

A unified approach to mixed-integer optimization problems with logical constraints

2019-07-03 · Dimitris Bertsimas, Ryan Cory-Wright, Jean Pauphilet

We propose a unified framework to address a family of classical mixed-integer optimization problems with logically constrained decision variables, including network design, facility location, unit commitment, sparse port…

Sparse Learning

Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1

2016-02-09 · Matthieu Courbariaux, Itay Hubara, Daniel Soudry, Ran El-Yaniv 외

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time. At training-time the binary weights and activations are used for computing the parameters…

GPU

A New Kernel Regularity Condition for Distributed Mirror Descent: Broader Coverage and Simpler Analysis

2026-03-13 · Junwen Qiu, Ziyang Zeng, Leilei Mei, Junyu Zhang arxiv

Existing convergence of distributed optimization methods in non-Euclidean geometries typically rely on kernel assumptions: (i) global Lipschitz smoothness and (ii) bi-convexity of the associated Bregman divergence functi…

Distributed Optimization