paper-with-me

Papers

DAGrid: Directed Accumulator Grid

2023-06-05 · Hang Zhang, Renjiu Hu, Xiang Chen, Rongguang Wang, Jinwei Zhang, Jiahao Li

Recent research highlights that the Directed Accumulator (DA), through its parametrization of geometric priors into neural networks, has notably improved the performance of medical image recognition, particularly with small and imbalanced datasets. However, DA's potential in pixel-wise dense predictions is unexplored. To bridge this gap, we present the Directed Accumulator Grid (DAGrid), which allows geometric-preserving filtering in neural networks, thus broadening the scope of DA's applications to include pixel-level dense prediction tasks. DAGrid utilizes homogeneous data types in conjunction with designed sampling grids to construct geometrically transformed representations, retaining intricate geometric information and promoting long-range information propagation within the neural networks. Contrary to its symmetric counterpart, grid sampling, which might lose information in the sampling process, DAGrid aggregates all pixels, ensuring a comprehensive representation in the transformed space. The parallelization of DAGrid on modern GPUs is facilitated using CUDA programming, and also back propagation is enabled for deep neural network training. Empirical results show DAGrid-enhanced neural networks excel in supervised skin lesion segmentation and unsupervised cardiac image registration. Specifically, the network incorporating DAGrid has realized a 70.8% reduction in network parameter size and a 96.8% decrease in FLOPs, while concurrently improving the Dice score for skin lesion segmentation by 1.0% compared to state-of-the-art transformers. Furthermore, it has achieved improvements of 4.4% and 8.2% in the average Dice score and Dice score of the left ventricular mass, respectively, indicating an increase in registration accuracy for cardiac images. The source code is available at https://github.com/tinymilky/DeDA.

📄 PDF Abstract BibTeX arXiv:2306.02589

Code (1)

tinymilky/deda 공식 구현 pytorch

Tasks

Image RegistrationLesion SegmentationSkin Lesion Segmentation

Similar Papers 제목 키워드 기반

AdaGrid: Adaptive Grid Search for Link Prediction Training Objective

2022-03-30 · Tim Poštuvan, Jiaxuan You, Mohammadreza Banaei, Rémi Lebret 외

One of the most important factors that contribute to the success of a machine learning model is a good training objective. Training objective crucially influences the model's performance and generalization capabilities. …

BIG-bench Machine LearningGraph Neural NetworkLink Prediction

DeDA: Deep Directed Accumulator

2023-03-15 · Hang Zhang, Rongguang Wang, Renjiu Hu, Jinwei Zhang 외

Chronic active multiple sclerosis lesions, also termed as rim+ lesions, can be characterized by a hyperintense rim at the edge of the lesion on quantitative susceptibility maps. These rim+ lesions exhibit a geometrically…

A2Q: Accumulator-Aware Quantization with Guaranteed Overflow Avoidance

2023-08-25 · ICCV 2023 1 · Ian Colbert, Alessandro Pappalardo, Jakoba Petri-Koenig

We present accumulator-aware quantization (A2Q), a novel weight quantization method designed to train quantized neural networks (QNNs) to avoid overflow when using low-precision accumulators during inference. A2Q introdu…

Quantization

Quantization of Deep Neural Networks for Accumulator-constrained Processors

2020-04-24 · Barry de Bruin, Zoran Zivkovic, Henk Corporaal

We introduce an Artificial Neural Network (ANN) quantization methodology for platforms without wide accumulation registers. This enables fixed-point model deployment on embedded compute platforms that are not specificall…

ClassificationGeneral Classificationimage-classificationImage Classification+1

A2Q+: Improving Accumulator-Aware Weight Quantization

2024-01-19 · Ian Colbert, Alessandro Pappalardo, Jakoba Petri-Koenig, Yaman Umuroglu

Quantization techniques commonly reduce the inference costs of neural networks by restricting the precision of weights and activations. Recent studies show that also reducing the precision of the accumulator can further …

Quantization