paper-with-me

Papers

Pruning Sparse Tensor Neural Networks Enables Deep Learning for 3D Ultrasound Localization Microscopy

2024-02-14 · Brice Rauby, Paul Xing, Jonathan Porée, Maxime Gasse, Jean Provost

Ultrasound Localization Microscopy (ULM) is a non-invasive technique that allows for the imaging of micro-vessels in vivo, at depth and with a resolution on the order of ten microns. ULM is based on the sub-resolution localization of individual microbubbles injected in the bloodstream. Mapping the whole angioarchitecture requires the accumulation of microbubbles trajectories from thousands of frames, typically acquired over a few minutes. ULM acquisition times can be reduced by increasing the microbubble concentration, but requires more advanced algorithms to detect them individually. Several deep learning approaches have been proposed for this task, but they remain limited to 2D imaging, in part due to the associated large memory requirements. Herein, we propose to use sparse tensor neural networks to reduce memory usage in 2D and to improve the scaling of the memory requirement for the extension of deep learning architecture to 3D. We study several approaches to efficiently convert ultrasound data into a sparse format and study the impact of the associated loss of information. When applied in 2D, the sparse formulation reduces the memory requirements by a factor 2 at the cost of a small reduction of performance when compared against dense networks. In 3D, the proposed approach reduces memory requirements by two order of magnitude while largely outperforming conventional ULM in high concentration settings. We show that Sparse Tensor Neural Networks in 3D ULM allow for the same benefits as dense deep learning based method in 2D ULM i.e. the use of higher concentration in silico and reduced acquisition time.

📄 PDF Abstract BibTeX arXiv:2402.09359

Code (1)

provostultrasoundlab/sparsetensorulm 공식 구현 pytorch

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

VENOM: A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores

2023-10-03 · Roberto L. Castro, Andrei Ivanov, Diego Andrade, Tal Ben-Nun 외

The increasing success and scaling of Deep Learning models demands higher computational efficiency and power. Sparsification can lead to both smaller models as well as higher compute efficiency, and accelerated hardware …

Computational Efficiency

Squeeze-Release: Iterative Pruning with Exact Structural Minimization

2026-06-12 · Roman Denkin, Ida Akerholm, Prashant Singh, Ida-Maria Sintorn arxiv

Unstructured pruning produces sparse weight tensors, but the standard implementation keeps tensor shapes unchanged so the deployed model is no smaller than before pruning. We present an exact structural rewrite, which we…

Low-Rank+Sparse Tensor Compression for Neural Networks

2021-11-02 · Cole Hawkins, Haichuan Yang, Meng Li, Liangzhen Lai 외

Low-rank tensor compression has been proposed as a promising approach to reduce the memory and compute requirements of neural networks for their deployment on edge devices. Tensor compression reduces the number of parame…

Tensor Decomposition

S$^3$: Structured Sparsity Specification

2026-04-13 · Ayoub Ghriss arxiv

We introduce the Structured Sparsity Specification (S$^3$), an algebraic framework for defining, composing, and implementing structured sparse patterns. S$^3$ specifies sparsity through three components: a View that resh…

Fast and selective super-resolution ultrasound in vivo with sono-switchable nanodroplets

2022-03-08 · Kai Riemer, Matthieu Toulemonde, Jipeng Yan, Marcelo Lerendegui 외

Perfusion by the microcirculation is key to the development, maintenance and pathology of tissue. Its measurement with high spatiotemporal resolution is consequently valuable but remains a challenge in deep tissue. Ultra…

Super-Resolution