paper-with-me

홈 › Papers

Structured Model Pruning for Efficient Inference in Computational Pathology

2024-04-12 · Mohammed Adnan, Qinle Ba, Nazim Shaikh, Shivam Kalra, Satarupa Mukherjee, Auranuch Lorsakul

Recent years have seen significant efforts to adopt Artificial Intelligence (AI) in healthcare for various use cases, from computer-aided diagnosis to ICU triage. However, the size of AI models has been rapidly growing due to scaling laws and the success of foundational models, which poses an increasing challenge to leverage advanced models in practical applications. It is thus imperative to develop efficient models, especially for deploying AI solutions under resource-constrains or with time sensitivity. One potential solution is to perform model compression, a set of techniques that remove less important model components or reduce parameter precision, to reduce model computation demand. In this work, we demonstrate that model pruning, as a model compression technique, can effectively reduce inference cost for computational and digital pathology based analysis with a negligible loss of analysis performance. To this end, we develop a methodology for pruning the widely used U-Net-style architectures in biomedical imaging, with which we evaluate multiple pruning heuristics on nuclei instance segmentation and classification, and empirically demonstrate that pruning can compress models by at least 70% with a negligible drop in performance.

📄 PDF Abstract BibTeX arXiv:2404.08831

Code (0)

등록된 구현이 없습니다.

Tasks

Instance SegmentationModel CompressionSemantic Segmentation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Pruning 설명 없음

Similar Papers 제목 키워드 기반

R-TOSS: A Framework for Real-Time Object Detection using Semi-Structured Pruning

2023-03-03 · Abhishek Balasubramaniam, Febin P Sunny, Sudeep Pasricha

Object detectors used in autonomous vehicles can have high memory and computational overheads. In this paper, we introduce a novel semi-structured pruning framework called R-TOSS that overcomes the shortcomings of state-…

Autonomous VehiclesObjectobject-detectionObject Detection+1

GoPrune: Accelerated Structured Pruning with $\ell_{2,p}$-Norm Optimization

2025-11-27 · Li Xu, Xianchao Xiu arxiv

Convolutional neural networks (CNNs) suffer from rapidly increasing storage and computational costs as their depth grows, which severely hinders their deployment on resource-constrained edge devices. Pruning is a practic…

Computational EfficiencyNetwork Pruning

S4oP: Operator-level Pruning of Structured State Space Models for Resource-Constrained Devices

2026-06-16 · Marco Deano, Filippo Ziche, Nicola Bombieri arxiv

Structured State Space Models (SSMs), including the S4 and S4D architectures, have recently emerged as powerful alternatives to attention-based models for capturing long-range dependencies in sequential data. Despite the…

A Comparative Study of Pruning Methods in Transformer-based Time Series Forecasting

2024-12-17 · Nicholas Kiefer, Arvid Weyrauch, Muhammed Öz, Achim Streit 외

The current landscape in time-series forecasting is dominated by Transformer-based models. Their high parameter count and corresponding demand in computational resources pose a challenge to real-world deployment, especia…

Time SeriesTime Series Forecasting

The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models

2022-03-14 · Eldar Kurtic, Daniel Campos, Tuan Nguyen, Elias Frantar 외

Transformer-based language models have become a key building block for natural language processing. While these models are extremely accurate, they can be too large and computationally intensive to run on standard deploy…

CPUQuantization