paper-with-me

홈 › Papers

Computational Efficient Width-Wise Early Exiting in Wireless Communication Systems

2024-05-06 · Dieter Verbruggen, Hazem Sallouha, Sofie Pollin

Deep learning (DL) techniques are increasingly pervasive across various domains, including wireless communication, where they extract insights from raw radio signals. However, the computational demands of DL pose significant challenges, particularly in distributed wireless networks like Cell-free networks, where deploying DL models on edge devices becomes hard due to heightened computational loads. These computational loads escalate with larger input sizes, often correlating with improved model performance. To mitigate this challenge, Early Exiting (EE) techniques have been introduced in DL, primarily targeting the depth of the model. This approach enables models to exit during inference based on specified criteria, leveraging entropy measures at intermediate exits. Doing so makes less complex samples exit early, reducing the average computational load and inference time. In our contribution, we propose a novel width-wise exiting strategy for Convolutional Neural Network (CNN)-based architectures. By selectively adjusting the input size, we aim to regulate computational demands effectively. Our approach aims to decrease the average computational load during inference while maintaining performance levels comparable to conventional models. We specifically investigate Modulation Classification, a well-established application of DL in wireless communication. Our experimental results show substantial reductions in computational load, with an average decrease of 26%, and particularly notable reductions of 60% in high-SNR scenarios. Through this work, we present a practical solution for reducing computational demands in deep learning applications, particularly within the domain of wireless communication.

📄 PDF Abstract BibTeX arXiv:2405.03222

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Early exiting Exit whenever the model is confident enough allowing early exiting from hidden layers

Similar Papers 제목 키워드 기반

Magic Pyramid: Accelerating Inference with Early Exiting and Token Pruning

2021-10-30 · Xuanli He, Iman Keivanloo, Yi Xu, Xiang He 외

Pre-training and then fine-tuning large language models is commonly used to achieve state-of-the-art performance in natural language processing (NLP) tasks. However, most pre-trained models suffer from low inference spee…

text-classificationText Classification

Magic Pyramid: Accelerating Inference with Early Exiting and Token Pruning

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Pre-training and then fine-tuning large language models is commonly used to achieve state-of-the-art performance in natural language processing (NLP) tasks. However, most pre-trained models suffer from low inference spe…

text-classificationText Classification

Adaptive Early Exiting for Collaborative Inference over Noisy Wireless Channels

2023-11-29 · Mikolaj Jankowski, Deniz Gunduz, Krystian Mikolajczyk

Collaborative inference systems are one of the emerging solutions for deploying deep neural networks (DNNs) at the wireless network edge. Their main idea is to divide a DNN into two parts, where the first is shallow enou…

Collaborative Inferenceimage-classificationImage Classification

Using Early Exits for Fast Inference in Automatic Modulation Classification

2023-08-22 · Elsayed Mohammed, Omar Mashaal, Hatem Abou-zeid

Automatic modulation classification (AMC) plays a critical role in wireless communications by autonomously classifying signals transmitted over the radio spectrum. Deep learning (DL) techniques are increasingly being use…

Amortized-Precision Quantization for Early-Exit Vision Transformers

2026-05-08 · Rui Fang, Hsi-Wen Chen, Ming-Syan Chen arxiv

Vision Transformers (ViTs) achieve strong performance across vision tasks, yet their deployment with low-precision early exiting remains fragile. Existing quantization methods assume static full-depth execution, making t…