paper-with-me

Papers

Robust Information Bottleneck for Task-Oriented Communication with Digital Modulation

2022-09-21 · Songjie Xie, Shuai Ma, Ming Ding, Yuanming Shi, Mingjian Tang, Youlong Wu

Task-oriented communications, mostly using learning-based joint source-channel coding (JSCC), aim to design a communication-efficient edge inference system by transmitting task-relevant information to the receiver. However, only transmitting task-relevant information without introducing any redundancy may cause robustness issues in learning due to the channel variations, and the JSCC which directly maps the source data into continuous channel input symbols poses compatibility issues on existing digital communication systems. In this paper, we address these two issues by first investigating the inherent tradeoff between the informativeness of the encoded representations and the robustness to information distortion in the received representations, and then propose a task-oriented communication scheme with digital modulation, named discrete task-oriented JSCC (DT-JSCC), where the transmitter encodes the features into a discrete representation and transmits it to the receiver with the digital modulation scheme. In the DT-JSCC scheme, we develop a robust encoding framework, named robust information bottleneck (RIB), to improve the communication robustness to the channel variations, and derive a tractable variational upper bound of the RIB objective function using the variational approximation to overcome the computational intractability of mutual information. The experimental results demonstrate that the proposed DT-JSCC achieves better inference performance than the baseline methods with low communication latency, and exhibits robustness to channel variations due to the applied RIB framework.

📄 PDF Abstract BibTeX arXiv:2209.10382

Code (1)

SongjieXie/Discrete-TaskOriented-JSCC 공식 구현 pytorch

Tasks

Informativeness

Similar Papers 제목 키워드 기반

Aligning Task- and Reconstruction-Oriented Communications for Edge Intelligence

2025-02-21 · Yufeng Diao, Yichi Zhang, Changyang She, Philip Guodong Zhao 외

Existing communication systems aim to reconstruct the information at the receiver side, and are known as reconstruction-oriented communications. This approach often falls short in meeting the real-time, task-specific dem…

Autonomous DrivingSemantic Segmentation

Adversarial Robustness of Bottleneck Injected Deep Neural Networks for Task-Oriented Communication

2024-12-13 · Alireza Furutanpey, Pantelis A. Frangoudis, Patrik Szabo, Schahram Dustdar

This paper investigates the adversarial robustness of Deep Neural Networks (DNNs) using Information Bottleneck (IB) objectives for task-oriented communication systems. We empirically demonstrate that while IB-based appro…

Adversarial Robustness

Task-Oriented Communication for Graph Data: A Graph Information Bottleneck Approach

2024-09-04 · Shujing Li, Yanhu Wang, Shuaishuai Guo, Chenyuan Feng

Graph data, essential in fields like knowledge representation and social networks, often involves large networks with many nodes and edges. Transmitting these graphs can be highly inefficient due to their size and redund…

Quantization

Task-Oriented Communication with Out-of-Distribution Detection: An Information Bottleneck Framework

2023-05-21 · Hongru Li, Wentao Yu, Hengtao He, Jiawei Shao 외

Task-oriented communication is an emerging paradigm for next-generation communication networks, which extracts and transmits task-relevant information, instead of raw data, for downstream applications. Most existing deep…

InformativenessOut-of-Distribution Detection

Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach

2021-02-08 · Jiawei Shao, Yuyi Mao, Jun Zhang

This paper investigates task-oriented communication for edge inference, where a low-end edge device transmits the extracted feature vector of a local data sample to a powerful edge server for processing. It is critical t…

Dynamic neural networksInformativeness