paper-with-me

홈 › Papers

Vision Transformer Based Semantic Communications for Next Generation Wireless Networks

2025-03-21 · Muhammad Ahmed Mohsin, Muhammad Jazib, Zeeshan Alam, Muhmmad Farhan Khan, Muhammad Saad, Muhammad Ali Jamshed

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer (ViT)-based semantic communication framework that has been deliberately designed to achieve high semantic similarity during image transmission while simultaneously minimizing the demand for bandwidth. By equipping ViT as the encoder-decoder framework, the proposed architecture can proficiently encode images into a high semantic content at the transmitter and precisely reconstruct the images, considering real-world fading and noise consideration at the receiver. Building on the attention mechanisms inherent to ViTs, our model outperforms Convolution Neural Network (CNNs) and Generative Adversarial Networks (GANs) tailored for generating such images. The architecture based on the proposed ViT network achieves the Peak Signal-to-noise Ratio (PSNR) of 38 dB, which is higher than other Deep Learning (DL) approaches in maintaining semantic similarity across different communication environments. These findings establish our ViT-based approach as a significant breakthrough in semantic communications.

📄 PDF Abstract BibTeX arXiv:2503.17275

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderSemantic CommunicationSemantic SimilaritySemantic Textual Similarity

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Transformer Masked Autoencoders for Next-Generation Wireless Communications: Architecture and Opportunities

2024-01-11 · Abdullah Zayat, Mahmoud A. Hasabelnaby, Mohanad Obeed, Anas Chaaban

Next-generation communication networks are expected to exploit recent advances in data science and cutting-edge communications technologies to improve the utilization of the available communications resources. In this ar…

Data Compression

Will 6G be Semantic Communications? Opportunities and Challenges from Task Oriented and Secure Communications to Integrated Sensing

2024-01-03 · Yalin E. Sagduyu, Tugba Erpek, Aylin Yener, Sennur Ulukus

This paper explores opportunities and challenges of task (goal)-oriented and semantic communications for next-generation (NextG) communication networks through the integration of multi-task learning. This approach employ…

Federated LearningMulti-Task LearningRobust Design

Adaptive Semantic Token Selection for AI-native Goal-oriented Communications

2024-04-25 · Alessio Devoto, Simone Petruzzi, Jary Pomponi, Paolo Di Lorenzo 외

In this paper, we propose a novel design for AI-native goal-oriented communications, exploiting transformer neural networks under dynamic inference constraints on bandwidth and computation. Transformers have become the s…

How to Evaluate Semantic Communications for Images with ViTScore Metric?

2023-09-09 · Tingting Zhu, Bo Peng, Jifan Liang, Tingchen Han 외

Semantic communications (SC) have been expected to be a new paradigm shifting to catalyze the next generation communication, whose main concerns shift from accurate bit transmission to effective semantic information exch…

MS-SSIMSemantic CommunicationSemantic SimilaritySemantic Textual Similarity+1

Demo: Real-Time Semantic Communications with a Vision Transformer

2022-05-08 · Hanju Yoo, Taehun Jung, Linglong Dai, Songkuk Kim 외

Semantic communications are expected to enable the more effective delivery of meaning rather than a precise transfer of symbols. In this paper, we propose an end-to-end deep neural network-based architecture for image tr…