paper-with-me

Papers

Hyperdimensional Computing Empowered Federated Foundation Model over Wireless Networks for Metaverse

2024-08-26 · Yahao Ding, Wen Shang, Minrui Xu, Zhaohui Yang, Ye Hu, Dusit Niyato, Mohammad Shikh-Bahaei

The Metaverse, a burgeoning collective virtual space merging augmented reality and persistent virtual worlds, necessitates advanced artificial intelligence (AI) and communication technologies to support immersive and interactive experiences. Federated learning (FL) has emerged as a promising technique for collaboratively training AI models while preserving data privacy. However, FL faces challenges such as high communication overhead and substantial computational demands, particularly for neural network (NN) models. To address these issues, we propose an integrated federated split learning and hyperdimensional computing (FSL-HDC) framework for emerging foundation models. This novel approach reduces communication costs, computation load, and privacy risks, making it particularly suitable for resource-constrained edge devices in the Metaverse, ensuring real-time responsive interactions. Additionally, we introduce an optimization algorithm that concurrently optimizes transmission power and bandwidth to minimize the maximum transmission time among all users to the server. The simulation results based on the MNIST dataset indicate that FSL-HDC achieves an accuracy rate of approximately 87.5%, which is slightly lower than that of FL-HDC. However, FSL-HDC exhibits a significantly faster convergence speed, approximately 3.733x that of FSL-NN, and demonstrates robustness to non-IID data distributions. Moreover, our proposed optimization algorithm can reduce the maximum transmission time by up to 64% compared with the baseline.

📄 PDF Abstract BibTeX arXiv:2408.14416

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Resource-Efficient Federated Hyperdimensional Computing

2023-06-02 · Nikita Zeulin, Olga Galinina, Nageen Himayat, Sergey Andreev

In conventional federated hyperdimensional computing (HDC), training larger models usually results in higher predictive performance but also requires more computational, communication, and energy resources. If the system…

Federated Hyperdimensional Computing for Resource-Constrained Industrial IoT

2026-03-20 · Nikita Zeulin, Olga Galinina, Nageen Himayat, Sergey Andreev arxiv

In the Industrial Internet of Things (IIoT) systems, edge devices often operate under strict constraints in memory, compute capability, and wireless bandwidth. These limitations challenge the deployment of advanced data …

Federated Learning

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing

2024-11-02 · Fardin Jalil Piran, Zhiling Chen, Mohsen Imani, Farhad Imani

Federated Learning (FL) has become a key method for preserving data privacy in Internet of Things (IoT) environments, as it trains Machine Learning (ML) models locally while transmitting only model updates. Despite this …

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Federated LearningLifelong learning+1

A Theoretical Perspective on Hyperdimensional Computing

2020-10-14 · Anthony Thomas, Sanjoy Dasgupta, Tajana Rosing

Hyperdimensional (HD) computing is a set of neurally inspired methods for obtaining high-dimensional, low-precision, distributed representations of data. These representations can be combined with simple, neurally plausi…

The Hyperdimensional Transform: a Holographic Representation of Functions

2023-10-24 · Pieter Dewulf, Michiel Stock, Bernard De Baets

Integral transforms are invaluable mathematical tools to map functions into spaces where they are easier to characterize. We introduce the hyperdimensional transform as a new kind of integral transform. It converts squar…