paper-with-me

Papers

Efficient Federated Meta-Learning over Multi-Access Wireless Networks

2021-08-14 · Sheng Yue, Ju Ren, Jiang Xin, Deyu Zhang, Yaoxue Zhang, Weihua Zhuang

Federated meta-learning (FML) has emerged as a promising paradigm to cope with the data limitation and heterogeneity challenges in today's edge learning arena. However, its performance is often limited by slow convergence and corresponding low communication efficiency. In addition, since the available radio spectrum and IoT devices' energy capacity are usually insufficient, it is crucial to control the resource allocation and energy consumption when deploying FML in practical wireless networks. To overcome the challenges, in this paper, we rigorously analyze each device's contribution to the global loss reduction in each round and develop an FML algorithm (called NUFM) with a non-uniform device selection scheme to accelerate the convergence. After that, we formulate a resource allocation problem integrating NUFM in multi-access wireless systems to jointly improve the convergence rate and minimize the wall-clock time along with energy cost. By deconstructing the original problem step by step, we devise a joint device selection and resource allocation strategy to solve the problem with theoretical guarantees. Further, we show that the computational complexity of NUFM can be reduced from $O(d^2)$ to $O(d)$ (with the model dimension $d$) via combining two first-order approximation techniques. Extensive simulation results demonstrate the effectiveness and superiority of the proposed methods in comparison with existing baselines.

📄 PDF Abstract BibTeX arXiv:2108.06453

Code (0)

등록된 구현이 없습니다.

Tasks

Meta-Learning

Similar Papers 제목 키워드 기반

Pre-Training and Personalized Fine-Tuning via Over-the-Air Federated Meta-Learning: Convergence-Generalization Trade-Offs

2024-06-17 · Haifeng Wen, Hong Xing, Osvaldo Simeone

For modern artificial intelligence (AI) applications such as large language models (LLMs), the training paradigm has recently shifted to pre-training followed by fine-tuning. Furthermore, owing to dwindling open reposito…

Federated LearningMeta-Learning

Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data

2019-07-05 · Jin-Hyun Ahn, Osvaldo Simeone, Joonhyuk Kang

Cooperative training methods for distributed machine learning typically assume noiseless and ideal communication channels. This work studies some of the opportunities and challenges arising from the presence of wireless …

BIG-bench Machine LearningFederated Learning

Federated Learning for Wireless Communications: Motivation, Opportunities and Challenges

2019-07-30 · Solmaz Niknam, Harpreet S. Dhillon, Jeffery H. Reed

There is a growing interest in the wireless communications community to complement the traditional model-based design approaches with data-driven machine learning (ML)-based solutions. While conventional ML approaches re…

Federated LearningPrivacy Preserving

Federated Multi-View Synthesizing for Metaverse

2023-12-18 · Yiyu Guo, Zhijin Qin, Xiaoming Tao, Geoffrey Ye Li

The metaverse is expected to provide immersive entertainment, education, and business applications. However, virtual reality (VR) transmission over wireless networks is data- and computation-intensive, making it critical…

Domain AdaptationFederated LearningTransfer Learning

Over-The-Air Federated Learning Over Scalable Cell-free Massive MIMO

2022-12-13 · Houssem Sifaou, Geoffrey Ye Li

Cell-free massive MIMO is emerging as a promising technology for future wireless communication systems, which is expected to offer uniform coverage and high spectral efficiency compared to classical cellular systems. We …

Federated Learning