paper-with-me

Papers

A Machine Learning Framework for Distributed Functional Compression over Wireless Channels in IoT

2022-01-24 · Yashas Malur Saidutta, Afshin Abdi, Faramarz Fekri

IoT devices generating enormous data and state-of-the-art machine learning techniques together will revolutionize cyber-physical systems. In many diverse fields, from autonomous driving to augmented reality, distributed IoT devices compute specific target functions without simple forms like obstacle detection, object recognition, etc. Traditional cloud-based methods that focus on transferring data to a central location either for training or inference place enormous strain on network resources. To address this, we develop, to the best of our knowledge, the first machine learning framework for distributed functional compression over both the Gaussian Multiple Access Channel (GMAC) and orthogonal AWGN channels. Due to the Kolmogorov-Arnold representation theorem, our machine learning framework can, by design, compute any arbitrary function for the desired functional compression task in IoT. Importantly the raw sensory data are never transferred to a central node for training or inference, thus reducing communication. For these algorithms, we provide theoretical convergence guarantees and upper bounds on communication. Our simulations show that the learned encoders and decoders for functional compression perform significantly better than traditional approaches, are robust to channel condition changes and sensor outages. Compared to the cloud-based scenario, our algorithms reduce channel use by two orders of magnitude.

📄 PDF Abstract BibTeX arXiv:2201.09483

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingBIG-bench Machine LearningObject Recognition

Similar Papers 제목 키워드 기반

A Novel Framework for Image-to-image Translation and Image Compression

2021-11-25 · Fei Yang, Yaxing Wang, Luis Herranz, Yongmei Cheng 외

Data-driven paradigms using machine learning are becoming ubiquitous in image processing and communications. In particular, image-to-image (I2I) translation is a generic and widely used approach to image processing probl…

Image CompressionImage GenerationImage RestorationImage-to-Image Translation+3

FastSGD: A Fast Compressed SGD Framework for Distributed Machine Learning

2021-12-08 · Keyu Yang, Lu Chen, Zhihao Zeng, Yunjun Gao

With the rapid increase of big data, distributed Machine Learning (ML) has been widely applied in training large-scale models. Stochastic Gradient Descent (SGD) is arguably the workhorse algorithm of ML. Distributed ML m…

BIG-bench Machine LearningQuantization

Unbiased Single-scale and Multi-scale Quantizers for Distributed Optimization

2021-09-26 · S Vineeth

Massive amounts of data have led to the training of large-scale machine learning models on a single worker inefficient. Distributed machine learning methods such as Parallel-SGD have received significant interest as a so…

BIG-bench Machine LearningDistributed OptimizationQuantization

Distributed learning with compressed gradients

2018-06-18 · Sarit Khirirat, Hamid Reza Feyzmahdavian, Mikael Johansson

Asynchronous computation and gradient compression have emerged as two key techniques for achieving scalability in distributed optimization for large-scale machine learning. This paper presents a unified analysis framewor…

BIG-bench Machine LearningDistributed Optimization

3LC: Lightweight and Effective Traffic Compression for Distributed Machine Learning

2018-02-21 · Hyeontaek Lim, David G. Andersen, Michael Kaminsky

The performance and efficiency of distributed machine learning (ML) depends significantly on how long it takes for nodes to exchange state changes. Overly-aggressive attempts to reduce communication often sacrifice final…

BIG-bench Machine LearningData CompressionGPUQuantization