A Machine Learning Framework for Distributed Functional Compression over Wireless Channels in IoT
IoT devices generating enormous data and state-of-the-art machine learning techniques together will revolutionize cyber-physical systems. In many diverse fields, from autonomous driving to augmented reality, distributed IoT devices compute specific target functions without simple forms like obstacle detection, object recognition, etc. Traditional cloud-based methods that focus on transferring data to a central location either for training or inference place enormous strain on network resources. To address this, we develop, to the best of our knowledge, the first machine learning framework for distributed functional compression over both the Gaussian Multiple Access Channel (GMAC) and orthogonal AWGN channels. Due to the Kolmogorov-Arnold representation theorem, our machine learning framework can, by design, compute any arbitrary function for the desired functional compression task in IoT. Importantly the raw sensory data are never transferred to a central node for training or inference, thus reducing communication. For these algorithms, we provide theoretical convergence guarantees and upper bounds on communication. Our simulations show that the learned encoders and decoders for functional compression perform significantly better than traditional approaches, are robust to channel condition changes and sensor outages. Compared to the cloud-based scenario, our algorithms reduce channel use by two orders of magnitude.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingBIG-bench Machine LearningObject RecognitionSimilar Papers 제목 키워드 기반
A Novel Framework for Image-to-image Translation and Image Compression
Data-driven paradigms using machine learning are becoming ubiquitous in image processing and communications. In particular, image-to-image (I2I) translation is a generic and widely used approach to image processing probl…
Image CompressionImage GenerationImage RestorationImage-to-Image Translation+3FastSGD: A Fast Compressed SGD Framework for Distributed Machine Learning
With the rapid increase of big data, distributed Machine Learning (ML) has been widely applied in training large-scale models. Stochastic Gradient Descent (SGD) is arguably the workhorse algorithm of ML. Distributed ML m…
BIG-bench Machine LearningQuantizationUnbiased Single-scale and Multi-scale Quantizers for Distributed Optimization
Massive amounts of data have led to the training of large-scale machine learning models on a single worker inefficient. Distributed machine learning methods such as Parallel-SGD have received significant interest as a so…
BIG-bench Machine LearningDistributed OptimizationQuantizationDistributed learning with compressed gradients
Asynchronous computation and gradient compression have emerged as two key techniques for achieving scalability in distributed optimization for large-scale machine learning. This paper presents a unified analysis framewor…
BIG-bench Machine LearningDistributed Optimization3LC: Lightweight and Effective Traffic Compression for Distributed Machine Learning
The performance and efficiency of distributed machine learning (ML) depends significantly on how long it takes for nodes to exchange state changes. Overly-aggressive attempts to reduce communication often sacrifice final…
BIG-bench Machine LearningData CompressionGPUQuantization