A Hybrid Architecture for On-Device Compressive Machine Learning
Developing machine learning techniques that can protect the privacy of users’ data is of utmost importance, as tracking and selling our digital data (often without our permission and knowledge) has become a booming business model. By processing the data on the device that has collected the data, we can dramatically increase the level of privacy. On-device machine offers several additional benefits, such as low latency, efficient use of network bandwidth, and more autonomy. However, many devices deployed on the “edge” have very limited memory, weak processors, and scarce energy supply. This poses the challenge of envisioning new machine learning architectures that can function properly under such dire conditions. This issue is particularly urgent with the emergence of the Internet of Things. We propose a hybrid hardware-software framework that facilitates increased privacy protection due to on-device processing and moreover has the potential to significantly reduce the computational complexity and memory requirements of on-device machine learning. In the first step, inspired by compressive sensing, data is collected in compressed form simultaneously with the sensing process. Thus this compression happens already at the hardware level during data acquisition. But unlike in compressive sensing, this compression is achieved via a projection operator that is specifically tailored to the desired machine learning task. The second step consists of a specially designed and trained deep network. Numerical simulations in image classification illustrate the viability of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningCompressive Sensingimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
What Happens on the Edge, Stays on the Edge: Toward Compressive Deep Learning
Machine learning at the edge offers great benefits such as increased privacy and security, low latency, and more autonomy. However, a major challenge is that many devices, in particular edge devices, have very limited me…
BIG-bench Machine LearningCompressive Sensingimage-classificationImage ClassificationHigh correlated variables creator machine: Prediction of the compressive strength of concrete
In this paper, we introduce a novel hybrid model for predicting the compressive strength of concrete using ultrasonic pulse velocity (UPV) and rebound number (RN). First, 516 data from 8 studies of UPV and rebound hammer…
A Parallel Compressive Imaging Architecture for One-Shot Acquisition
A limitation of many compressive imaging architectures lies in the sequential nature of the sensing process, which leads to long sensing times. In this paper we present a novel architecture that uses fewer detectors than…
Compressive SensingLow complexity joint position and channel estimation at millimeter wave based on multidimensional orthogonal matching pursuit
Compressive approaches provide a means of effective channel high resolution channel estimates in millimeter wave MIMO systems, despite the use of analog and hybrid architectures. Such estimates can also be used as part o…
PositionLearning a Compressive Sensing Matrix with Structural Constraints via Maximum Mean Discrepancy Optimization
We introduce a learning-based algorithm to obtain a measurement matrix for compressive sensing related recovery problems. The focus lies on matrices with a constant modulus constraint which typically represent a network …
Compressive Sensing