TinyML NLP Scheme for Semantic Wireless Sentiment Classification with Privacy Preservation
Natural Language Processing (NLP) operations, such as semantic sentiment analysis and text synthesis, often raise privacy concerns and demand significant on-device computational resources. Centralized learning (CL) on the edge provides an energy-efficient alternative but requires collecting raw data, compromising user privacy. While federated learning (FL) enhances privacy, it imposes high computational energy demands on resource-constrained devices. This study provides insights into deploying privacy-preserving, energy-efficient NLP models on edge devices. We introduce semantic split learning (SL) as an energy-efficient, privacy-preserving tiny machine learning (TinyML) framework and compare it to FL and CL in the presence of Rayleigh fading and additive noise. Our results show that SL significantly reduces computational power and CO2 emissions while enhancing privacy, as evidenced by a fourfold increase in reconstruction error compared to FL and nearly eighteen times that of CL. In contrast, FL offers a balanced trade-off between privacy and efficiency. Our code is available for replication at our GitHub repository: https://github.com/AhmedRadwan02/TinyEco2AI-NLP.
Code (1)
Tasks
ClassificationFederated LearningPrivacy PreservingSentiment AnalysisSentiment ClassificationSimilar Papers 제목 키워드 기반
TinyML Towards Industry 4.0: Resource-Efficient Process Monitoring of a Milling Machine
In the context of industry 4.0, long-serving industrial machines can be retrofitted with process monitoring capabilities for future use in a smart factory. One possible approach is the deployment of wireless monitoring s…
On-device Online Learning and Semantic Management of TinyML Systems
Recent advances in Tiny Machine Learning (TinyML) empower low-footprint embedded devices for real-time on-device Machine Learning. While many acknowledge the potential benefits of TinyML, its practical implementation pre…
Audio Classificationimage-classificationImage ClassificationManagement+1Integration of TinyML and LargeML: A Survey of 6G and Beyond
The transition from 5G networks to 6G highlights a significant demand for machine learning (ML). Deep learning models, in particular, have seen wide application in mobile networking and communications to support advanced…
Autonomous VehiclesManagementIntelligence at the Extreme Edge: A Survey on Reformable TinyML
Tiny Machine Learning (TinyML) is an upsurging research field that proposes to democratize the use of Machine Learning and Deep Learning on highly energy-efficient frugal Microcontroller Units. Considering the general as…
BenchmarkingBIG-bench Machine LearningSurveyMultiCore+TPU Accelerated Multi-Modal TinyML for Livestock Behaviour Recognition
The advancement of technology has revolutionised the agricultural industry, transitioning it from labour-intensive farming practices to automated, AI-powered management systems. In recent years, more intelligent livestoc…
Activity Recognitionimage-classificationImage Classificationobject-detection+1