EventsThe 11th International Electronic Conference on Sensors and Applications
Published
This submission belongs to the session S3. Sensor Networks, IoT, Smart Cities and Heath Monitoring of the event The 11th International Electronic Conference on Sensors and Applications
Published date
26 Nov, 2024
Academic Editor
author-avatarStefan Bosse
Citation
Timothy Malche, Jyoti Mishra, Amit Hirawat, Embedded Intelligence for Smart Home using TinyML Approach to Keyword Spotting, in Proceedings of The 11th International Electronic Conference on Sensors and Applications, 26 November–28 November 2024, MDPI: Basel, Switzerland, doi: 10.3390/ecsa-11-20522
Share
Email
Facebook
Twitter
LinkedIn

Embedded Intelligence for Smart Home using TinyML Approach to Keyword Spotting

Jyoti Mishra 1
1. Manipal University Jaipur, India
2. Department of Computer Applications, Manipal University Jaipur, Jaipur, Rajasthan, India, India
Abstract

Current research in home automation focuses on integrating emerging technologies like Internet of Things (IoT), and machine learning to create smart home solutions that offer enhanced convenience, efficiency, and security. Benefits include remote control of household devices, optimized energy usage through automated systems, and improved user experience with real-time monitoring and alerts. In this study a TinyML (Tiny Machine Learning) based keyword spotting machine learning model and system is proposed which enables voice-based home automation. The proposed system allows users to control household devices through voice commands with minimal computational resources and real-time performance. The main objective of this research is to develop TinyML model for resource constrained devices. The system enables home systems to efficiently recognize specific keywords or phrases by integrating voice control for enhanced user convenience and accessibility. In this research the different voice keywords of users of different age groups have been collected in home environment and trained using machine learning algorithm. An, IoT based system is then developed utilizing the TinyML model to recognize specific voice command and perform home automation tasks. The model has achieved 98% accuracy with F1 score of 1.00 and 92% recall. The quantized model uses Latency of 11 ms, 19.8K of RAM and 55.0 K of flash for keyword classification which is a best fit for any resource constraint devices. The proposed system demonstrates the viability of deploying a keyword spotting model for home automation on resource-constrained IoT devices. The research helps in building efficient and user-friendly smart home solutions, enhancing the accessibility and functionality of home automation systems.

Keywords
Embedded AI
TinyML
Home Automation
Keyword Spotting
Internet of Things
Manuscript
Instance Segmentation based Automated Detection and Thickness Estimation of Oil Spills in Aerial Imagery
Athlete Tracking at a Marathon Event with LoRa: A Performance Evaluation with Mobile Gateways