EventsThe 13th International Electronic Conference on Sensors and Applications
Published
with-doi10.3390/engproc2026163076 (registering DOI)
This submission belongs to the session S4. Sensors and Artificial Intelligence of the event The 13th International Electronic Conference on Sensors and Applications
Published date
16 Nov, 2026
Academic Editor
author-avatarFrancisco Falcone
Citation
Mihail Alexandrov Mateev, AI-Driven Multimodal Sensor Intelligence Using Embeddings, Ontologies, and Agentic Workflows for Construction and Industrial Automation Monitoring, in Proceedings of The 13th International Electronic Conference on Sensors and Applications, 18 November–20 November 2026, MDPI: Basel, Switzerland, doi: 10.3390/engproc2026163076
Share
Email
Facebook
Twitter
LinkedIn

AI-Driven Multimodal Sensor Intelligence Using Embeddings, Ontologies, and Agentic Workflows for Construction and Industrial Automation Monitoring

1. Department of Computer Aided Engineering, Faculty of Structural Engineering, University of Architecture, Civil Engineering and Geodesy (UACEG), 1 Hristo Smirnenski Blvd., 1046 Sofia, Bulgaria
Abstract

Modern construction and industrial automation environments generate large volumes of heterogeneous data from sensors, visual inspections, equipment logs, maintenance records, and human observations. Although artificial intelligence methods are increasingly used for anomaly detection, object recognition, and predictive analytics, many existing approaches remain isolated from domain knowledge and provide limited explainability for engineering decision-making. This paper proposes an AI-driven multimodal sensor intelligence architecture that combines embeddings, ontology-based knowledge representation, and autonomous agentic workflows for contextual interpretation of sensor and inspection data.

The proposed architecture introduces an ontology layer that represents physical assets, sensor observations, construction activities, defects, operational states, risks, and recommended actions. Image and text embeddings are used to connect visual evidence, sensor readings, and inspection descriptions in a shared semantic space. A knowledge graph organizes these relationships and enables explainable reasoning over detected events. On top of this semantic layer, agentic workflows coordinate retrieval, validation, summarization, rule checking, and notification tasks. This allows the system to support human experts by identifying relevant evidence, detecting inconsistencies, and recommending follow-up inspection or maintenance actions.

The approach is positioned for construction monitoring and industrial automation scenarios, where sensor signals, images, and technical documentation must be interpreted together. The expected contribution is a reusable framework for integrating artificial intelligence with sensor data, semantic models, and human-supervised autonomous workflows. Compared with isolated AI models or conventional sensor dashboards, the proposed approach improves contextual retrieval, explainability, and decision support for complex engineering environments.

Keywords
sensors and artificial intelligence
multimodal sensor data
image embeddings
ontology
knowledge graph
agentic workflows
construction monitoring
industrial automation
GenAI
Industry 4.0.
Manuscript
Sciforum-187764engproc-163-00076.pdf
Development of a Didactic Plant with Material Classification Using an Intelligent Sensor
A Fault-Tolerant Edge Computing Architecture for Low-Latency Actuation in Agricultural IoT