Context-aware knowledge-based middleware for selective information delivery in data-intensive monitoring systems
Introduction
The evolution of control and monitoring systems has enabled information accessibility for almost any aspect of the environment (Sauter et al., 2011). In modern systems it is possible to integrate large numbers of various sensors to capture environmental conditions (e.g. temperature, humidity, and light), particular features of the process of interest (e.g. the product status in the production line) and the state of the users involved in the process or system operation. Potentially, it could offer advantages for timely situational awareness of the all system users. In reality growing information complexity challenges the usability of the system, human performance, and safety overwhelming the cognitive capacities of a user. This paper addresses a problem of selective information delivery to different users of the system by proposing context-aware information management middleware (IMM), which is able to analyze the run-time data of the system and deliver the information which is relevant to the user given the current situation and user needs/responsibilities.
The aim is to bring the right information to the right user at the right time, thus information management middleware should be able to determine the “rightness” according to the situation. The introduction of context-awareness is claimed to enable the desired flexibility of system behavior (Baumgartner et al., 2010, Fischer, 2012). The context can be defined as “any information that can be used to characterize the situation of an entity, where an entity can be a person, place, or physical or computational object” (Abowd and Dey, 1999), and then the system is context-aware “if it uses context to provide relevant information and/or services to the user, where relevancy depends on the user׳s task” (Dey, 2001). Both definitions are quite generic and allow different technological solutions for context-aware systems providing the right services (Emmanouilidis et al., 2013), actions (Feng et al., 2009) or system adaptation.
This paper proposes context-aware information management middleware for data intensive monitoring systems, where user is exposed to numerous sources of data coming from heterogeneous devices of the system and various situations of the environment. The middleware provides the user with the relevant information depending on the current situation, user role in the system, his needs and responsibilities. The main technological trends of achieving context-awareness in the systems are presented and analyzed, and the chosen approach using Semantic Web technologies (specifically OWL ontologies, SPARQL and SPARQL/Update1 queries) is justified. The system utilizes a reconfigurable knowledge model (ontologies) which decouples data from the application logic. The clear division of data and application logic enables context-awareness and (1) facilitates the system reconfiguration process when new information is introduced into the system; (2) enables the implementation of domain independent tools which facilitate the process of adapting IMM in new domain. The proposed approach is supported by ontological engineering principles, a description of a prototype already implemented, and describing reference cases from the building automation domain.
The rest of the paper is organized as follows. Section 2 overviews the state of the art for context-aware systems and justifies the choice of Semantic Web technologies for the solution proposed. Section 3 describes the functional architecture of the system and the enabling technologies for the main architectural blocks. Section 4 states the main design principles of the knowledge model of the system, the query templates enabling reconfiguration and the domain independent capabilities of the solution. Section 5 describes the tools for implementing IMM in detail and is followed by section 6 with simple examples of scenarios from the building automation domain exemplifying the knowledge model and demonstrating in function the main principles of the proposed solution. Section 7 presents performance evaluation of developed prototype; and finally, Section 8 concludes the paper and highlights directions for future work.
Section snippets
State of the art
Context-aware systems are a fairly active research topic resulting in numerous solutions and application areas. In order to limit the scope during the literature analysis, the focus was placed on the solutions with use cases similar to data intensive monitoring systems (i.e. with active and numerous incoming data flows) and selective reaction to the present context (i.e. delivery of personalized services or performing particular actions rather than activity recognition). Thus, other features of
Building blocks of IMM and associated technologies
IMM is seen as intermediate layer between information sources of the system (such as physical sensors, databases, and applications) and information consumers (such as HMI builders, history databases, and other client applications) (Fig. 1). The objectives of information management middleware are (1) to analyze data from information sources in order to deliver the information to the end users in a personalized manner during run-time, (2) to send the event notification messages to the different
Design principles of ontological context modeling and queries
The proposed IMM architecture utilizes Semantic Web technologies with the focus on ontologies and queries enabling the reconfiguration capabilities of the system. In order to make generic query templates reusable in different domains, ontologies should follow certain design principles. This section serves to explain the ontological design principles and query templates adopted for the proposed solution.
Software tools for implementing IMM blocks functionality
The proposed functional blocks of IMM have modular structure with specific functionalities (Fig. 1), which could be quite easily divided between different tools implementing IMM. The distinct functionality and distributed nature of modern data intensive environments led to the adoption of the SOA approach for IMM implementation. The architecture layers are realized as separate web applications with the communication via Web Services (WS); these applications are OntologyManager, OntologyService,
Case study
The IMM was developed for data intensive monitoring systems and intended to deliver personalized information to the user, analyze the current context in the environment, and facilitate the reconfiguration process of the system for technical administrators. The examples of those environments are Building and Factory Automation Systems (BAS and FAS correspondingly), which at present produce extensive data flows and are usually difficult to configure with new information such as devices or rules.
Evaluation
The crucial block of the proposed middleware is ontological context model with SWRL rules. Thus, the evaluation of middleware is focused on performance check of two key point processes in the proposed solution: (1) updating ontology with new information via SPARQL/Update statements; (2) querying ontology for specific information with SPARQL expressions. Both processes also involve semantic reasoning over ontological model with Pellet reasoner, thus considering SWRL rules incorporated into model.
Conclusions
This paper addresses the problem of personalized information delivery with respect to the user׳s role in the system, his needs and responsibilities, in environments, where user has to follow the information from numerous data sources and situations. The solution is seen in making the system aware of its context (e.g. the needs of a particular user, his role in the system, the layout of the locations with devices and users) with support middleware, which is able to reduce information flow to the
Acknowledgments
This work was partially supported by the ARTEMIS First Call 2010 Program under Grant Agreement number 269334, corresponding to the project ASTUTE (Pro-active decision support for data-intensive environments) and the Doctoral Programme of the President of the Tampere University of Technology (TUT).
References (60)
- et al.
The internet of things: a survey
Comput. Netw.
(2010) - et al.
Steps, techniques, and technologies for the development of intelligent applications based on Semantic Web Services: a case study in e-learning systems
Eng. Appl. Artif. Intell.
(2011) - et al.
BeAware! – situation awareness, the ontology-driven way
Data Knowl. Eng.
(2010) - et al.
Elderly activities recognition and classification for applications in assisted living
Expert Syst. Appl.
(2013) - et al.
Mobile guides: taxonomy of architectures, context awareness, technologies and applications
J. Netw. Comput. Appl.
(2013) - et al.
Modelling situation awareness for context-aware decision support
Expert Syst. Appl.
(2009) - et al.
Methodological guidelines for reusing general ontologies
Data Knowl. Eng.
(2013) - et al.
Ontology-based approach for measuring semantic similarity
Eng. Appl. Artif. Intell.
(2014) - et al.
Context-aware system for proactive personalized service based on context history
Expert Syst. Appl.
(2009) - et al.
A middleware framework for scalable management of linked streams
Web Semant.: Sci. Serv. Agents World Wide Web
(2012)
SigTur/E-Destination: ontology-based personalized recommendation of tourism and leisure activities
Eng. Appl. Artif. Intell.
A Semantic Web Services-based approach for production systems control
Adv. Eng. Inform.
Semantic variance: an intuitive measure for ontology accuracy evaluation
Eng. Appl. Artif. Intell.
A semantic model for actions and events in ambient intelligence
Eng. Appl. Artif. Intell.
Reusing ontologies on the Semantic Web: a feasibility study
Data Knowl. Eng.
A complex event processing approach to perceive the vehicular context
Inf. Fusion
Leveraging complex event processing for smart hospitals using RFID
J. Netw. Comput. Appl.
A lightweight and extensible complex event processing system for sense and respond applications
Expert Syst. Appl.
Towards a better understanding of context and context-awareness
Lect. Notes Comput. Sci.
A survey on context-aware systems
Int. J. Ad Hoc Ubiquitous Comput.
A data-oriented survey of context models
ACM SIGMOD Rec.
A Semantic Web-based approach to knowledge management for grid applications
IEEE Trans. Knowl. Data Eng.
Performance evaluation for efficient complex event processing system according to event types and environment
Ubiquitous Inf. Technol. Appl. (LNEE)
Understanding and using context
Pers. Ubiquitous Comput.
A CEP babelfish: languages for complex event processing and querying surveyed
Reason. Event-Based Distrib. Syst. (SCI)
A framework for context-aware home-health monitoring
Ubiquitous Intell. Comput.
Cited by (18)
A Survey of Middlewares for self-adaptation and context-aware in Cloud of Things environment
2022, Procedia Computer ScienceSVM-tree and SVM-forest algorithms for imbalanced fault classification in industrial processes
2019, IFAC Journal of Systems and ControlCitation Excerpt :With the development of modern complex industrial process, an exceptionally large amount of data have been produced and stored for process analytics (Evchina, Puttonen, Dvoryanchikova, & Lastra, 2015; Feital, Kruger, Dutra, Pinto, & Lima, 2013; Ge, 2018a; Ge, Song, Ding, & Huang, 2017; Ge, Song, & Gao, 2013; Wang, Wu, Ni, Dong, Benbouzid, & Hu, 2016).
The MOM of context-aware systems: A survey
2019, Computer CommunicationsCitation Excerpt :Ontology-based technique based on OWL was used for context modeling and organization with context types like person, place, environment, device, and an API for context reasoning. Context-aware Knowledge-based Middleware [280]: A context-aware information management middleware that addresses selective information delivery with respect to the user‘s role in the system. An ontology-based technique for context modeling and organization was used that define users, roles, devices, alarms, and places in order to describe the environment, and a semantic reasoner was used for context reasoning.
Challenges and opportunities for publishing IIoT data in manufacturing as a service business
2019, Procedia ManufacturingHybrid approach for selective delivery of information streams in data-intensive monitoring systems
2016, Advanced Engineering InformaticsCitation Excerpt :It is a challenge to express temporal relationships among events such as “before”, “after”, and “overlaps”. There are attempts to overcome these challenges by using extensions of SWRL language as in [18] or by adding additional models or reasoners on top of the ontological model as in [13,19,20]; however, the application is still limited and there is no standardized approach to reason with time constraints. The publish/subscribe middleware are solutions providing asynchronous communication between multiple entities of the system.
Context-aware Knowledge-based Systems: A Literature Review
2023, Proceedings of the Annual Hawaii International Conference on System Sciences