Context-aware knowledge-based middleware for selective information delivery in data-intensive monitoring systems

https://doi.org/10.1016/j.engappai.2015.04.008Get rights and content

Abstract

Multiple embedded devices in modern control and monitoring systems are able to sense different aspects of the current context such as environmental conditions, current processes in the system and user state. The number of captured situations in the environment and quantity and variety of devices in the system produce considerable amounts of data, which should be processed, understood and followed by corresponding actions. However, fully delivered to the user regardless of their role in the system and needs, data flows cause cognitive overload and thus may compromise the safety of the system depending on the timely response of the operators. This paper addresses the problem of selective information delivery with respect to the user׳s role in the system, his needs and responsibilities, by proposing context-aware information management middleware. The system utilizes Semantic Web technologies by capturing relevant information in the knowledge model of the system, which decouples data from the application logics. A clear division of data and application logics enables context-awareness and facilitates the reconfiguration process, when new information should be added into the system. The chosen approach is justified with an analysis of main trends in context-aware solutions. The engineering principles of the knowledge model are described and illustrated with simple scenarios from the building automation domain. The prototype developed proves the feasibility of the approach via performance evaluation and demonstrates the reconfiguration capabilities of information flows in the system. Further work assumes the extension of the knowledge model and integration of the system with adaptive human–machine interfaces for multi-role and multi-user environments.

Introduction

The evolution of control and monitoring systems has enabled information accessibility for almost any aspect of the environment (Sauter et al., 2011). In modern systems it is possible to integrate large numbers of various sensors to capture environmental conditions (e.g. temperature, humidity, and light), particular features of the process of interest (e.g. the product status in the production line) and the state of the users involved in the process or system operation. Potentially, it could offer advantages for timely situational awareness of the all system users. In reality growing information complexity challenges the usability of the system, human performance, and safety overwhelming the cognitive capacities of a user. This paper addresses a problem of selective information delivery to different users of the system by proposing context-aware information management middleware (IMM), which is able to analyze the run-time data of the system and deliver the information which is relevant to the user given the current situation and user needs/responsibilities.

The aim is to bring the right information to the right user at the right time, thus information management middleware should be able to determine the “rightness” according to the situation. The introduction of context-awareness is claimed to enable the desired flexibility of system behavior (Baumgartner et al., 2010, Fischer, 2012). The context can be defined as “any information that can be used to characterize the situation of an entity, where an entity can be a person, place, or physical or computational object” (Abowd and Dey, 1999), and then the system is context-aware “if it uses context to provide relevant information and/or services to the user, where relevancy depends on the user׳s task” (Dey, 2001). Both definitions are quite generic and allow different technological solutions for context-aware systems providing the right services (Emmanouilidis et al., 2013), actions (Feng et al., 2009) or system adaptation.

This paper proposes context-aware information management middleware for data intensive monitoring systems, where user is exposed to numerous sources of data coming from heterogeneous devices of the system and various situations of the environment. The middleware provides the user with the relevant information depending on the current situation, user role in the system, his needs and responsibilities. The main technological trends of achieving context-awareness in the systems are presented and analyzed, and the chosen approach using Semantic Web technologies (specifically OWL ontologies, SPARQL and SPARQL/Update1 queries) is justified. The system utilizes a reconfigurable knowledge model (ontologies) which decouples data from the application logic. The clear division of data and application logic enables context-awareness and (1) facilitates the system reconfiguration process when new information is introduced into the system; (2) enables the implementation of domain independent tools which facilitate the process of adapting IMM in new domain. The proposed approach is supported by ontological engineering principles, a description of a prototype already implemented, and describing reference cases from the building automation domain.

The rest of the paper is organized as follows. Section 2 overviews the state of the art for context-aware systems and justifies the choice of Semantic Web technologies for the solution proposed. Section 3 describes the functional architecture of the system and the enabling technologies for the main architectural blocks. Section 4 states the main design principles of the knowledge model of the system, the query templates enabling reconfiguration and the domain independent capabilities of the solution. Section 5 describes the tools for implementing IMM in detail and is followed by section 6 with simple examples of scenarios from the building automation domain exemplifying the knowledge model and demonstrating in function the main principles of the proposed solution. Section 7 presents performance evaluation of developed prototype; and finally, Section 8 concludes the paper and highlights directions for future work.

Section snippets

State of the art

Context-aware systems are a fairly active research topic resulting in numerous solutions and application areas. In order to limit the scope during the literature analysis, the focus was placed on the solutions with use cases similar to data intensive monitoring systems (i.e. with active and numerous incoming data flows) and selective reaction to the present context (i.e. delivery of personalized services or performing particular actions rather than activity recognition). Thus, other features of

Building blocks of IMM and associated technologies

IMM is seen as intermediate layer between information sources of the system (such as physical sensors, databases, and applications) and information consumers (such as HMI builders, history databases, and other client applications) (Fig. 1). The objectives of information management middleware are (1) to analyze data from information sources in order to deliver the information to the end users in a personalized manner during run-time, (2) to send the event notification messages to the different

Design principles of ontological context modeling and queries

The proposed IMM architecture utilizes Semantic Web technologies with the focus on ontologies and queries enabling the reconfiguration capabilities of the system. In order to make generic query templates reusable in different domains, ontologies should follow certain design principles. This section serves to explain the ontological design principles and query templates adopted for the proposed solution.

Software tools for implementing IMM blocks functionality

The proposed functional blocks of IMM have modular structure with specific functionalities (Fig. 1), which could be quite easily divided between different tools implementing IMM. The distinct functionality and distributed nature of modern data intensive environments led to the adoption of the SOA approach for IMM implementation. The architecture layers are realized as separate web applications with the communication via Web Services (WS); these applications are OntologyManager, OntologyService,

Case study

The IMM was developed for data intensive monitoring systems and intended to deliver personalized information to the user, analyze the current context in the environment, and facilitate the reconfiguration process of the system for technical administrators. The examples of those environments are Building and Factory Automation Systems (BAS and FAS correspondingly), which at present produce extensive data flows and are usually difficult to configure with new information such as devices or rules.

Evaluation

The crucial block of the proposed middleware is ontological context model with SWRL rules. Thus, the evaluation of middleware is focused on performance check of two key point processes in the proposed solution: (1) updating ontology with new information via SPARQL/Update statements; (2) querying ontology for specific information with SPARQL expressions. Both processes also involve semantic reasoning over ontological model with Pellet reasoner, thus considering SWRL rules incorporated into model.

Conclusions

This paper addresses the problem of personalized information delivery with respect to the user׳s role in the system, his needs and responsibilities, in environments, where user has to follow the information from numerous data sources and situations. The solution is seen in making the system aware of its context (e.g. the needs of a particular user, his role in the system, the layout of the locations with devices and users) with support middleware, which is able to reduce information flow to the

Acknowledgments

This work was partially supported by the ARTEMIS First Call 2010 Program under Grant Agreement number 269334, corresponding to the project ASTUTE (Pro-active decision support for data-intensive environments) and the Doctoral Programme of the President of the Tampere University of Technology (TUT).

References (60)

  • A. Moreno et al.

    SigTur/E-Destination: ontology-based personalized recommendation of tourism and leisure activities

    Eng. Appl. Artif. Intell.

    (2013)
  • J. Puttonen et al.

    A Semantic Web Services-based approach for production systems control

    Adv. Eng. Inform.

    (2010)
  • D. Sánchez et al.

    Semantic variance: an intuitive measure for ontology accuracy evaluation

    Eng. Appl. Artif. Intell.

    (2015)
  • M.J. Santofimia et al.

    A semantic model for actions and events in ambient intelligence

    Eng. Appl. Artif. Intell.

    (2011)
  • E. Simperl

    Reusing ontologies on the Semantic Web: a feasibility study

    Data Knowl. Eng.

    (2009)
  • F. Terroso-Sáenz et al.

    A complex event processing approach to perceive the vehicular context

    Inf. Fusion

    (2015)
  • W. Yao et al.

    Leveraging complex event processing for smart hospitals using RFID

    J. Netw. Comput. Appl.

    (2011)
  • I. Zappia et al.

    A lightweight and extensible complex event processing system for sense and respond applications

    Expert Syst. Appl.

    (2012)
  • G. Abowd et al.

    Towards a better understanding of context and context-awareness

    Lect. Notes Comput. Sci.

    (1999)
  • Ailisto, H., Alahuhta, P., Haataja, V., Kyllönen, V., Lindholm, M., 2002. Structuring context aware applications:...
  • M. Baldauf et al.

    A survey on context-aware systems

    Int. J. Ad Hoc Ubiquitous Comput.

    (2007)
  • Bechhofer, S., Harmelen, F., Hendler, J., Horrocks, J., McGuinness, D.L., Patel-Schneider, P.F., Stein, L.A., 2004. OWL...
  • C. Bolchini et al.

    A data-oriented survey of context models

    ACM SIGMOD Rec.

    (2007)
  • L. Chen et al.

    A Semantic Web-based approach to knowledge management for grid applications

    IEEE Trans. Knowl. Data Eng.

    (2007)
  • D. Chung et al.

    Performance evaluation for efficient complex event processing system according to event types and environment

    Ubiquitous Inf. Technol. Appl. (LNEE)

    (2013)
  • A.K. Dey

    Understanding and using context

    Pers. Ubiquitous Comput.

    (2001)
  • M. Eckert et al.

    A CEP babelfish: languages for complex event processing and querying surveyed

    Reason. Event-Based Distrib. Syst. (SCI)

    (2011)
  • A. Esposito et al.

    A framework for context-aware home-health monitoring

    Ubiquitous Intell. Comput.

    (2008)
  • Evchina, Y., Dvoryanchikova, A., Martinez Lastra, J.L., 2013. Semantic information management for user and context...
  • Fischer, G., 2012. Context-aware systems – the ʻright’ information, at the ʻright’ time, in the ʻright’ place, in the...
  • Cited by (18)

    • SVM-tree and SVM-forest algorithms for imbalanced fault classification in industrial processes

      2019, IFAC Journal of Systems and Control
      Citation Excerpt :

      With the development of modern complex industrial process, an exceptionally large amount of data have been produced and stored for process analytics (Evchina, Puttonen, Dvoryanchikova, & Lastra, 2015; Feital, Kruger, Dutra, Pinto, & Lima, 2013; Ge, 2018a; Ge, Song, Ding, & Huang, 2017; Ge, Song, & Gao, 2013; Wang, Wu, Ni, Dong, Benbouzid, & Hu, 2016).

    • The MOM of context-aware systems: A survey

      2019, Computer Communications
      Citation Excerpt :

      Ontology-based technique based on OWL was used for context modeling and organization with context types like person, place, environment, device, and an API for context reasoning. Context-aware Knowledge-based Middleware [280]: A context-aware information management middleware that addresses selective information delivery with respect to the user‘s role in the system. An ontology-based technique for context modeling and organization was used that define users, roles, devices, alarms, and places in order to describe the environment, and a semantic reasoner was used for context reasoning.

    • Hybrid approach for selective delivery of information streams in data-intensive monitoring systems

      2016, Advanced Engineering Informatics
      Citation Excerpt :

      It is a challenge to express temporal relationships among events such as “before”, “after”, and “overlaps”. There are attempts to overcome these challenges by using extensions of SWRL language as in [18] or by adding additional models or reasoners on top of the ontological model as in [13,19,20]; however, the application is still limited and there is no standardized approach to reason with time constraints. The publish/subscribe middleware are solutions providing asynchronous communication between multiple entities of the system.

    • Context-aware Knowledge-based Systems: A Literature Review

      2023, Proceedings of the Annual Hawaii International Conference on System Sciences
    View all citing articles on Scopus
    View full text