The industry track of SIMUTools 2010.

Research Article

Using hidden non-Markovian Models to reconstruct system behavior in partially-observable systems

  • @INPROCEEDINGS{10.4108/ICST.SIMUTOOLS2010.8641,
        author={Robert  Buchholz and Claudia  Krull and Thomas  Strigl and Graham  Horton},
        title={Using hidden non-Markovian Models to reconstruct system behavior in partially-observable systems},
        proceedings={The industry track of SIMUTools 2010.},
        publisher={ACM},
        proceedings_a={SIMULATIONWORKS},
        year={2010},
        month={5},
        keywords={Proxel-based simulation hidden non-Markovian model hidden system production systems state space-based simulation},
        doi={10.4108/ICST.SIMUTOOLS2010.8641}
    }
    
  • Robert Buchholz
    Claudia Krull
    Thomas Strigl
    Graham Horton
    Year: 2010
    Using hidden non-Markovian Models to reconstruct system behavior in partially-observable systems
    SIMULATIONWORKS
    ICST
    DOI: 10.4108/ICST.SIMUTOOLS2010.8641
Robert Buchholz1,*, Claudia Krull1,*, Thomas Strigl2,*, Graham Horton1,*
  • 1: Otto-von-Guericke Universität, Magdeburg, Universitätsplatz 2, 39106 Magdeburg, Germany.
  • 2: iSILOG GmbH, Am Froschbächle 21, D-77815 Bühl
*Contact email: robert@isg.cs.uni-magdeburg.de, claudia@isg.cs.uni-magdeburg.de, thomas.strigl@isilog.de, graham@isg.cs.uni-magdeburg.de

Abstract

Many complex technical systems today have some basic protocol capability, which is used for example to monitor the quality of production output or to keep track of oil pressure in a modern car. The recorded protocols are usually used to detect deviations from some predefined standards and issue warnings. However, the information in such a protocol is not sufficient to determine the source or cause of the problem, since only part of the system is being observed.

In this paper we present an approach to reconstruct missing information in only partially-observable stochastic systems based only on recorded system output. The approach uses Hidden non-Markovian Models to model the partially-observable system and Proxel-based simulation to analyze the recorded system output.

Experiments were conducted using a production line example. The result of the analysis is a set of possible system behaviors that could have caused the recorded protocol, including their probabilities. We will show that our approach is able to reconstruct the relevant information to determine the source of non-standard system behavior.

The combination of Hidden non-Markovian Models and Proxel-based simulation holds the potential to reconstruct unobserved information from partial or even noisy output protocols of a system. It adds value to the information already recorded in many production systems today and opens new possibilities in the analysis of inherently only partially-observable systems.