Skip to main content
Log in

Near-Optimal Online Control of Dynamic Discrete-Event Systems

  • Published:
Discrete Event Dynamic Systems Aims and scope Submit manuscript

Abstract

A class of time-varying discrete-event systems, named dynamic discrete-event systems, is defined. The goal of this paper is to provide a method which is modular and can be applied in real solutions for the optimization of the online control of such systems. First, a simple control algorithm is presented, followed by illustrative examples of different issues that can arise if it is used. Afterward, a more complicated near-optimal online control algorithm with normalization of string values is proposed. The time variability of the systems is accounted for and the average computational time is drastically reduced. This is demonstrated with a set of simulations of the performance of the new algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Barr DR, Zehna PW (1983) Probability: Modeling Uncertainty. Massachusetts: Addison-Wesley

    Google Scholar 

  • Brandin BA, Malik R, Malik P (2004) Incremental verification and synthesis of discrete-event systems guided by counter examples. IEEE Trans Control Syst Technol 12(3):387–401

    Article  Google Scholar 

  • Brave Y, Heymann M (1993) On optimal attraction in discrete-event processes. Inf Sci 67:245–267

    Article  MATH  MathSciNet  Google Scholar 

  • Cassandras CG, Lafortune S (1999) Introduction to Discrete Event Systems. Norwell, Massachusetts: Kluwer

    MATH  Google Scholar 

  • Chen Y-L, Lafortune S, Lin F (1997) How to reuse supervisors when discrete event system models evolve. In: Proceedings of the 36th Conference on Decision and Control, vol 3, pp. 2964–2969, San Diego, California, USA

  • Chen Y-L, Lin F (2001) An optimal effective controller for discrete event systems. In: Proceedings of the 40th IEEE Conference on Decision and Control, vol 5, pp. 4092–4097

  • Chung S-L, Lafortune S, Lin F (1992) Limited lookahead policies in supervisory control of discrete event systems. IEEE Trans Automat Contr 37(12):1921–1935

    Article  MATH  MathSciNet  Google Scholar 

  • Chung S-L, Lafortune S, Lin F (1994) Supervisory control using variable lookahead policies. Discret Event Dyn Syste: Theory and Applications 4:237–268

    Article  MATH  Google Scholar 

  • de Queiroz MH, Cury JER (2000) Modular control of composed systems. In: Proceedings of the 2000 American Control Conference, vol 6, pp. 4051–4055

  • Gordon D, Kiriakidis K (2000) Adaptive supervisory control of interconnected discrete event systems. In: Proceedings of the 2000 IEEE International Conference on Control Applications, pp. 935–940, Alaska, USA: Anchorage

  • Grigorov L, Rudie K (2005) Issues in optimal control of dynamic discrete-event systems. In: Proceedings of the 16th IFAC World Congress (Paper 02005), Prague, Czech Republic

  • Grigorov LG (2004) Control of Dynamic Discrete-Event Systems, Master’s Thesis, School of Computing, Queen’s University, Kingston, Ontario, Canada

  • Hadj-Alouane NB, Lafortune S, Lin F (1994) Variable lookahead supervisory control with state information. IEEE Trans Automat Contr 39(12):2398–2410

    Article  MATH  MathSciNet  Google Scholar 

  • Hadj-Alouane NB, Lafortune S, Lin F (1996) Centralized and distributed algorithms for on-line synthesis of maximal control policies under partial observation. Discret Event Dyn Syst: Theory and Applications 6:379–427

    Article  MATH  Google Scholar 

  • Hart PE, Nilsson NJ, Raphael B (1968) A formal basis for the heuristic determination of minimum cost paths. IEEE Trans Syst Sci Cybern, SSC-4(2):100–107

    Article  Google Scholar 

  • Heymann M, Lin F (1994) On-line control of partially observed discrete event systems. Discret Event Dyn Syst Theory and Applications 4(3):221–236

    Article  MATH  Google Scholar 

  • Korf RE (1985) Depth-first Iterative-deepening: an optimal admissible tree search. Artif Intell 27:97–109

    Article  MATH  MathSciNet  Google Scholar 

  • Kumar R, Cheung HM, Marcus SI (1998) Extension based limited lookahed supervision of discrete event systems. Automatica 34(11):1327–1344

    Article  MATH  MathSciNet  Google Scholar 

  • Kumar R, Garg VK (1995) Optimal supervisory control of discrete event dynamical systems. SIAM J Control Optim 33:419–439

    Article  MATH  MathSciNet  Google Scholar 

  • Kumar R, Garg VK (2001) Control of stochastic discrete event systems modeled by probabilistic languages. IEEE Trans Automat Contr 46(1):593–606

    Article  MATH  MathSciNet  Google Scholar 

  • Lin F (1993) Robust and adaptive supervisory control of discrete event systems. IEEE Trans Automat Contr 38(12):1848–1852

    Article  MATH  Google Scholar 

  • Minhas R, Wonham WM (2003) Online supervision of discrete event systems. In: Proceedings of the 2003 American Control Conference, vol 2, pp. 1685–1690

  • Mohanty SR, Chandra V, Kumar R (1999) A computer implementable algorithm for the synthesis of an optimal controller for acyclic discrete event processes. In: Proceedings of the 1999 IEEE International Conference on Robotics and Automation, vol 1, pp. 126–130

  • Ramadge PJ, Wonham WM (1987) Supervisory control of a class of discrete event processes. SIAM J Contr Optimization 25(1):206–230

    Article  MATH  MathSciNet  Google Scholar 

  • Russell SJ, Norvig P (2003) Artificial Intelligence: A Modern Approach, 2nd edn. Upper Saddle River, New Jersey: Pearson Education

    Google Scholar 

  • Sengupta R, Lafortune S (1998) An optimal control theory for discrete event systems. SIAM J Contr Optim 36(2):488–541

    Article  MATH  MathSciNet  Google Scholar 

  • Young S, Garg VK (1995) Model uncertainty in discrete event systems. SIAM J Contr Optim 33(1):208–226

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lenko Grigorov.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Grigorov, L., Rudie, K. Near-Optimal Online Control of Dynamic Discrete-Event Systems. Discrete Event Dyn Syst 16, 419–449 (2006). https://doi.org/10.1007/s10626-006-0020-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10626-006-0020-x

Keywords

Navigation