Skip to main content
Springer Nature Link
Log in

A Distributed Learning Control System for Elevator Groups

  • Conference paper
Artificial Intelligence and Soft Computing – ICAISC 2006 (ICAISC 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4029))

Included in the following conference series:

Abstract

Human-designed elevator control policies usually perform sufficiently well, but are costly to obtain and do not easily adapt to changing traffic patterns. This paper describes an adaptive distributed elevator control system based on reinforcement learning. Whereas inspired by prior work, the design of the system is novel, developed with the intention to avoid any unrealistic assumptions that would limit its practical usefulness. Encouraging experimental results are presented with a realistic simulator of an elevator group.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Levy, D., Yardin, M., Alexandrowitz, A.: Optimal control of elevators. International Journal of Systems Science 8, 301–320 (1977)

    Article  Google Scholar 

  2. Pepyne, D.L., Cassandras, C.G.: Optimal dispatching control for elevator systems during uppeak traffic. IEEE Transactions on Control Systems Technology 5(6), 629–643 (1997)

    Article  Google Scholar 

  3. Siikonen, M.: Planning and Control Models for Elevators in High-Rise Buildings. PhD thesis, Helsinki Unverstity of Technology, Systems Analysis Laboratory (1997)

    Google Scholar 

  4. Cortés, P., Larrañeta, J., Onieva, L.: Genetic algorithm for controllers in elevator groups: Analysis and simulation during lunchpeak traffic. Applied Soft Computing 4, 159–174 (2004)

    Article  Google Scholar 

  5. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)

    Google Scholar 

  6. Crites, R.H., Barto, A.G.: Improving elevator performance using reinforcement learning. In: Touretzky, D.S., Mozer, M.C., Hasselmo, M.E. (eds.) Advances in Neural Information Processing Systems, vol. 8, pp. 1017–1023. MIT Press, Cambridge (1996)

    Google Scholar 

  7. Crites, R.H., Barto, A.G.: Elevator group control using multiple reinforcement learning agents. Machine Learning 33, 235–262 (1998)

    Article  MATH  Google Scholar 

  8. Bradtke, S.J., Duff, M.O.: Reinforcement learning methods for continuous-time Markov decision problems. In: Tesauro, G., Touretzky, D., Leen, T. (eds.) Advances in Neural Information Processing Systems, vol. 7, pp. 393–400. MIT Press, Cambridge (1995)

    Google Scholar 

  9. Watkins, C.J.C.H.: Learning from Delayed Rewards. PhD thesis, King’s College, Cambridge (1989)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Fundamental Technological Research, Polish Academy of Sciences, Świetokrzyska 21, 00-049, Warsaw, Poland

    Tomasz Walczak

  2. Department of Electronics and Information Technology, Warsaw University of Technology, Nowowiejska 15/19, 00-665, Warsaw, Poland

    Paweł Cichosz

Authors
  1. Tomasz Walczak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paweł Cichosz
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Artificial Intelligence, Academy of Humanities and Economics, Poland

    Leszek Rutkowski

  2. Institute of Automatics, AGH University of Science and Technology, Al. Mickiewicza 30, PL-30-059, Kraków, Poland

    Ryszard Tadeusiewicz

  3. Department of Electrical Engineering and Computer Sciences, Berkeley Initiative in Soft Computing (BISC), University of California, 94720-1776, Berkeley, CA, USA

    Lotfi A. Zadeh

  4. Department of Electrical Engineering, University of Louisville, 40292, Louisville, KY, U.S.A

    Jacek M. Żurada

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Walczak, T., Cichosz, P. (2006). A Distributed Learning Control System for Elevator Groups. In: Rutkowski, L., Tadeusiewicz, R., Zadeh, L.A., Żurada, J.M. (eds) Artificial Intelligence and Soft Computing – ICAISC 2006. ICAISC 2006. Lecture Notes in Computer Science(), vol 4029. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11785231_128

Download citation

  • DOI: https://doi.org/10.1007/11785231_128

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-35748-3

  • Online ISBN: 978-3-540-35750-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics