Skip to main content
SpringerLink
Log in

A Metrics Framework for Quantifying Autonomy in Complex Systems

  • Conference paper
  • First Online:
Multiagent System Technologies (MATES 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9433))

Included in the following conference series:

Abstract

Autonomous systems, often realized as multi-agent systems, are envisioned to deal with uncertain and dynamic environments. They are applied in dangerous situations, e.g. as rescue robots or to relieve humans from complex and tedious tasks like driving a car or infrastructure maintenance. But in order to further improve the technology a generic measurement and benchmarking of autonomy is required. Within this paper we present an improved understanding of autonomous systems. Based on this foundation we introduce our concept of a multi-dimensional autonomy metric framework that especially takes into account multi-system environments. Finally, our approach is illustrated by means of an example.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alonso, E., Mondragón, E.: Agency, learning and animal-based reinforcement learning. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 1–6. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  2. Alonso, F., Fuertes, J.L., Martínez, L., Soza, H.: Towards a set of measures for evaluating software agent autonomy. In:Eighth Mexican International Conference on Artificial Intelligence, MICAI 2009, pp. 73–78. IEEE (2009)

    Google Scholar 

  3. Barber, K.S., Martin, C.E.: Agent autonomy: specification, measurement, and dynamic adjustment. In: Proceedings of the Autonomy Control Software Workshop at Autonomous Agents, vol. 1999, pp. 8–15. Citeseer (1999)

    Google Scholar 

  4. Barber, K.S., Park, J.: Agent belief autonomy in open multi-agent systems. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 7–16. Springer, Heidelberg (2004)

    Google Scholar 

  5. Bradshaw, J.M., Feltovich, P.J., Jung, H., Kulkarni, S., Taysom, W., Uszok, A.: Dimensions of adjustable autonomy and mixed-initiative interaction. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 17–39. Springer, Heidelberg (2004)

    Google Scholar 

  6. Carabelea, C., Boissier, O., Florea, A.: Autonomy in multi-agent systems: a classification attempt. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 103–113. Springer, Heidelberg (2004)

    Google Scholar 

  7. Carraway, G.F., Squibb, J.B.: Autonomy metrics. In: Proceedings of 4th International Symposium on Space Mission Operations and Ground Data Systems, vol. 2, Munich (1996)

    Google Scholar 

  8. Castelfranchi, C.: Guarantees for autonomy in cognitive agent architecture. In: Wooldridge, M.J., Jennings, N.R. (eds.) Intelligent Agents. Lecture Notes in Computer Science, vol. 890, pp. 56–70. Springer, Heidelberg (1995)

    Chapter  Google Scholar 

  9. Castelfranchi, C., Falcone, R.: From automaticity to autonomy: the frontier of artificial agents. In: Hexmoor, H., Castelfranchi, C., Falcone, R. (eds.) Agent Autonomy. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 7, pp. 103–136. Springer, US (2003)

    Chapter  Google Scholar 

  10. Delaroche, L., Fogel, D.F.L., Freeman, W., Grossbcrg, S., Lee, S., Lima, P., Pouchard, L., Schultz, A.: Measuring performance of systems with autonomy: metrics for intelligence of constructed systems. In: Measuring the Performance and Intelligence of Systems: Proceedings of the 2000 PerMIS Workshop, 14–16 August 2000, vol. 970, p. 4. The Institute (2001)

    Google Scholar 

  11. Dorais, G., Bonasso, R.P., Kortenkamp, D., Pell, B., Schreckenghost, D.: Adjustable autonomy for human-centered autonomous systems. In: Working notes ofthe Sixteenth International Joint Conference on Artificial Intelligence Workshopon Adjustable Autonomy Systems, pp. 16–35 (1999)

    Google Scholar 

  12. Gouaich, A.: Requirements for achieving software agents autonomy and definingtheir responsibility. In: Proceedings of Autonomy Workshop at AAMAS 2003, vol. 236 (2003)

    Google Scholar 

  13. Hinchey, M.G., Sterritt, R.: Self-managing software. Computer 39(2), 107–109 (2006)

    Article  Google Scholar 

  14. Johnson, M., Bradshaw, J., Feltovich, P., Jonker, C., van Riemsdijk, B., Sierhuis, M.: Autonomy and interdependence in human-agent-robot teams. IEEE Intell. Syst. 27(2), 43–51 (2012)

    Article  Google Scholar 

  15. Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36(1), 41–50 (2003)

    Article  MathSciNet  Google Scholar 

  16. Luck, M., D’Inverno, M., Munroe, S.: Autonomy: variable and generative. In: Hexmoor, H., Castelfranchi, C., Falcone, R. (eds.) AUTONOMY 2003. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 7, pp. 11–28. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  17. Maheswaran, R.T., Tambe, M., Varakantham, P., Myers, K.: Adjustable autonomy challenges in personal assistant agents: a position paper. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 187–194. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  18. Myers, K., Berry, P., Blythe, J., Conley, K., Gervasio, M., McGuinness, D., Morley, D., Pfeffer, A., Pollack, M., Tambe, M.: An intelligent personal assistant for task and time management. AI Mag. 28(2), 47–61 (2007)

    Google Scholar 

  19. Myers, K.L., Morley, D.N.: Policy-based agent directability. In: Hexmoor, H., Castelfranchi, C., Falcone, R. (eds.) Agent Autonomy. Multiagent Systems, Artificial Societies, and Simulated Organizations, vol. 7, pp. 185–209. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  20. Olsen, D.R., Goodrich, M.A.: Metrics for evaluating human-robot interactions. In: Proceedings of PERMIS, vol. 2003, p. 4 (2003)

    Google Scholar 

  21. Rudas, I.J., Fodor, J.: Intelligent systems. Int. J. Comput. Commun. Control 3(3), 132–138 (2008)

    Google Scholar 

  22. Salehie, M., Tahvildari, L.: Self-adaptive software: landscape and research challenges. ACM Trans. Auton. Adapt. Syst. 4(2), 1–42 (2009)

    Article  Google Scholar 

  23. Scerri, P., Pynadath, D., Tambe, M.: Adjustable autonomy in real-world multi-agent environments. In: Proceedings of the Fifth International Conference on Autonomous Agents, AGENTS 2001, pp. 300–307. ACM, New York (2001)

    Google Scholar 

  24. Schillo, M., Fischer, K.: A taxonomy of autonomy in multiagent organisation. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 68–82. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  25. Schmeck, H.: Organic computing - a new vision for distributed embedded systems. In: 8th IEEE International Symposium on Object-Oriented Real-Time Distributed Computing (ISORC), pp. 201–203, May 2005

    Google Scholar 

  26. Shannon, C.: A mathematical theory of communication. Bell Syst. Tech. J., 27, 379–423, 623–656, July, October 1948

    Google Scholar 

  27. Sierhuis, M., Bradshaw, J.M., Acquisti, A., Van Hoof, R., Jeffers, R., Uszok, A.: Human-agent teamwork and adjustable autonomy in practice. In: Proceedings of the Seventh International Symposium on Artificial Intelligence, Robotics and Automation in Space (I-SAIRAS) (2003)

    Google Scholar 

  28. Tambe, M., Scerri, P., Pynadath, D.V.: Adjustable autonomy for the real world. J. Artif. Intell. Res. 17(1), 171–228 (2002)

    MathSciNet  MATH  Google Scholar 

  29. Ulrich, I.R., Mondada, F., Nicoud, J.D.: Autonomous vacuum cleaner. Robot. Auton. Syst. 19, 4–233 (1997)

    Article  Google Scholar 

  30. Verhagen, H.: Autonomy and reasoning for natural and artificial agents. In: Nickles, M., Rovatsos, M., Weiss, G. (eds.) AUTONOMY 2003. LNCS (LNAI), vol. 2969, pp. 83–94. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  31. Weiß, G., Rovatsos, M., Nickles, M.: Capturing agent autonomy in roles and xml. In: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2003, pp. 105–112. ACM, New York (2003)

    Google Scholar 

  32. Yavnai, A.: Entropy-based criteria for intelligent autonomous systems. In: Proceedings of the 1991 IEEE International Symposium on Intelligent Control, pp. 55–60, August 1991

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Electrical Engineering and Computer Science, DAI-Labor, Technische Universität Berlin, Ernst-Reuter-Platz 7, 10587, Berlin, Germany

    Christopher-Eyk Hrabia, Nils Masuch & Sahin Albayrak

Authors
  1. Christopher-Eyk Hrabia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nils Masuch
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sahin Albayrak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christopher-Eyk Hrabia .

Editor information

Editors and Affiliations

  1. Technische Universität Clausthal, Clausthal-Zellerfeld, Germany

    Jörg P. Müller

  2. Erasmus University Rotterdam, Rotterdam, The Netherlands

    Wolf Ketter

  3. Bar Ilan University, Ramat Gan, Israel

    Gal Kaminka

  4. Brandenburg University of Technology, Cottbus, Germany

    Gerd Wagner

  5. Delft University of Technology, Delft, The Netherlands

    Nils Bulling

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Hrabia, CE., Masuch, N., Albayrak, S. (2015). A Metrics Framework for Quantifying Autonomy in Complex Systems. In: Müller, J., Ketter, W., Kaminka, G., Wagner, G., Bulling, N. (eds) Multiagent System Technologies . MATES 2015. Lecture Notes in Computer Science(), vol 9433. Springer, Cham. https://doi.org/10.1007/978-3-319-27343-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27343-3_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27342-6

  • Online ISBN: 978-3-319-27343-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation