Skip to main content
SpringerLink
Log in
Book cover

International Workshop on Engineering Multi-Agent Systems

EMAS 2021: Engineering Multi-Agent Systems pp 273–291Cite as

Engineering Explainable Agents: An Argumentation-Based Approach

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13190))

Abstract

Explainability has become one of the most important concepts in Artificial Intelligence (AI), resulting in a complete area of study called Explainable AI (XAI). In this paper, we propose an approach for engineering explainable BDI agents based on the use of argumentation techniques. In particular, our approach is based on modelling argumentation schemes, which provide not only the reasoning patterns agents use to instantiate arguments but also templates for agents to translate arguments in an agent-oriented programming language to natural language. Thus, using our approach, agents are able to provide explanations about their mental attitudes and decision-making not only to other software agents but also to humans. This is particularly useful when agents and humans carry out tasks collaboratively.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    For example, new performatives for argumentation-based communication between Jason agents were introduced in [31, 33].

  2. 2.

    Sometimes called presumptive, or abductive as well.

  3. 3.

    Here, we assume that the agent is able to answer the critical questions related to that argument instance.

References

  1. Akata, Z., et al.: A research agenda for hybrid intelligence: augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence. Computer 53(8), 18–28 (2020)

    Article  Google Scholar 

  2. Baskar, J., Janols, R., Guerrero, E., Nieves, J.C., Lindgren, H.: A multipurpose goal model for personalised digital coaching. In: Montagna, S., Abreu, P.H., Giroux, S., Schumacher, M.I. (eds.) A2HC/AHEALTH -2017. LNCS (LNAI), vol. 10685, pp. 94–116. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-70887-4_6

    Chapter  Google Scholar 

  3. Bordini, R.H., Dastani, M., Dix, J., Seghrouchni, A.E.F.: Multi-Agent Programming: Languages. Tools and Applications, 1st edn. Springer, Heidelberg (2009). https://doi.org/10.1007/978-0-387-89299-3

  4. Bordini, R.H., Hübner, J.F., Wooldridge, M.: Programming Multi-Agent Systems in AgentSpeak using Jason. Wiley Series in Agent Technology. Wiley, Hoboken (2007)

    Google Scholar 

  5. Broekens, J., Harbers, M., Hindriks, K., Van Den Bosch, K., Jonker, C., Meyer, J.J.: Do you get it? User-evaluated explainable BDI agents. In: German Conference on Multiagent System Technologies, pp. 28–39. Springer (2010)

    Google Scholar 

  6. Burrieza, A., Yuste-Ginel, A.: Basic beliefs and argument-based beliefs in awareness epistemic logic with structured arguments. Front. Artif. Intell. Appl. 326, 123–134 (2020)

    MATH  Google Scholar 

  7. Cheng, C.Y., Qian, X., Tseng, S.H., Fu, L.C.: Recommendation dialogue system through pragmatic argumentation. In: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 335–340. IEEE (2017)

    Google Scholar 

  8. Dignum, F., Bex, F.: Creating dialogues using argumentation and social practices. In: Diplaris, S., Satsiou, A., Følstad, A., Vafopoulos, M., Vilarinho, T. (eds.) INSCI 2017. LNCS, vol. 10750, pp. 223–235. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-77547-0_17

    Chapter  Google Scholar 

  9. Donadello, I., Dragoni, M., Eccher, C.: Explaining reasoning algorithms with persuasiveness: a case study for a behavioural change system. In: Proceedings of the 35th Annual ACM Symposium on Applied Computing, pp. 646–653 (2020)

    Google Scholar 

  10. Dung, P.M.: On the acceptability of arguments and its fundamental role in nonmonotonic reasoning, logic programming and n-person games. Artif. Intell. 77, 321–357 (1995)

    Article  MathSciNet  Google Scholar 

  11. Ehsan, U., Riedl, M.: On design and evaluation of human-centered explainable AI systems. In: Glasgow 2019 (2019)

    Google Scholar 

  12. Engelmann, D., Couto, J., Gabriel, V., Vieira, R., Bordini, R.: Towards an ontology to support decision-making in hospital bed allocation. In: Proceedings of 31st International Conference on Software Engineering & Knowledge Engineering, pp. 71–74 (2019)

    Google Scholar 

  13. Engelmann, D.C.: Conversational agents based on argumentation theory and ontologies. In: Proceedings of the Fourth Summer School on Argumentation: Computational and Linguistic Perspectives (SSA 2020), pp. 10–12 (2020)

    Google Scholar 

  14. Engelmann, D.C.: An interactive agent to support hospital bed allocation based on plan validation. Dissertation, Pontifícia Universidade Católica do Rio Grande do Sul (2019)

    Google Scholar 

  15. Grando, A., Moss, L., Bel-Enguix, G., Jiménez-López, M.D., Kinsella, J.: Argumentation-based dialogue systems for medical training. In: Neustein, A., Markowitz, J. (eds.) Where Humans Meet Machines, pp. 213–232. Springer, New York (2013). https://doi.org/10.1007/978-1-4614-6934-6_10

    Chapter  Google Scholar 

  16. Grübler, M.d.S., da Costa, C.A., Righi, R., Rigo, S., Chiwiacowsky, L.: A hospital bed allocation hybrid model based on situation awareness. Comput. Inform. Nurs. 36, 249–255 (2018)

    Google Scholar 

  17. Gunning, D.: Explainable Artificial Intelligence (XAI). Defense Advanced Research Projects Agency (DARPA), and Web 2, 2 (2017)

    Google Scholar 

  18. Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., Yang, G.Z.: XAI-explainable artificial intelligence. Sci. Robot. 4(37), eaay7120 (2019)

    Google Scholar 

  19. Harbers, M., van den Bosch, K., Meyer, J.J.: Design and evaluation of explainable BDI agents. In: 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, vol. 2, pp. 125–132. IEEE (2010)

    Google Scholar 

  20. Huynh, T.D., Jennings, N.R., Shadbolt, N.R.: An integrated trust and reputation model for open multi-agent systems. Auton. Agents Multi-Agent Syst. 13(2), 119–154 (2006)

    Article  Google Scholar 

  21. Kökciyan, N., et al.: A collaborative decision support tool for managing chronic conditions. In: MedInfo, pp. 644–648 (2019)

    Google Scholar 

  22. Langley, P.: Explainable agency in human-robot interaction. In: AAAI Fall Symposium Series (2016)

    Google Scholar 

  23. Matos, J., Rodrigues, P.P.: Modeling decisions for hospital bed management - a review. In: 4th International Conference on Health Informatics, pp. 504–507 (2011)

    Google Scholar 

  24. Melo, V.S., Panisson, A.R., Bordini, R.H.: Argumentation-based reasoning using preferences over sources of information. In: Fifteenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS) (2016)

    Google Scholar 

  25. Panisson, A.R., Bordini, R.H.: Knowledge representation for argumentation in agent-oriented programming languages. In: 2016 Brazilian Conference on Intelligent Systems, BRACIS (2016)

    Google Scholar 

  26. Panisson, A.R., Bordini, R.H.: Argumentation schemes in multi-agent systems: a social perspective. In: El Fallah-Seghrouchni, A., Ricci, A., Son, T.C. (eds.) EMAS 2017. LNCS (LNAI), vol. 10738, pp. 92–108. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91899-0_6

    Chapter  Google Scholar 

  27. Panisson, A.R., Bordini, R.H.: Uttering only what is needed: enthymemes in multi-agent systems. In: Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems, pp. 1670–1672. International Foundation for Autonomous Agents and Multiagent Systems (2017)

    Google Scholar 

  28. Panisson, A.R., Bordini, R.H.: Towards a computational model of argumentation schemes in agent-oriented programming languages. In: IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) (2020)

    Google Scholar 

  29. Panisson, A.R., et al.: Arguing about task reallocation using ontological information in multi-agent systems. In: 12th International Workshop on Argumentation in Multiagent Systems (2015)

    Google Scholar 

  30. Panisson, A.R., Melo, V.S., Bordini, R.H.: Using preferences over sources of information in argumentation-based reasoning. In: 2016 Brazilian Conference on Intelligent Systems, BRACIS (2016)

    Google Scholar 

  31. Panisson, A.R., Meneguzzi, F., Fagundes, M., Vieira, R., Bordini, R.H.: Formal semantics of speech acts for argumentative dialogues. In: Thirteenth International Conference on Autonomous Agents and Multiagent Systems, pp. 1437–1438 (2014)

    Google Scholar 

  32. Panisson, A.R., Meneguzzi, F., Vieira, R., Bordini, R.H.: An approach for argumentation-based reasoning using defeasible logic in multi-agent programming languages. In: 11th International Workshop on Argumentation in Multiagent Systems (2014)

    Google Scholar 

  33. Panisson, A.R., Meneguzzi, F., Vieira, R., Bordini, R.H.: Towards practical argumentation in multi-agent systems. In: 2015 Brazilian Conference on Intelligent Systems, BRACIS 2015 (2015)

    Google Scholar 

  34. Panisson, A.R., Sarkadi, S., McBurney, P., Parsons, S., Bordini, R.H.: Lies, bullshit, and deception in agent-oriented programming languages. In: Proceedings of the 20th International Trust Workshop co-located with AAMAS/IJCAI/ECAI/ICML 2018, Stockholm, Sweden, 14 July 2018. pp. 50–61 (2018)

    Google Scholar 

  35. Pinto, L.R., de Campos, F.C.C., Perpétuo, I.H.O., Ribeiro, Y.C.N.M.B.: Analisys of hospital bed capacity via queuing theory and simulation. In: Proceedings of the Winter Simulation Conference 2014, pp. 1281–1292. IEEE (2014)

    Google Scholar 

  36. Prakken, H.: An abstract framework for argumentation with structured arguments. Argument Comput. 1(2), 93–124 (2011)

    Article  Google Scholar 

  37. Rao, A.S.: AgentSpeak(L): BDI agents speak out in a logical computable language. In: Van de Velde, W., Perram, J.W. (eds.) MAAMAW 1996. LNCS, vol. 1038, pp. 42–55. Springer, Heidelberg (1996). https://doi.org/10.1007/BFb0031845

    Chapter  Google Scholar 

  38. Richardson, A., Rosenfeld, A.: A survey of interpretability and explainability in human-agent systems. In: XAI Workshop on Explainable Artificial Intelligence, pp. 137–143 (2018)

    Google Scholar 

  39. Sabater, J., Sierra, C.: Review on computational trust and reputation models. Artif. Intell. Rev. 24(1), 33–60 (2005)

    Article  Google Scholar 

  40. Sado, F., Loo, C.K., Kerzel, M., Wermter, S.: Explainable goal-driven agents and robots-a comprehensive review and new framework. arXiv preprint arXiv:2004.09705 (2020)

  41. Sarkadi, S., Panisson, A.R., Bordini, R.H., McBurney, P.J., Parsons, S.D., Chapman, M.D.: Modelling deception using theory of mind in multi-agent systems. AI Commun. 32(4), 287–302 (2019)

    Article  MathSciNet  Google Scholar 

  42. Schmidt, D.: Ontologias para Representação de Tarefas Colaborativas em Sistemas Multi-Agentes. Master’s thesis, Pontifical Catholic University of Rio Grande do Sul (2015)

    Google Scholar 

  43. Tao, X., Yelland, N., Zhang, Y.: Fuzzy cognitive modeling for argumentative agent. In: 2012 IEEE International Conference on Fuzzy Systems, pp. 1–8. IEEE (2012)

    Google Scholar 

  44. Teow, K.L., El-Darzi, E., Foo, C., Jin, X., Sim, J.: Intelligent analysis of acute bed overflow in a tertiary hospital in Singapore. J. Med. Syst. 36, 1873–1882 (2012)

    Article  Google Scholar 

  45. Toulmin, S.E.: The Uses of Argument. Cambridge University Press, Cambridge (1958)

    Google Scholar 

  46. Walton, D., Reed, C., Macagno, F.: Argumentation Schemes. Cambridge University Press, Cambridge (2008)

    Google Scholar 

  47. Walton, D.: Argumentation Schemes for Presumptive Reasoning. Routledge (1996)

    Google Scholar 

  48. Weber, K., Janowski, K., Rach, N., Weitz, K., Minker, W., Ultes, S., André, E.: Predicting persuasive effectiveness for multimodal behavior adaptation using bipolar weighted argument graphs. In: International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2019, Auckland, New Zealand, May 2020, pp. 1476–1484 (2020)

    Google Scholar 

  49. Wooldridge, M.: An Introduction to Multiagent Systems. Wiley, Hoboken (2009)

    Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge partial funding from CNPq and CAPES.

Author information

Authors and Affiliations

  1. Federal University of Santa Catarina, Araranguá, SC, Brazil

    Alison R. Panisson

  2. School of Technology, PUCRS, Porto Alegre, RS, Brazil

    Débora C. Engelmann & Rafael H. Bordini

Authors
  1. Alison R. Panisson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Débora C. Engelmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rafael H. Bordini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alison R. Panisson .

Editor information

Editors and Affiliations

  1. Utrecht University, Utrecht, The Netherlands

    Natasha Alechina

  2. University of Turin, Turin, Italy

    Matteo Baldoni

  3. Utrecht University, Utrecht, The Netherlands

    Brian Logan

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Panisson, A.R., Engelmann, D.C., Bordini, R.H. (2022). Engineering Explainable Agents: An Argumentation-Based Approach. In: Alechina, N., Baldoni, M., Logan, B. (eds) Engineering Multi-Agent Systems. EMAS 2021. Lecture Notes in Computer Science(), vol 13190. Springer, Cham. https://doi.org/10.1007/978-3-030-97457-2_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-97457-2_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-97456-5

  • Online ISBN: 978-3-030-97457-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation