Skip to main content
Springer Nature Link
Log in

Towards a Methodology for Developing Human-AI Collaborative Decision Support Systems

  • Conference paper
  • First Online:
Computer-Human Interaction Research and Applications (CHIRA 2023)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1996))

Abstract

Decision-making is a complex activity, often demanding collaboration, sometimes even in the form of dynamic (ad hoc) teams of loosely coupled participants collected to deal with a particular problem. At the same time, recent developments in the AI have shown that AI plays an important role in decision-making, and AI-agents may become full-fledged participants of collaborative decision support systems. However, integration of AI-agents into collaborative processes requires solving a number of tasks concerning human-AI interaction, interpretability, mutual learning, etc. This paper is a step towards a methodology to create decision support systems based on human-AI collaboration. An analysis of typical requirements to the collaborative decision support systems and typical scenarios that such systems have to implement sustains the introduced methodology. Based on this analysis, foundational problems needed settlements to develop human-AI collaborative decision support systems have been identified, and their possible solutions are offered. In the proposed methodology, ontologies play an important role, providing interoperability among heterogeneous participants. The methodology implies a technological backing in the form of a collaborative computational environment, helping to develop decision support systems for particular domains.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Smirnov, A., Ponomarev, A.: Supporting collective intelligence of human-machine teams in decision-making scenarios. In: Russo, D., Ahram, T., Karwowski, W., Di Bucchianico, G., Taiar, R. (eds.) IHSI 2021. AISC, vol. 1322, pp. 773–778. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-68017-6_115

    Chapter  Google Scholar 

  2. Smirnov, A., Ponomarev, A., Levashova, T., Shilov, N.: Conceptual framework of a human-machine collective intelligence environment for decision support. Proc. Bulg. Acad. Sci. 75, 102–109 (2022). https://doi.org/10.7546/CRABS.2022.01.12

    Article  Google Scholar 

  3. Snyder, H.: Literature review as a research methodology: an overview and guidelines. J. Bus. Res. 104, 333–339 (2019). https://doi.org/10.1016/j.jbusres.2019.07.039

    Article  Google Scholar 

  4. Demartini, G., Mizzaro, S., Spina, D.: Human-in-the-loop artificial intelligence for fighting online misinformation: challenges and opportunities. Bull. Tech. Comm. Data Eng. 43, 65–74 (2020)

    Google Scholar 

  5. Nakahashi, R., Yamada, S.: Balancing performance and human autonomy with implicit guidance agent. Front. Artif. Intell. 4, 736321 (2021). https://doi.org/10.3389/frai.2021.736321

  6. Neef, M.: A taxonomy of human - agent team collaborations. In: Proceedings of the 18th BeNeLux Conference on Artificial Intelligence (BNAIC 2006), pp. 245–250 (2006)

    Google Scholar 

  7. Umbrico, A., Orlandini, A., Cesta, A.: An ontology for human-robot collaboration. Procedia CIRP. 93, 1097–1102 (2020). https://doi.org/10.1016/j.procir.2020.04.045

    Article  Google Scholar 

  8. Wilson, H.J., Daugherty, P.R.: Collaborative Intelligence: Humans and AI are Joining Forces (2018). https://hbr.org/2018/07/collaborative-intelligence-humans-and-ai-are-joining-forces. Accessed 21 Aug 2023

  9. Hemmer, P., Schemmer, M., Riefle, L., Rosellen, N., Vössing, M., Kühl, N.: Factors that influence the adoption of human-AI collaboration in clinical decision-making (2022). http://arxiv.org/abs/2204.09082

  10. van den Bosch, K., Bronkhorst, A.: Human-AI cooperation to benefit military decision making. In: Proceedings of Specialist Meeting Big Data & Artificial Intelligence for Military Decision Making, pp. S3–1–1-S3–1–13 (2018). https://doi.org/10.14339/STO-MP-IST-160

  11. Pohl, J.: Collaborative decision-support and the human-machine relationship. In: A Decision-Making Tools Workshop, pp. 21–46. Collaborative Agent Design Research Center, San Luis (2019)

    Google Scholar 

  12. Kase, S.E., Hung, C.P., Krayzman, T., Hare, J.Z., Rinderspacher, B.C., Su, S.M.: The future of collaborative human-artificial intelligence decision-making for mission planning. Front. Psychol. 13, 850628 (2022). https://doi.org/10.3389/fpsyg.2022.850628

  13. Candrian, C., Scherer, A.: Rise of the machines: Delegating decisions to autonomous AI. Comput. Human Behav. 134, 107308 (2022). https://doi.org/10.1016/j.chb.2022.107308

    Article  Google Scholar 

  14. Klein, G., Woods, D.D., Bradshaw, J.M., Hoffman, R.R., Feltovich, P.J.: Ten challenges for making automation a “Team Player” in joint human-agent activity. IEEE Intell. Syst. 19, 91–95 (2004). https://doi.org/10.1109/MIS.2004.74

    Article  Google Scholar 

  15. Crowley, J.L., et al.: A hierarchical framework for collaborative artificial intelligence. IEEE Pervasive Comput. 22(1), 1–10 (2022). https://doi.org/10.1109/MPRV.2022.3208321

  16. Chen, J., Lim, C.P., Tan, K.H., Govindan, K., Kumar, A.: Artificial intelligence-based human-centric decision support framework: an application to predictive maintenance in asset management under pandemic environments. Ann. Oper. Res. 11, 1–24 (2021). https://doi.org/10.1007/s10479-021-04373-w

    Article  Google Scholar 

  17. Bouabdallaoui, Y., Lafhaj, Z., Yim, P., Ducoulombier, L., Bennadji, B.: Predictive maintenance in building facilities: a machine learning-based approach. Sensors 21, 1044 (2021). https://doi.org/10.3390/s21041044

    Article  Google Scholar 

  18. Lee, M.H., Siewiorek, D.P.P., Smailagic, A., Bernardino, A., Bermúdez i Badia, S.B.: A human-AI collaborative approach for clinical decision making on rehabilitation assessment. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–14. ACM, New York, NY, USA (2021). https://doi.org/10.1145/3411764.3445472

  19. Puranam, P.: Human–AI collaborative decision-making as an organization design problem. J. Organ. Des. 10, 75–80 (2021). https://doi.org/10.1007/s41469-021-00095-2

  20. Lai, V., Carton, S., Bhatnagar, R., Liao, Q.V., Zhang, Y., Tan, C.: Human-AI collaboration via conditional delegation: a case study of content moderation. In: CHI Conference on Human Factors in Computing Systems, pp. 1–18. ACM, New York, NY, USA (2022). https://doi.org/10.1145/3491102.3501999

  21. Cortes, C., DeSalvo, G., Mohri, M.: Learning with rejection. In: Ortner, R., Simon, H.U., Zilles, S. (eds.) ALT 2016. LNCS (LNAI), vol. 9925, pp. 67–82. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46379-7_5

    Chapter  Google Scholar 

  22. Fuegener, A., Grahl, J., Gupta, A., Ketter, W.: Cognitive challenges in human-AI collaboration: Investigating the path towards productive delegation. Inf. Syst. Res. 33, 678–696 (2022)

    Article  Google Scholar 

  23. Bosch, K. van den, Bronkhorst, A.: Human-AI cooperation to benefit military decision making. In: Proceedings of Specialist Meeting Big Data & Artificial Intelligence for Military Decision Making, pp. S3–1–1–S3–1–13. S&T Organization (2018). https://doi.org/10.14339/STO-MP-IST-160

  24. Simon, H.: Rational decision making in business organizations. Am. Econ. Assoc. 69, 493–513 (1979)

    Google Scholar 

  25. Mann, L., Harmoni, R., Power, C.: The GOFER course in decision making. In: Baron, J., Brown, R.V. (eds.) Teaching decision making to adolescents, pp. 61–78. Lawrence Erlbaum Associates, Hillsdale (1991)

    Google Scholar 

  26. Guo, K.L.: DECIDE: a decision-making model for more effective decision making by health care managers. Health Care Manag. (Frederick) 27, 118–127 (2008). https://doi.org/10.1097/01.HCM.0000285046.27290.90

    Article  Google Scholar 

  27. de Sousa Ribeiro, M., Leite, J.: Aligning artificial neural networks and ontologies towards explainable AI. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 6, pp. 4932–4940. AAAI Press (2021)

    Google Scholar 

  28. Bourgeais, V., Zehraoui, F., Ben Hamdoune, M., Hanczar, B.: Deep GONet: self-explainable deep neural network based on Gene Ontology for phenotype prediction from gene expression data. BMC Bioinform. 22, 1–24 (2021). https://doi.org/10.1186/s12859-021-04370-7

    Article  Google Scholar 

  29. Moreau, L., Groth, P.: The prov Ontology. In: Moreau, L., Groth, P. (eds.) Provenance: An Introduction to PROV, pp. 21–38. Springer International Publishing, Cham (2013). https://doi.org/10.1007/978-3-031-79450-6_3

    Chapter  Google Scholar 

  30. Smirnov, A., Levashova, T., Ponomarev, A., Shilov, N.: Methodology for multi-aspect ontology development: ontology for decision support based on human-machine collective intelligence. IEEE Access. 9, 135167–135185 (2021). https://doi.org/10.1109/ACCESS.2021.3116870

    Article  Google Scholar 

  31. Seeliger, A., Pfaff, M., Krcmar, H.: Semantic web technologies for explainable machine learning models: a literature review. CEUR Workshop Proc. 2465, 30–45 (2019)

    Google Scholar 

  32. Smirnov, A., Levashova, T.: Context-aware personalized decision support based on user digital life model. In: Proceedings of the 6th International Conference on Computer-Human Interaction Research and Applications, pp. 129–136. SCITEPRESS - Science and Technology Publications (2022). https://doi.org/10.5220/0011526900003323

  33. Spetzler, C., Winter, H., Meyer, J.: Decision Quality: Value Creation from Better Business Decisions. Wiley (2016)

    Google Scholar 

  34. Fayoumi, A.G.: Evaluating the effectiveness of decision support system: findings and comparison. Int. J. Adv. Comput. Sci. Appl. 9, 195–200 (2018). https://doi.org/10.14569/IJACSA.2018.091023

  35. Straka, G.A.: Measurement and evaluation of competence. Cedefop Reference series, no. 58, pp. 263–311. Luxembourg, Office for Official Publications of the European Communities (2004).

    Google Scholar 

  36. Is Your Team Too Big? Too Small? What’s the Right Number?, https://knowledge.wharton.upenn.edu/podcast/knowledge-at-wharton-podcast/is-your-team-too-big-too-small-whats-the-right-number-2/. Accessed 21 Aug 2023

  37. Katzenbach, J.R., Smith, D.K.: The Wisdom of Teams: Creating the High-Performance Organization. Harvard Business Review Press, Harvard (2015)

    Google Scholar 

  38. LaFasto, F., Larson, C.: When Teams Work Best: 6,000 Team Members and Leaders Tell What it Takes to Succeed. 1st edn. SAGE Publications, Inc (2001)

    Google Scholar 

  39. Robbins, S.P., Judge, T.A.: Organizational Behavior. Prentice Hall, Upper Saddle River (2006)

    Google Scholar 

  40. Karpov, A.A., Lale, A., Ronzhin, A.L.: Multimodal assistive systems for a smart living environment. SPIIRAS Proc. 4(19), 48–64 (2014). https://doi.org/10.15622/sp.19.3

Download references

Acknowledgement

The presented research is due to the grant no. 22–11-00214 from Russian Science Foundation.

Author information

Authors and Affiliations

  1. St. Petersburg Federal Research Center of the Russian Academy of Sciences, 14th Line, 39, St. Petersburg, 199178, Russia

    Alexander Smirnov, Andrew Ponomarev & Tatiana Levashova

Authors
  1. Alexander Smirnov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrew Ponomarev
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tatiana Levashova
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tatiana Levashova .

Editor information

Editors and Affiliations

  1. Instituto Superior Técnico, IT - Institute of Telecommunications, Lisbon, Portugal

    Hugo Plácido da Silva

  2. University of Turin, Turin, Italy

    Pietro Cipresso

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Smirnov, A., Ponomarev, A., Levashova, T. (2023). Towards a Methodology for Developing Human-AI Collaborative Decision Support Systems. In: da Silva, H.P., Cipresso, P. (eds) Computer-Human Interaction Research and Applications. CHIRA 2023. Communications in Computer and Information Science, vol 1996. Springer, Cham. https://doi.org/10.1007/978-3-031-49425-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-49425-3_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-49424-6

  • Online ISBN: 978-3-031-49425-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics