skip to main content
10.1145/3419604.3419802acmotherconferencesArticle/Chapter ViewAbstractPublication PagessitaConference Proceedingsconference-collections
research-article

Evaluating Ongoing Decision Support System: A Case Study

Published: 08 November 2020 Publication History

Abstract

The aim of this paper is to put into practice a framework we proposed in an earlier work for evaluating on-going decision support systems. The framework serves as a base for a method to compute evaluation criteria scores using an AHP model. The paper also illustrates the automation of this method into a tool to enable GASCO company to choose between two already implemented DSSs in order to reduce IT operating cost. The evaluation covers three axes: Process, outcome and decision maker metrics. The results highlight the importance of using users' learning as a measure to determine DSS success.

References

[1]
Holsapple, C. W. "Decisions and Knowledge", 2008. In: Handbook on Decision Support Systems 1. International Handbooks Information System. Springer, Berlin, Heidelberg. 2008.
[2]
Parkes, A. "Designing effective decision support using decisional guidance", 2010 PACIS, 91.
[3]
Boukhayma K., Elmanouar, A., 'Evaluating decision support systems: a literature review', 2015. In Proceeding of ISDA, Marrakech 2015. Paper 88.
[4]
Boukhayma K., Elmanouar, A., "Evaluating Decision Support Systems' Effect on User Learning: An Exploratory Study", 2018. In: Rocha Á., Adeli H., Reis L., Costanzo S. (eds) Trends and Advances in Information Systems and Technologies. WorldCIST'18 2018. Advances in Intelligent Systems and Computing, vol 746. Springer, Cham.
[5]
Rhee C., Rao H. R., Evaluation of Decision Support Systems. In: Handbook on Decision Support Systems 2. 2008.International Handbooks Information System. Springer, Berlin, Heidelberg.
[6]
Forgionne, G. "Decision-Making Support Systems Effectiveness: The Process to Outcome Link". 2000.Information Knowledge-Systems Management 2.
[7]
Boukhayma, K., Elmanouar, A. "Towards a global DSS evaluation method using decisional guidance". Journal of Scientific & Engineering Research Volume 8, Issue 8. 2017
[8]
Forgionne, G., Mora M., Gupta J., Gelman O. "Decision-Making Support Systems", 2005. Encyclopedia of Information Science and Technology, Hershey, PA, Idea Group.
[9]
Parikh M., Fazlollahi B., Verma S."The effectiveness of decisional guidance: an empirical evaluation", 2015. Decision Sciences 32 (2).
[10]
Rai, A., Lang, S. S., Welker, R. B., (2002). Assessing the validity of IS success models: An empirical test and theoretical analysis. information systems research, 13 (I).
[11]
Reason, J, 2008. The Human Contribution: Unsafe Acts, Accidents and Heroic Recoveries. Surrey, England, Ashgate.
[12]
Henry, W. W., Potts, c., Jeremy, C., Wyatt Douglas, G., Altman, 2001. Challenges in Evaluating Complex Decision Support Systems: Lessons from Design-a-Trial. In Proceedings of 8th Conference on Artificial Intelligence in Medicine in Europe, 2001.
[13]
Moreau, É. M. F., 2016. The impact of intelligent decision support systems on intellectual task success: An empirical investigation. Decision Support Systems (42:2) (2016).
[14]
Chen, Z., 1992. User responsibility and exception handling in decision support systems. Decision Support Systems. 8(6), 537--5
  1. Evaluating Ongoing Decision Support System: A Case Study

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      SITA'20: Proceedings of the 13th International Conference on Intelligent Systems: Theories and Applications
      September 2020
      333 pages
      ISBN:9781450377331
      DOI:10.1145/3419604
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 08 November 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Decision support systems
      2. software evaluation
      3. user learning

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      SITA'20
      SITA'20: Theories and Applications
      September 23 - 24, 2020
      Rabat, Morocco

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 72
        Total Downloads
      • Downloads (Last 12 months)8
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 18 Feb 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media