Abstract
We describe the use of simulation‐based experiments to assess the computer support needs of automation supervisors in the United States Postal Service (USPS). Because of the high cost of the proposed system, the inability of supervisors to articulate their computer support needs, and the infeasibility of direct experimentation in the actual work environment, we used a simulation to study end‐user decision making, and to experiment with alternative computer support capabilities. In Phase One we investigated differences between expert and novice information search and decision strategies in the existing work environment. In Phase Two, we tested the impact of computer support features on performance. The empirical results of the two experiments showed how to differentially support experts and novices, and the effectiveness of proposed information systems before they were built. The paper concludes by examining the implications of the project for the software requirements engineering community.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson, N.S. and J.R. Olson, Eds. (1985), Proceedings of the Workshop on Software Human Factors, National Academy Press, Washington, DC.
Anthes, G.H. (1996), “Postal Service Plugging In To On-line Potential,” Computerworld 30,4, 1 & 26.
Bainbridge, L. (1979), “Verbal Reports as Evidence of the Process Operator's Knowledge,” International Journal of Man-Machine Studies 11,4, 411–436.
Bell, P.C. and R.M. O'Keefe (1995), “An Experimental Investigation into the Efficacy of Visual Interactive Simulation,” Management Science 41,6, 1018–1038.
Bell, P.C., A.A. Taseen, and P.F. Kirkpatrick (1990), “Visual Interactive Simulation Modeling in a Decision Support Role,” Computers and Operations Research 17,5, 447–456.
Byrd, T.A., K.L. Cossick, and R.W. Zmud (1992), “A Synthesis of Research on Requirements Analysis and Knowledge Acquisition Techniques,” MIS Quarterly 16,1, 117–138.
Chau, P.Y.K. (1993), “Decision Support Using Traditional Simulation and Visual Interactive Simulation,” Information and Decision Technologies 19,1, 63–76.
Chau, P.Y.K. and P.C. Bell (1994), “Decision Support for the Design of a New Production Plant Using Visual Interactive Simulation,” Journal of the Operational Research Society 45,11, 1273–1284.
Ericsson, A. and H.A. Simon (1984), Protocol Analysis, MIT Press, London, UK.
Eriksson, H. (1992), “A Survey of Knowledge Acquisition Techniques and Tools and Their Relationship to Software Engineering,” Journal of Systems Software 19,1, 97–107.
Johannsen, G. and J.L. Alty (1991), “Knowledge Engineering for Industrial Expert Systems,” Automatica 27,1, 97–114.
Klein, G.A. (1989), “Recognition-Primed Decisions,” Advances in Man-Machine Systems Research 5,1, 47–92.
Kleinmuntz, D.N. (1985), “Cognitive Heuristics and Feedback in a Dynamic Decision Environment,” Management Science 31,6, 680–702.
Kleinmuntz, D.N. and J.B. Thomas (1987), “The Value of Action and Inference in Dynamic Decision Making,” Organizational Behavior and Human Decision Processes 39,3, 341–364.
Lerch, F.J., D.J. Ballou, A.H. Vera, P.R. Snyder, and S. Vargo (1996), “Information Search, Decision Heuristics, and Performance in Dynamic Decision Making: The Effects of General and Specific Task Knowledge,” Working Paper, Graduate School of Industrial Administration, Carnegie Mellon University, Pittsburgh, PA.
Lerch, F.J., D.B. Fenner, P.R. Snyder, and P.S. Goodman (1992), “Information Search in Real-Time Dynamic Decision Making,” In Proceedings of the 5th Advanced Technology Conference, Vol. 3, United State Postal Service, Washington, DC, pp. 893–912.
Mantei, M.M. and T.J. Teorey (1989), “Incorporating Behavioral Techniques into the Systems Development Life Cycle,” MIS Quarterly 13,3, 257–273.
Moray, N. (1987), “Intelligent Aids, Mental Models, and the Theory of Machines,” International Journal of Man-Machine Studies 27,6, 619–629.
Newell, A. and H.A. Simon (1972), Human Problem Solving, Prentice-Hall, Englewood Cliffs, NJ.
Porter, K. (1991), “Visual Interactive Simulation as a Communication Tool — A Case Study,” European Journal of Operational Research 54,3, 287–292.
Randhawa, S.U. and E.D. McDowell (1990), “An Investigation of the Applicability of Expert Systems to Job Shop Scheduling,” International Journal of Man-Machine Studies 32,2, 203–213.
Roth, E.M. and D.D. Woods (1989), “Cognitive Task Analysis: An Approach to Knowledge Acquisition for Intelligent System Design,” In Topics in Expert System Design, G. Guida and C. Tasso, Eds., North-Holland, Amsterdam, The Netherlands, pp. 233–264.
Sterman, J.D. (1989a), “Misperceptions of Feedback in Dynamic Decision Making,” Organizational Behavior and Human Decision Processes 43,3, 301–335.
Sterman, J.D. (1989b), “Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Environment,” Management Science 35,3, 321–339.
Todd, P. and I. Benbasat (1987), “Process Tracing Methods in Decision Support Systems: Exploring the Black Box,” MIS Quarterly 11,4, 493–512.
Woods, D.D. and E. Hollnagel (1987), “Mapping Cognitive Demands in Complex Problem-Solving Worlds,” International Journal of Man-Machine Studies 26,2, 257–275.
Yang, H. (1995), “Information/Knowledge Acquisition Methods for Decision Support Systems and Expert Systems,” Information Processing and Management 31,1, 47–58.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Lerch, F.J., Ballou, D.J. & Harter, D.E. Using simulation‐based experiments for software requirements engineering. Annals of Software Engineering 3, 345–366 (1997). https://doi.org/10.1023/A:1018942122436
Issue Date:
DOI: https://doi.org/10.1023/A:1018942122436