Abstract
Previous studies show that software development projects strongly underestimate the uncertainty of their effort estimates. This overconfidence in estimation accuracy may lead to poor project planning and execution. In this paper, we investigate whether the use of estimation error information from previous projects improves the realism of uncertainty assessments. As far as we know, there have been no empirical software studies on this topic before. Nineteen realistically composed estimation teams provided minimum-maximum effort intervals for the same software project. Ten of the teams (Group A) received no instructions about how to complete the uncertainty assessment process. The remaining nine teams (Group B) were instructed to apply a history-based uncertainty assessment process. The main results is that software professionals seem to willing to consider the error of previous effort estimates as relevant information when assessing the minimum effort of a new project, but not so much when assessing the maximum effort!
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Connolly, T., Dean, D.: Decomposed versus holistic estimates of effort required for software writing tasks. Management Science 43(7), 1029–1045 (1997)
Jørgensen, M., Teigen, K.H.: Uncertainty Intervals versus Interval Uncertainty: An Alternative Method for Eliciting Effort Prediction Intervals in Software Development Projects. In: International conference on Project Management (ProMAC), Singapore, pp. 343–352 (2002)
Jørgensen, M., Teigen, K.H., Moløkken, K.: Better Sure than Safe? Overconfidence in Judgment Based Software Development Effort Prediction Intervals. Journal of System and Software (2004) (to appear)
Jørgensen, M.: Top-Down and Bottom-Up Expert Estimation of Software Development Effort 46(1), 3–16 (2004)
Alpert, M., Raiffa, H.: A progress report on the training of probability assessors. In: Tversky, A. (ed.) Judgment under uncertainty: Heuristics and biases, pp. 294–305. Cambridge University Press, Cambridge (1982)
Kahnemann, D., Slovic, P., Tversky, A.: Judgement under uncertainty: Heuristics and biases. Cambridge University Press, Cambridge (1982)
Tversky, A., Kahneman, D.: Judgment under uncertainty: Heuristics and biases. Science 185, 1124–1130 (1974)
Yaniv, I., Foster, D.P.: Precision and accuracy of judgmental estimation. Journal of behavioral decision making 10, 21–32 (1997)
Lichtenstein, S., Fischhoff, B.: Do those who know more also know more about how much they know? Organizational Behaviour and Human Decision Processes 20(2), 159–183 (1977)
Arkes, H.R.: Overconfidence in judgmental forecasting. In: Armstrong, J.S. (ed.) Principles of forecasting: A handbook for researchers and practitioners, pp. 495–515. Kluwer Academic Publishers, Boston (2001)
Kahneman, D., Tversky, A.: Variants of uncertainty. In: Kahneman, D., Slovic, P., Tversky, A. (eds.) Judgment under uncertainty: Heuristics and biases, pp. 509–520. Cambridge University Press, Cambridge (1982)
Griffin, D., Buehler, R.: Frequency, probability, and prediction: Easy solutions to cognitive illusions? Cognitive Psychology 38(1), 48–78 (1999)
Kahneman, D., Lovallo, D.: Timid choices and bold forecasts: A cognitive perspective on risk taking. Management Science 39(1), 17–31 (1993)
Jørgensen, M., Sjøberg, D.I.K.: An effort prediction interval approach based on the empirical distribution of previous estimation accuracy. Journal of Information and Software Technology 45(3), 123–136 (2003)
Jørgensen, M., Sjøberg, D.I.K.: Impact of effort estimates on software project work. Information and Software Technology 43(15), 939–948 (2001), 2001
Klein, W.M., Kunda, Z.: Exaggerated self-assessments and the preference for controllable risks. Organizational behavior and human decision processes 59(3), 410–427 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jørgensen, M., Moløkken, K. (2004). Eliminating Over-Confidence in Software Development Effort Estimates. In: Bomarius, F., Iida, H. (eds) Product Focused Software Process Improvement. PROFES 2004. Lecture Notes in Computer Science, vol 3009. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24659-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-24659-6_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21421-2
Online ISBN: 978-3-540-24659-6
eBook Packages: Springer Book Archive