Skip to main content
Springer Nature Link
Log in

Evaluating the Impact of the QuARS Requirements Analysis Tool Using Simulation

  • Conference paper
Software Process Dynamics and Agility (ICSP 2007)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 4470))

Included in the following conference series:

Abstract

Adopting new tools and technologies on a development process can be a risky endeavor. Will the project accept the new technology? What will be the impact? Far too often the project is asked to adopt the new technology without planning how it will be applied on the project or evaluating the technology’s potential impact. In this paper we provide a case study evaluating one new technology. Specifically we assess the merits of an automated defect detection tool. Using process simulation, we find situations where the use of this new technology is useful and situations where the use of this new technology is useless for large-scale NASA projects that utilize a process similar to the IEEE 12207 systems development lifecycle. The method can be applied to assessing the impact (including Return on Investment), break even point and the overall value of applying any tool on a project.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Lami, G., Gnesi, S., Fabbrini, F., Fusani, M., Trentanni, G.: An Automatic Tool for the Analysis of Natural Language Requirements. International Journal of Computer Systems Science and Engineering, Special Issue on Automated Tools for Requirement Engineering 20 (2005)

    Google Scholar 

  2. Kellner, M.I., Madachy, R.J., Raffo, D.M.: Software Process Simulation Modeling: Why? What? How? Journal of Systems and Software 46, 91–105 (1999)

    Article  Google Scholar 

  3. Raffo, D.: Predicting the Impact of potential process changes: A quantitative approach to process modeling. In: Emam, K.E., Madhavji, N.H. (eds.) Elements of Software Process Assessment and Improvement, IEEE Computer Soc. Press, Los Alamitos (1999)

    Google Scholar 

  4. Raffo, D., Harrison, W., Vandeville, J.: Coordinating models and metrics to manage software projects. Software Process Improvement and Practice 5, 159–168 (2000)

    Article  Google Scholar 

  5. Raffo, D.M., Vandeville, J.V., Martin, R.H.: Software process simulation to achieve higher CMM levels. Journal of Systems and Software 46, 163–172 (1999)

    Article  Google Scholar 

  6. Raffo, D., Settle, J., Harrison, W.: Estimating the Financial Benefit and Risk Associated with Process Changes. In: First Workshop on Economics-Driven Software Engineering Research, International Conference on Software Engineering (ICSE 99), Los Angeles, California (1999)

    Google Scholar 

  7. Osterweil, L.J., Sondheimer, N.K., Clarke, L.A., Katsh, E., Rainey, D.: Using Process Definitions to Facilitate the Specification of Requirements. Department of Computer Science, University of Massachusetts, Amherst, MA 01003 (2006)

    Google Scholar 

  8. Pfahl, D., Laitenberger, O., Dorsch, J., Ruhe, G.: An Externally Replicated Experiment for Evaluating the Learning Effectiveness of Using Simulations in Software Project Management Education. Empirical Software Engineering 8, 367–395 (2003)

    Article  Google Scholar 

  9. Melis, M., Turnu, I., Cau, A., Concas, G.: A Software Process Simulation Model of Extreme Programming. In: The 6th International Workshop on Software Process Simulation and Modeling, St. Louis, Missouri (2005)

    Google Scholar 

  10. Abdel-Hamid, T.K.: Dynamics of software project staffing: A system dynamics based simulation approach. IEEE Transactions on Software Engineering 15, 109–119 (1989)

    Article  Google Scholar 

  11. Madachy, R.J.: System dynamics modeling of an inspection-based process, pp. 376–386 (1996)

    Google Scholar 

  12. Smith, N., Capiluppi, A., Fernández-Ramil, J.: Agent-based simulation of open source evolution. Software Process: Improvement and Practice 11, 423–434 (2006)

    Article  Google Scholar 

  13. Martin, R.H., Raffo, D.: A model of the software development process using both continuous and discrete models. Software Process: Improvement and Practice 5, 147–157 (2000)

    Article  Google Scholar 

  14. Setamanit, S., Wakeland, W., Raffo, D.: Using Simulation to Evaluate Global Software Development Task Allocation Strategies. Special Issue on Software Process, Software Process: Improvement and Practice (Forthcomming)

    Google Scholar 

  15. Wakeland, W.W., Martin, R.H., Raffo, D.: Using design of experiments, sensitivity analysis, and hybrid simulation to evaluate changes to a software development process: a case study. Software Process: Improvement and Practice 9, 107–119 (2004)

    Article  Google Scholar 

  16. Law, A.M., Kelton, W.D.: Simulation Modeling and Analysis. The McGraw-Hill Companies, Inc., New York (2003)

    Google Scholar 

  17. Leffingwell, D., Widrig, D.: Managing software requirements: a unified approach. Addison-Wesley Longman Publishing Co., Inc, Boston (2000)

    Google Scholar 

  18. Ferguson, R.W., Lami, G.: An Empirical Study on the Relationship between Defective Requirements and Test Failures. In: 30th IEEE-NASA Annual Software Engineering Workshop (SEW-30), Columbia, MD, U.S.A, IEEE Computer Society Press, Los Alamitos (2006)

    Google Scholar 

  19. Lami, G., Ferguson, R.W.: An Empirical Study on the Impact of Automation on the Requirements Analysis Process. Journal of Computer Science and Technology (JCST) (Forthcomming)

    Google Scholar 

  20. Raffo, D., Nayak, U., Wakeland, W.: Implementing Generalized Process Simulation Models. In: 6th International Workshop on Software Process Simulation and Modeling, St. Louis, Missouri (2005)

    Google Scholar 

  21. IEEE/EIA 12207.0-1996 IEEE/EIA Standard Industry Implementation of International Standard ISO/IEC 12207: 1995 (ISO/IEC 12207) Standard for Information Technology Software Life Cycle Processes. IEEE/EIA 12207.0-1996, i-75 (1998)

    Google Scholar 

  22. Raffo, D., Nayak, U., Setamanit, S.-o., Sullivan, P., Wakeland, W.: Using Software Process Simulation to Assess the Impact of IV&V Activities. In: Proceeding of the 5th International Workshop on Software Process Simulation and Modeling (ProSim’04), Edinburgh, Scotland (2004)

    Google Scholar 

  23. Jones, C.: Applied software measurement: assuring productivity and quality. McGraw-Hill, New York (1991)

    MATH  Google Scholar 

  24. Raffo, D., Wakeland, W.: High Value Added Ways to Apply Process Simulation with Organizations. Software Engineering Institute, Carnegie Mellon University (Forthcoming)

    Google Scholar 

  25. Harrison, W., Raffo, D., Settle, J., Eickelmann, N.: Technology Review: Adapting Financial Measures: Making a Business Case for Software Process Improvement. Software Quality Control 8, 211–231 (1999)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Business Administration, Portland State University, Portland, Oregon 97201, USA

    David M. Raffo & Siri-on Setamanit

  2. Maseeh College of Engineering and Computer Science, Portland State University, Portland, Oregon 97201, USA

    David M. Raffo & Bhuricha Deen Sethanandha

  3. Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA

    Robert Ferguson

Authors
  1. David M. Raffo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert Ferguson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Siri-on Setamanit
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bhuricha Deen Sethanandha
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Qing Wang Dietmar Pfahl David M. Raffo

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer Berlin Heidelberg

About this paper

Cite this paper

Raffo, D.M., Ferguson, R., Setamanit, So., Sethanandha, B.D. (2007). Evaluating the Impact of the QuARS Requirements Analysis Tool Using Simulation. In: Wang, Q., Pfahl, D., Raffo, D.M. (eds) Software Process Dynamics and Agility. ICSP 2007. Lecture Notes in Computer Science, vol 4470. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72426-1_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-72426-1_26

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-72425-4

  • Online ISBN: 978-3-540-72426-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics