Skip to main content
Springer Nature Link
Log in

Evaluation of Project Quality: A DEA-Based Approach

  • Conference paper
Software Process Change (SPW 2006)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 3966))

Included in the following conference series:

Abstract

The evaluation of project quality exhibits multivariable, VRS (variable return to scale) and decision maker’s preference properties. In this paper, we present a Data Envelopment Analysis (DEA) based evaluation approach. The DEA VRS model, which handles multivariable and VRSeffectively, is used to measure project quality. And the DEA cone ratio model, which utilizes Analytical Hierarchy Process (AHP) to constrain quality metrics with respect to decision maker’s preference, is also adopted to analyze the return to scaleof the projects. A case study, which assesses 10 projects from ITECHS and 20 “Top active” projects on sourceforge.net with the novel method, is demonstrated. The results indicate that our approach is effective for quality evaluation and can get accurate estimates of future possible improvements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Stensrud, E., Myrtveit, I.: Identifying High Performance ERP Projects. IEEE Transaction on Software Engineering 29(5), 387–416 (2003)

    Article  Google Scholar 

  2. Paradi, J.C., Reese, D.N., Rosen, D.: Applications of DEA to measure the efficiency of software production at two large Canadian banks. Annals of Operations Research 73, 91–115 (1997)

    Article  MATH  Google Scholar 

  3. http://itechs.iscas.ac.cn/

  4. http://sourceforge.net/index.php

  5. Malaiya, Y.K., Denton, J.: Module Size Distribution and Defect Density Software Reliability Engineering. Software Reliability Engineering, 62–71 (2000)

    Google Scholar 

  6. Rosenberg, J.: Some Misconceptions About Lines of Code. In: Software Metrics Symposium, pp. 137–142 (1997)

    Google Scholar 

  7. Golden, B.L., Wasil, E.A., Harker, P.T. (eds.): The Analytic Hierarchy Process - Applications and Studies. Springer, Heidelberg (1989)

    Google Scholar 

  8. Liang, L., Cui, J.C.: Selection of Input-output Items and Data Disposal in DEA. Journal of Systems Engineering 18(6), 487–490 (2003)

    Google Scholar 

  9. Banker, R.D., Charnes, A., Cooper, W.W.: Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis. Management Science 30(9), 1078–1092 (1984)

    Article  MATH  Google Scholar 

  10. Dinh-Trong, T., Bieman, J.M.: Open source software development: a case study of FreeBSD Software Metrics. Software Metrics, 96–105 (2004)

    Google Scholar 

  11. Charnes, A., Cooper, W.W., Wei, Q.L., et al.: Cone Ratio Data Envelopment Analysis and Multi-Objective Programming. International Journal of System Science 20(7), 1099–1118 (1989)

    Article  MATH  Google Scholar 

  12. Charnes, A., Cooper, W.W., Rhodes, E.: Measuring the Efficiency of Decision Making Units. European J. Operational Research 2, 429–444 (1978)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratory for Internet Software Technologies, Institute of Software, The Chinese Academy of Sciences, Beijing, 100080, China

    Shen Zhang, Yongji Wang, Jie Tong, Jinhui Zhou & Li Ruan

  2. Key Laboratory for Computer Science, The Chinese Academy of Sciences, Beijing, 100080, China

    Shen Zhang

  3. The Chinese Academy of Sciences, Graduate University, Beijing, 100039, China

    Yongji Wang, Jie Tong, Jinhui Zhou & Li Ruan

Authors
  1. Shen Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yongji Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jie Tong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jinhui Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Li Ruan
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Massey University, New Zealand

    Qing Wang

  2. Department of Informatics, University of Oslo, Norway

    Dietmar Pfahl

  3. Portland State University, 631 SW Harrison St., Portland, OR, USA

    David M. Raffo

  4. School of Computer Science, University of Hertfordshire, College Lane, AL10 9AB, Hatfield, Herts, UK

    Paul Wernick

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhang, S., Wang, Y., Tong, J., Zhou, J., Ruan, L. (2006). Evaluation of Project Quality: A DEA-Based Approach. In: Wang, Q., Pfahl, D., Raffo, D.M., Wernick, P. (eds) Software Process Change. SPW 2006. Lecture Notes in Computer Science, vol 3966. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11754305_10

Download citation

  • DOI: https://doi.org/10.1007/11754305_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34199-4

  • Online ISBN: 978-3-540-34201-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics