Skip to main content
SpringerLink
Log in

Meta Analysis — a Method of Combining Empirical Results and its Application in Object-Oriented Software Systems

  • Conference paper
OOIS 2001

Abstract

Understanding and controlling software development processes have gained increasing importance. In this sense experimentation is an accepted approach toward scientific disciplines, including the software development community. It enables us to establish and validate measures that give comprehensive and accurate quantitative description of the characteristics of these systems.

However, individual experimental studies tend to yield different results and draw different conclusions on the same phenomena. One way to make sense of the vast number of accumulated study findings is to apply meta-analysis to the results of individual studies.

The intent of this paper is to review the principles of meta-analytic methods and techniques, their applications in different sciences and software engineering, and present results achieved in these fields. Particular attention is paid to object-oriented software measures and their numeric characterization.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Light R.J., D.B. Pillemar. Summing Up: The Science of reviewing research. Harvard University Press, Cambridge, Massachusetts, and London, England, 1984

    Google Scholar 

  2. Hunter J.E., F.L Schmidt. Methods of Meta-Analysis — Correcting Error and Bias in Research Findings. Newbury Park: Sage Publications, 1995

    Google Scholar 

  3. Hedges L.V., I. Olkin. Statistical methods for meta-analysis, Orlando: Academic Press, 1984

    Google Scholar 

  4. Brooks A. Meta Analysis — A Silver Bullet — for Meta-Analysis. Empirical Software Engineering 1997; 2: 333 – 338

    Article  Google Scholar 

  5. Cook T.D., H. Cooper, D.S. Cordray, H. Hartmann, L.V. Hedges, R.J. Light, T.A. Louis, F. Mosteller. Meta-Analysis for explanation — A casebook, 1994

    Google Scholar 

  6. Liao Yuen-Kuang Cliff. Effects on hypermedia versus traditional instruction on students’ achievement: A meta-analysis. J Res Comput Educ 1998; 30: 341

    Google Scholar 

  7. Belanger Scott E. Literature Review and Analysis of Biological Complexity in Model Stream Ecosystems: Influence of Size and Experimental Design. Ecotox Environ Safe 1997; 36: 1 – 16

    Article  Google Scholar 

  8. Sohn S.Y. Meta Analysis of Classification Algorithms for Pattern Recognition, IEEE T Pattern Anal 1999; 21: 1137 – 1144

    Article  Google Scholar 

  9. Hayes W. Research Synthesis in Software Engineering: A Case for Meta-Analysis. Proceedings of the Sixth IEEE International Symposium on Software Metrics, 2000

    Google Scholar 

  10. Miller J. Can results from Software Engineering experiments be safely combined? Proceedings of the Sixth IEEE International Symposium on Software Metrics 2000

    Google Scholar 

  11. Pickard L.M., B.A. Kitchenham, P.W. Jones Combining empirical results in software engineering. Inform Software Tech 1998; 40: 811 – 821

    Article  Google Scholar 

  12. Hu Q. Evaluating Alternative Software Production Functions. IEEE T Software Eng 1997; 23

    Google Scholar 

  13. Chidamber S.R, D.P. Darcy, C.F. Kemerer. Towards a Metrics suite for Object Oriented Design. OOPSLA 1991: 197–211

    Google Scholar 

  14. Chidamber S.R, C.F. Kemerer. A metrics suite for object-oriented design. IEEE T Software Eng 1994; 20: 476 – 493

    Article  Google Scholar 

  15. Basili V.R., L.C. Briand, W.L. Melo. A Validation of Object-Oriented Design Metrics as Quality Indicators. IEEE T Software Eng 1996; 22: 751 – 761

    Article  Google Scholar 

  16. El Emam K., S. Benlarbi, N. Goel. The Confounding Effect of Class Size on the Validity of Object-Oriented Metrics. Technical Report, NRC/ERB-1062, September 1999. NRC 43606

    Google Scholar 

  17. Briand L.C., J. Wüst. The impact of Design on Development Cost in Object-Oriented Systems. ISERN Technical Report 99–16

    Google Scholar 

  18. Li W., S. Henry. Object-Oriented Metrics that Predict Maintainability. J Syst Software 1993; 23: 111 – 122

    Article  Google Scholar 

  19. Chidamber S.R, D.P. Darcy, C.F. Kemerer. Managerial Use of Metrics for Object-Oriented Software: An Exploratoiy Analysis. IEEE T Software Eng 1998; 24: 629 – 639

    Article  Google Scholar 

  20. Belsley D.A. Conditioning diagnostics: Collinearity and Weak Data in Regression. J. Wiley, New York, 1991

    Google Scholar 

  21. Aron A., E.N. Aron. Statistics for the behavioral and social sciences. Prentice Hall, 1997

    Google Scholar 

  22. Succi G., L. Benedicenti, C. Bonamico, T. Vernazza. The Webmetrics Project — Exploiting Software Tools on Demand. World Multiconference on Systemics, Cybernetics, and Informatics 1998, Orlando, FL

    Google Scholar 

  23. Cohen J. Statistical power analysis for the behavioral sciences, New York: Academic Press, 1977

    Google Scholar 

  24. Greene W.H. Econometric analysis, New York: Macmillan; London: Collier Macmillan, 2000

    Google Scholar 

  25. Schmidt P. Estimation of Seemingly Unrelated Regressions with Unequal Numbers of Observations. J Econometrics 1977, 5:365–377

    Article  MATH  Google Scholar 

  26. Im E. Unequal Numbers of Observations and Partial Efficiency Gain. Econ Lett 1994, 46:291–294

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Alberta, Edmonton, Canada

    Snezana Djokic, Giancarlo Succi & Witold Pedrycz

  2. Department of Electrical and Computer Engineering, University of Calgary, Calgary, Calgary, Canada

    Martin Mintchev

Authors
  1. Snezana Djokic
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Giancarlo Succi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Witold Pedrycz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Martin Mintchev
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Electrical and Computer Engineering, Faculty of Engineering, University of Calgary, Canada

    Xingxu Wang  & Ronald Johnston  & 

  2. School of Computing, Information Systems and Mathematics, South Bank University, 103 Borough Road, London, UK

    Shushma Patel

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag London Limited

About this paper

Cite this paper

Djokic, S., Succi, G., Pedrycz, W., Mintchev, M. (2001). Meta Analysis — a Method of Combining Empirical Results and its Application in Object-Oriented Software Systems. In: Wang, X., Johnston, R., Patel, S. (eds) OOIS 2001. Springer, London. https://doi.org/10.1007/978-1-4471-0719-4_12

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-0719-4_12

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-85233-546-5

  • Online ISBN: 978-1-4471-0719-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation