Skip to main content
SpringerLink
Log in

Exploring the effects of SourceForge.net coordination and communication tools on the efficiency of open source projects using data envelopment analysis

  • Published:
Empirical Software Engineering Aims and scope Submit manuscript

Abstract

In this paper we explore possible benefits of communication and coordination tools in open source projects using an efficiency score derived from data envelopment analysis (DEA) as dependent variable. DEA is a general non-parametric method for efficiency comparisons without asking the user to define any relations between different factors or a production function. The method can account for economies or diseconomies of scale, and is able to deal with multi-input, multi-output systems in which the factors have different scales. Using two different data sets, successful and random open source projects, retrieved from SourceForge.net, we analyze impacts on their efficiency from the usage of communication and coordination tools. The results were mixed with no clear positive effects being proven consistently: In the data set of successful projects, mostly negative influences were found. On the contrary, tool adoption showed positive relationships to efficiency in the random data set. This stresses the importance of development status as a moderating variable and might also hint at threshold values for tool benefits. In addition, adoption of tools outside the hosting platform may be more likely for successful projects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Albrecht AJ, Gaffney JE (1983) Software function, source lines of code, and development effort prediction: a software science validation. IEEE Trans Softw Eng 9(6):639–648 doi:10.1109/TSE.1983.235271

    Article  Google Scholar 

  • Amor JJ, Robles G, Gonzalez-Barahona JM (2006) Effort Estimation by Characterizing Developer Activity. In: Proceedings 8th International Workshop on Economics-Driven Software Engineering Research (ICSE 2006), Shanghai, China

  • Banker RD, Chang H, Kemerer CF (1994) Evidence on economies of scale in software development. Inf Softw Technol 36(5):275–282 doi:10.1016/0950-5849(94)90083-3

    Article  Google Scholar 

  • Banker RD, Charnes A, Cooper W (1984) Some models for estimating technical and scale inefficiencies in data envelopment analysis. Manage Sci 30:1078–1092

    Article  MATH  Google Scholar 

  • Banker RD, Kauffman RJ (1991) Reuse and productivity in integrated computer-aided software engineering: an empirical study. MIS Q 15(3):375–401 doi:10.2307/249649

    Article  Google Scholar 

  • Banker RD, Kemerer C (1989) Scale economies in new software development. IEEE Trans Softw Eng 15(10):416–429 doi:10.1109/TSE.1989.559768

    Article  Google Scholar 

  • Banker RD, Slaughter SA (1997) A field study of scale economies in software maintenance. Manage Sci 43(12):1709–1725

    Article  MATH  Google Scholar 

  • Boehm BW, Abts C, Brown AW, Chulani S, Clark BK, Horowitz E et al (2000) Software Cost Estimation with COCOMO II. Prentice Hall, Upper Saddle River, NJ

    Google Scholar 

  • Brooks FP Jr (1995) The mythical man-month: essays on software engineering. Anniversary edition. Addison-Wesley, Reading, MA

    Google Scholar 

  • Carmel E, Agarwal R (2001) Tactical approaches for alleviating distance in global software development. IEEE Softw 18(2):22–29 doi:10.1109/52.914734

    Article  Google Scholar 

  • Charnes A, Cooper W, Rhodes E (1978a) A Data Envelopment Analysis Approach to Evaluation of the Program Follow Through Experiments in U.S. Public School Education (Management Science Research Report No. 432) Carnegie-Mellon University, Pittsburgh, PA

  • Charnes A, Cooper W, Rhodes E (1978b) Measuring the efficiency of decision making units. Eur J Oper Res 2:429–444 doi:10.1016/0377-2217(78)90138-8

    Article  MATH  MathSciNet  Google Scholar 

  • Crowston K, Annabi H, Howison J (2003) Defining open source software project success. In: Proceedings of ICIS 2003, Seattle, WA

  • Crowston K, Annabi H, Howison J, Masango C (2004) Towards a portfolio of FLOSS Project success measures. In: Collaboration, Conflict and Control: The 4th Workshop on Open Source Software Engineering (ICSE 2004), Edinburgh, Scotland

  • Crowston K, Howison J, Annabi H (2006) Information systems success in free and open source software development: theory and measures. Softw Process Improv Pract 11(2):123–148 doi:10.1002/spip.259

    Article  Google Scholar 

  • Demetriou N, Koch S, Neumann G (2006) The Development of the OpenACS Community. In: Lytras M, Naeve A (eds) Open source for knowledge and learning management: strategies beyond tools. Idea, Hershey, PA

    Google Scholar 

  • Diaz-Martinez, Z. and Fernandez-Menendez, J. (2008). DEA: Data Envelopment Analysis. R package version 0.1–2

  • Dixon R (2003) Open source software law. Artech House, Norwood, MA

    Google Scholar 

  • Dutoit AH, Bruegge B (1998) Communication metrics for software development. IEEE Trans Softw Eng 24(8):615–628 doi:10.1109/32.707697

    Article  Google Scholar 

  • Faraj S, Sproull L (2000) Coordinating expertise in software development teams. Manage Sci 46(12):1554–1568 doi:10.1287/mnsc.46.12.1554.12072

    Article  Google Scholar 

  • Farell MJ (1957) The measurement of productive efficiency. J R Stat Soc [Ser A] 120(3):250–290 doi:10.2307/2343100

    Google Scholar 

  • Fussel SR, Kraut RE, Lerch FJ, Scherlis WL, McNally MM, Cadiz JJ (1998) Coordination, overload and team performance: effects of team communication strategies. In: Proceedings CSCW 1998, pp 275–284, Seattle, Washington

  • Gopal A, Mukhopadhyay T, Krishnan MS (2002) The role of software processes and communication in offshore software development. Commun ACM 45(4):193–2000 doi:10.1145/505999.506008

    Article  Google Scholar 

  • Herbsleb JD, Grinter RE (1999) Architectures, coordination, and distance: Conway’s Law and beyond. IEEE Softw 16(5):63–70 doi:10.1109/52.795103

    Article  Google Scholar 

  • Hertel G, Niedner S, Hermann S (2003) Motivation of software developers in open source projects: an internet-based survey of contributors to the Linux kernel. Res Policy 32(7):1159–1177 doi:10.1016/S0048-7333(03)00047-7

    Article  Google Scholar 

  • Holck J, Jorgensen N (2004) Do not check in on red: control meets anarchy in two open source projects. In: Koch S (ed) Free/open source software development. Idea Group, Hershey, PA

    Google Scholar 

  • Howison J, Crowston K (2004). The perils and pitfalls of mining SourceForge. In: Proceedings of the International Workshop on Mining Software Repositories, pp 7–11, Edinburgh, Scotland

  • Hu Q (1997) Evaluating alternative software production functions. IEEE Trans Softw Eng 23(6):379–387 doi:10.1109/32.601078

    Article  Google Scholar 

  • Hunt F, Johnson P (2002) On the pareto distribution of sourceforge projects. Proceedings Open Source Software Development Workshop, pp 122–129, Newcastle, UK

  • Kitchenham B (2002) The question of scale economies in software—why cannot researchers agree? Inf Softw Technol 44(1):13–24 doi:10.1016/S0950-5849(01)00204-X

    Article  Google Scholar 

  • Kitchenham B, Mendes E (2004) Software productivity measurement using multiple size measures. IEEE Trans Softw Eng 30(12):1023–1035 doi:10.1109/TSE.2004.104

    Article  Google Scholar 

  • Koch S (2004) Profiling an open source project ecology and its programmers. Electron Mark 14(2):77–88 doi:10.1080/10196780410001675031

    Article  Google Scholar 

  • Koch S (2005) Effort modeling and programmer participation in open source software projects (Arbeitspapiere zum Tätigkeitsfeld Informationsverarbeitung, Informationswirtschaft und Prozessmanagement, Nr. 03/2005). Wirtschaftsuniversität Wien, Vienna, Austria

  • Koch S (2007) Software evolution in open source projects—a large-scale investigation. J Softw Maint Evol 19(6):361–382 doi:10.1002/smr.348

    Article  Google Scholar 

  • Koch S (2008) Measuring the efficiency of free and open source software projects using data envelopment analysis. In: Sowe SK, Stamelos I, Samoladas I (eds) Emerging free and open source software practices. IGI, Hershey, PA, pp 25–44

    Google Scholar 

  • Koch S, Neumann C (2008) Exploring the effects of process characteristics on product quality in open source software development. J Database Manage 19(2):31–57

    Google Scholar 

  • Koch S, Schneider G (2002) Effort, cooperation and coordination in an open source software project: gnome. Inf Syst J 12(1):27–42 doi:10.1046/j.1365-2575.2002.00110.x

    Article  Google Scholar 

  • Kraut RE, Streeter LA (1995) Coordination in software development. Commun ACM 38(3):69–81 doi:10.1145/203330.203345

    Article  Google Scholar 

  • Krishnan MS, Kriebel CH, Kekre S, Mukhopadhyay T (2000) An empirical analysis of productivity and quality in software products. Manage Sci 46(6):745–759 doi:10.1287/mnsc.46.6.745.11941

    Article  Google Scholar 

  • Laurent LS (2004) Understanding open source and free software licensing. O’Reilly & Associates: Cambridge, MA

    Google Scholar 

  • Leon A (2000) A Guide to software configuration management. Artech House, Norwood, MA

    MATH  Google Scholar 

  • Mayrhauser A, Wohlin C, Ohlsson M (2000) Assessing and understanding efficiency and success of software production. Empir Softw Eng 5(2):125–154 doi:10.1023/A:1009815306795

    Article  MATH  Google Scholar 

  • Michlmayr M (2005) Software process maturity and the success of free software projects. In: Zielinski K, Szmuc T (eds) Software engineering: evolution and emerging technologies. IOS, Amsterdam, The Netherlands, pp 3–14

    Google Scholar 

  • Mockus A, Fielding R, Herbsleb J (2002) Two case studies of open source software development: Apache and Mozilla. ACM Trans Softw Eng Methodol 11(3):309–346 doi:10.1145/567793.567795

    Article  Google Scholar 

  • Myrtveit I, Stensrud E (1999) Benchmarking COTS projects using data envelopment analysis. In: Proceedings of 6th International Software-Metrics-Symposium, pp 269–278, Boca-Raton, FL

  • Paulk MC, Curtis B, Chrissis MB, Weber CV (1993) Capability Maturity Model, Version 1.1. IEEE Softw 10(4):18–27 doi:10.1109/52.219617

    Article  Google Scholar 

  • Perens B (1999) The Open Source Definition. In: DiBona C et al (ed) Open sources: voices from the open source revolution. O’Reilly & Associates, Cambridge, MA

    Google Scholar 

  • Perry DE, Porter AA, Votta LG (2000) Empirical studies of software engineering: a roadmap. In: Finkelstein A (ed) The future of software engineering. ACM, New York

    Google Scholar 

  • R Development Core Team (2008) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria

    Google Scholar 

  • Raymond ES (1999) The Cathedral and the Bazaar. O’Reilly & Associates, Cambridge, MA

    Google Scholar 

  • Reel JS (1999) Critical success factors in software projects. IEEE Softw 16(3):18–23 doi:10.1109/52.765782

    Article  Google Scholar 

  • Robbins J (2005) Adopting Open Source Software Engineering (OSSE) practices by adopting OSSE tools. In: Feller J, Fitzgerald B, Hissam SA, Lakhani KR (eds) Perspectives on free and open source software. MIT, Cambridge, MA

    Google Scholar 

  • Rosen L (2004) Open source licensing: software freedom and intellectual property law. Prentice Hall, Englewood Cliffs, NJ

    Google Scholar 

  • Rusovan S, Lawford M, Parnas DL (2005) Open source software development: future or fad? In: Feller J, Fitzgerald B, Hissam SA, Lakhani KR (eds) Perspectives on free and open source software. MIT, Cambridge, MA

    Google Scholar 

  • Scacchi W, Feller J, Fitzgerald B, Hissam S, Lakhani K (2006) Understanding free/open source software development processes. Softw Process Improv Pract 11(2):95–105 doi:10.1002/spip.255

    Article  Google Scholar 

  • Stallman RM (2002) Free software, free society: selected essays of Richard M. Stallman. GNU, Boston, MA

    Google Scholar 

  • Stewart KJ (2004) OSS project success: from internal dynamics to external impact. In Collaboration, Conflict and Control: The 4th workshop on Open Source Software Engineering (ICSE 2004), Edinburgh, Scotland

  • Stewart KJ, Gosain S (2006) The moderating role of development stage in affecting free/open source software project performance. Softw Process Improv Pract 11(2):177–191 doi:10.1002/spip.258

    Article  Google Scholar 

  • Stewart KJ, Ammeter AP, Maruping LM (2006) Impacts of licence choice and organisational sponsorship on user interest and development activity in open source software projects. Inf Syst Res 17(2):126–144 doi:10.1287/isre.1060.0082

    Article  Google Scholar 

  • Varian HR (2005) Intermediate microeconomics: a modern approach, 2nd edn. W. W. Norton, New York, NY

    Google Scholar 

  • Weiss D (2005) Measuring success of open source projects using web search engines. In: Proceedings of the 1st International Conference on Open Source Systems, Genoa, Italy, pp 93–99

Download references

Author information

Authors and Affiliations

  1. Institute for Information Business, Vienna University of Economics and BA, Augasse 2-6, 1090, Vienna, Austria

    Stefan Koch

Authors
  1. Stefan Koch
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stefan Koch.

Additional information

Editor: Sandro Morasca

Rights and permissions

Reprints and permissions

About this article

Cite this article

Koch, S. Exploring the effects of SourceForge.net coordination and communication tools on the efficiency of open source projects using data envelopment analysis. Empir Software Eng 14, 397–417 (2009). https://doi.org/10.1007/s10664-008-9086-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10664-008-9086-4

Keywords

Search

Navigation