skip to main content
10.1145/3422392.3422410acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

How software organizations are using the ISO/IEC 29110 standard's processes: a survey of the state of the art and practice

Authors Info & Claims
Published:21 December 2020Publication History

ABSTRACT

ISO/IEC 29110 was developed containing a set of industrially validated practices that can potentially be adopted by software Very Small Entities (VSE). VSEs usually have characteristics that differentiate them from organizations of different sizes, such as extremely limited resources and informal project management processes, tending to adopt Agile methods and having an historical resistance to the adoption of standards, that are in general developed for large organizations. In this sense, our research question arises: "How are software organizations using the ISO/IEC 29110 practices?". To answer this question, a Systematic Mapping Study (SM), and a Survey with software organizations were carried out in order to identify the state of the art and the state of the practice in relation to the use of the standard's practices. The SM identified 21 primary studies reporting the use of the standard in hundreds of software organizations with positive results such as organizational learning, process improvement, improved communication, and also some negative results, such as deployment difficulties in technical areas and the need for additional time and resources. The Survey carried out with 23 software companies identified that, in general, companies do not explicitly know the content of the standard, but partially carry out, in accordance with the standard, practices related to planning, monitoring, control and execution of a project plan, and do not carry out requirements analysis or architecture and detailed design as defined in the standard.

References

  1. International Organization for Standardization, 2016. ISO/IEC TR 29110-1:2016 Systems and software engineering -- Lifecycle profiles for Very Small Entities (VSEs) -- Part 1: Overview (ISO Standard No. 29110-1:2016).Google ScholarGoogle Scholar
  2. ABES - Associação Brasileira das Empresas de Software, 2019. Brazilian Software Market: scenario and trends 2019 (1st ed.) - São PauloGoogle ScholarGoogle Scholar
  3. X. Larrucea, R. V. O' Connor, R. C. Palacios and C. Y. Laporte. 2016. Software Process Improvement in Very Small Organization. In IEEE Computer Society, 33, 2, 85--89. DOI: https://doi.org/10.1109/ms.2016.42Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. V. Siddoo, N. Wongsai and R. Wetprasit. 2013. An Implementation Approach of ISO/IEC 29110 for Government Organizations. In Proceeding of the 1st Annual PSU Phuket International Conference. Available at: http://www.conference.phuket.psu.ac.th/conference2012/proceedings/pdf/o_SCI14.pdfGoogle ScholarGoogle Scholar
  5. N. Paternoster, C. Giardino, M. Unterkalmsteiner, T. Gorschek, & P. Abrahamsson. 2014. Software development in startup companies: A systematic mapping study. Information and Software Technology, 56, 10, 1200--1218. DOI: https://doi.org/10.1016/j.infsof.2014.04.014Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. R. O' Connor, C. Y. Laporte. 2012. Software project management in very small entities with ISO/IEC 29110. In EuroSPI 2012: Systems, Software and Services Process Improvement Springer, 330--341, Springer Berlin Heidelberg. DOI: https://doi.org/10.1007/978-3-642-31199-4_29Google ScholarGoogle ScholarCross RefCross Ref
  7. M. Muñoz, A. Peña, J. Mejia, G. P. Gasca-Hurtado, M. C. Gómez-Alvarez & C. Y. Laporte. 2019. A comparative analysis of the implementation of the Software Basic profile of ISO/IEC 29110 in thirteen teams that used predictive versus adaptive life cycles. In European Conference on Software Process Improvement. Springer, 179--191. DOI:https://doi.org/10.1049/iet-sen.2019.0040Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. N. Tremblay, C. Y. Laporte, D. Poliquin & J. Menaceur. 2019. Implementing systems engineering and project management processes in a Canadian company - Overview and Results Achieved. In INCOSE International Symposium. Wiley, 1105--129. DOI: https://doi.org/10.1002/j.2334-5837.2019.00592.xGoogle ScholarGoogle ScholarCross RefCross Ref
  9. M. Muñoz, J. Mejia, & C. Y. Laporte. 2020. Implementing ISO/IEC 29110 to reinforce four very small entities of Mexico under an agile approach. IET Software, 14, 2, 75--81. DOI: https://doi.org/10.1049/iet-sen.2019.0040Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. R. O' Connor, C. Y. Laporte. 2010. Towards the Provision of Assistance for Very SmallEntities in Deploying Software Lifecycle Standards. In: 11th International Conference on Product Focused Software Development and Process Improvement. Limerick, Ireland, ACM, 4-7 DOI: https://doi.org/10.1145/1961258.1961259Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. R. O' Connor, C. Y. Laporte. 2011. Using ISO/IEC 29110 to Harness Process Improvement in Very Small Entities, In: Workshop on SPI in SMIEs, 18th European Software Process Improvement Conference. Springer-Verlag, CCIS 172, 225--235. DOI: https://doi.org/10.1007/978-3-642-22206-1_20Google ScholarGoogle ScholarCross RefCross Ref
  12. C. Y. Laporte, S. Alexandre, R. O' Connor. 2008. A Software Engineering Lifecycle Standard for Very Small Enterprises. In: Proceedings of EuroSPI. CCIS, Springer, 16, 129- 141. DOI: https://doi.org/10.1007/978 -3-540-85936-9_12Google ScholarGoogle ScholarCross RefCross Ref
  13. E. Mkpojiogu, N. L. Hashim, A. Al-Sakkaf & A. Hussain. 2019. Software startups: Motivations for Agile Adoption. Int. Journal Innovative Technology Exploring Eng., 8, 8, 454--459. Available at: https://www.ijitee.org/wp-content/uploads/papers/v8i8s/H10780688S19.pdfGoogle ScholarGoogle Scholar
  14. M. Kuhrmann & J. Müench. 2019. SPI is Dead, isn't it? Clear the Stage for Continuous Learning! In 2019 IEEE/ACM International Conference on Software and System Processes (ICSSP). IEEE, 9--13. DOI: https://doi.org/10.1109/icssp.2019.00012Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Munoz, J. Mejia, & A. Lagunas. 2018. Implementation of the ISO/IEC 29110 standard in agile environments: A systematic literature review. In 13th Iberian Conference on Information Systems and Technologies (CISTI), 1--6. DOI: https://doi.org/10.23919/cisti.2018.8399332Google ScholarGoogle ScholarCross RefCross Ref
  16. K. Petersen, S. Vakkalanka & L. Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology, 64, 1--18. DOI: https://doi.org/10.1016/j.infsof.2015.03.007Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. A. Pinsonneault & K. Kraemer. 1993. Survey research methodology in management information systems: an assessment. Journal of management information systems, 10, 2, 75--105. DOI: https://doi.org/10.1080/07421222.1993.11518001Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. International Organization for Standardization. 2020. Publicly Available Standards. Available at: https://standards.iso.org/ittf/PubliclyAvailableStandards/index.html.Google ScholarGoogle Scholar
  19. International Organization for Standardization. 2012. Software engineering -- Lifecycle profiles for Very Small Entities (VSEs) - Part 5-1-2: Management and engineering guide: Generic profile group: Basic profile (ISO Standard No. 29110-5-1-2:2012).Google ScholarGoogle Scholar
  20. G. Coleman & R. O'Connor. 2008. Investigating Software Process in Practice: A Grounded Theory Perspective. Journal of Systems and Software, 81, 5, 772--784. DOI: https://doi.org/10.1016/j.jss.2007.07.027Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. E. M. Campos, M. L. S. Gordón, R. C. Palacios, & A. M. Seco. 2014. Towards Measuring the Impact of the ISO/IEC 29110 Standard: A Systematic Review. In EuroSPI 2014, 1--12. DOI: https://doi.org/10.1007/978-3-662-43896-1_1Google ScholarGoogle ScholarCross RefCross Ref
  22. N. Wongsai, V. Siddoo & R. Wetprasit. 2015. Factors of Influence in Software Process Improvement: An ISO/IEC 29110 for Very-Small Entities. In 7th ICITEE, Chiang Mai, Thailand. DOI: https://doi.org/10.1109/iciteed.2015.7408904Google ScholarGoogle ScholarCross RefCross Ref
  23. L. Castillo-Salinas, S. Sanchez-Gordon, J. Villarroel-Ramos & M. Sánchez-Gordón. 2020. Evaluation of the implementation of a subset of ISO/IEC 29110 Software Implementation process in four teams of undergraduate students of Ecuador. An empirical software engineering experiment. Computer Standards & Interfaces, 70. DOI: https://doi.org/10.1016/j.csi.2020.103430Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. M. Muñoz, A. Peña, J. Mejia, G. P. Gasca-Hurtado, M. C. Gómez-Alvarez, & C. Y. Laporte. 2019. A comparative analysis of the implementation of the Software Basic profile of ISO/IEC 29110 in thirteen teams that used predictive versus adaptive life cycles. In European Conference on Software Process Improvement. Springer, 179--191. DOI: https://doi.org/10.1007/978-3-030-28005-5_14Google ScholarGoogle ScholarCross RefCross Ref
  25. M. Muñoz, M. Peralta & C. Y. Laporte. 2019. Análisis de las debilidades que presentan las Entidades Muy Pequeñas al implementar el estándar ISO/IEC 29110: Una comparativa entre estado del arte y el estado de la práctica. RISTI-Revista Ibérica de Sistemas e Tecnologias de Informação, 34, 85--96. DOI: https://doi.org/10.17013/risti.34.85-96Google ScholarGoogle ScholarCross RefCross Ref
  26. D. Mishra & A. Mishra. 2008. Software process improvement methodologies for small and medium enterprises. In International Conference on Product Focused Software Process Improvement. Springer 273--288. DOI: https://doi.org/10.1007/978-3-540-69566-0_23Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. G. C. da Silva & G. de Figueiredo Carneiro. 2016. Software process improvement in small and medium enterprises: A systematic literature review. In Information Technology: New Generations. Springer 603--613. DOI: https://doi.org/10.1007/978-3-319-32467-8_53Google ScholarGoogle ScholarCross RefCross Ref
  28. J. S. Molléri, K. Petersen & E. Mendes. 2020. An empirically evaluated checklist for surveys in software engineering. Information and Software Technology, 119. DOI: https://doi.org/10.1016/j.infsof.2019.106240Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. S. da Silva Leal & J. C. R. Hauck. 2019. Como as organizações de software tem utilizado a Norma ISO/IEC 29110: Um Mapeamento Sistemático. In Computer on the Beach, 639--648. Available at: https://siaiap32.univali.br/seer/index.php/acotb/article/view/14361Google ScholarGoogle Scholar
  30. B. A. Kitchenham. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. EBSE Technical Report, version 2.3, Keele University.Google ScholarGoogle Scholar
  31. C. Wohlin. 2014. Guidelines for Snowballing in Systematic Literature Studies and a Replication in Software Engineering. In 18th International Conference on Evaluation and Assessment in Software Engineering. ACM, DOI: https://doi.org/10.1145/2601248.2601268Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. J. Popay, H. Roberts, A. Sowden, M. Petticrew, L. Arai, M. Rodgers, N. Britten, K. Roen & S. Duffy. 2006. Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme. Lancaster Univ. DOI: https://doi.org/10.13140/2.1.1018.4643Google ScholarGoogle ScholarCross RefCross Ref
  33. I. Bickman & D. J. Rog. 1997. Handbook of applied social research methods. Thousand Oaks, Sage.Google ScholarGoogle Scholar
  34. ACATE - Associação Catarinense das Empresas de Tecnologia. 2018. Observatório ACATE: Panorama do Setor de Tecnologia de Santa Catarina 2018 (1st. ed.). ACATE, Florianópolis.Google ScholarGoogle Scholar
  35. Y. Baruch. 1999. Response rate in academic studies-A comparative analysis. Human relations, 52, 4, 421 -438. DOI: https://doi.org/10.1177/001872679905200401Google ScholarGoogle ScholarCross RefCross Ref
  36. J. M. Cortina. 1993. What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 1, 98. DOI: https://doi.org/10.1037/0021-9010.78.1.98Google ScholarGoogle ScholarCross RefCross Ref
  37. SEBRAE - Serviço Brasileiro de Apoio às Micro e Pequenas Empresas. 2013. Normas e Certificções em Software - qual serve melhor para mim? ISO/IEC 29110 / ISO 9000 / CMMI / MPS-BR (1st. ed.) SEBRAE, Brasília.Google ScholarGoogle Scholar
  38. D. A. Walker. 2016. Confidence intervals for Kendall's tau with small samples. Journal of Modern Applied Statistical Methods, 15, 1, 868--883. DOI: https://doi.org/10.22237/jmasm/1462077840Google ScholarGoogle ScholarCross RefCross Ref
  39. R. K. Som. 1995. Practical sampling techniques (2nd ed.). CRC Press.Google ScholarGoogle Scholar
  40. ACATE - Associação Catarinense das Empresas de Tecnologia. ACATE Tech Report 2015: Panorama de Inovação e Tecnologia de SC. (1st. ed.). ACATE, Florianópolis.Google ScholarGoogle Scholar
  41. E. Mourão, J. F. Pimentel, M. L. Kalinowski, E. Mendes and C. Wohlin. 2020. On the performance of hybrid search strategies for systematic literature reviews in software engineering. Information and Software Technology, 106294. DOI: https://doi.org/10.1016/j.infsof.2020.106294Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. How software organizations are using the ISO/IEC 29110 standard's processes: a survey of the state of the art and practice
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            SBES '20: Proceedings of the XXXIV Brazilian Symposium on Software Engineering
            October 2020
            901 pages
            ISBN:9781450387538
            DOI:10.1145/3422392

            Copyright © 2020 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 21 December 2020

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited

            Acceptance Rates

            Overall Acceptance Rate147of427submissions,34%

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader