The impact of tailoring criteria on agile practices adoption: A survey with novice agile practitioners in Brazil

https://doi.org/10.1016/j.jss.2017.12.012Get rights and content

Highlights

  • Tailoring criteria have a relevant impact on the adoption of agile practices.

  • Main criteria are external environment, previous knowledge and internal environment.

  • Organizations adopt agile practices to fit their context, culture and objectives.

  • Organizations adopt hybrid or custom software methods to meet their needs.

  • Novice practitioners in Brazil start using traditional software development practices.

Abstract

The software development industry adopts agile methods in different ways by considering contextual requirements. To fulfill organizational needs, adoption strategies consider agile methods tailoring. However, tailoring according to the context of the organization remains a problem to be solved. Literature on criteria for adopting software development methods exists, but not specifically for agile methods. Given this scenario, the following research question arises: what is the impact of software method tailoring criteria on the adoption of agile practices? To answer this question, we conducted a survey among agile practitioners in Brazil to gather data about importance of the tailoring criteria and agile practices adopted. A model for agile practices adoption based on the tailoring criteria is proposed using the results of the survey with a majority of novice agile practitioners. The proposed model was validated using PLS-SEM (partial least squares structural equation modeling) and the survey data. Results show that adoption of agile practices was influenced by criteria such as external environment, previous knowledge and internal environment. Results also indicate that organizations tend to use hybrid/custom software methods and select agile practices according to their needs.

Introduction

Agile methods and practices have been widely adopted by the software development industry (Qumer, Henderson-Sellers, September 11–14, 2006, Deemer, Benefield, Larman, Vodde, Nishijima, Dos Santos, 2013, VersionOne). However, adoption strategies can vary, from full adoption at once to iterative and incremental approaches (Nerur, Mahapatra, Mangalaraj, 2005, Soundararajan, Balci, Arthur, August 5–9, 2013, Rohunen, Rodriguez, Kuvaja, Krzanik, Markkula, 2010). Organizations use agile practices adoption and practice selection to generate tailored software development methods consistent with their values, culture, reality, needs and strategies (Ahmed, Sidky, 24–28 August 2009, Abbas, Gravell, Wills, August 9–13, 2010, Esfahani, Yu, Annosi, June 22–24, 2011, Kurapati, Manyam, Petersen, May 21–25, 2012, Madi, Dahalin, Baharom, 2011, Qumer, Henderson-Sellers, 2008, Rohunen, Rodriguez, Kuvaja, Krzanik, Markkula, 2010, Lpez-Martnez, Jurez-Ramrez, Huertas, Jimnez, Guerra-Garca, 2016). Software method tailoring research provides ways to tailor the software method and adapt it to the context to which it is being applied (Fitzgerald et al., 2000). Likewise, that research defines tailoring criteria to guide the tailoring process, regardless of the type of method adopted (Kalus and Kuhrmann, 2013). The association of agile practices adoption with software method tailoring criteria raises the research question: what is the impact of software method tailoring criteria on the adoption of agile practices?1

Not all organizations are ready to fully implement agile, when considering cultural and technical aspects (Qumer, Henderson-Sellers, 2008, Lpez-Martnez, Jurez-Ramrez, Huertas, Jimnez, Guerra-Garca, 2016, Hoda, Noble, 2017). These types of changes demand a considerable financial investment and have a big impact on the daily tasks performed by the teams. Instead, the adoption could be partial, keeping in place practices currently used by the organization, combining them with a new set of agile practices, to enable the organization to achieve its goals.

There is no standard on how agile practices fit into the organizational context (Rohunen et al., 2010). Agile practices adoption can be unique, as each organization takes into account the specific needs of each area of the development process. Often, organizations need help choosing the right combination of agile practices for their needs. This makes the usage of the tailoring criteria important, as it provides a possible solution for the agile practices adoption problem. The tailoring criteria, having already been defined in the literature (Kalus and Kuhrmann, 2013), can create a standard for guiding the selection of agile practices by establishing the importance of certain aspects of the organizational context.

The approaches we found in the literature for agile practices adoption generally focus on reporting previous practical experiences, or proposing new techniques for selecting such practices. The objective of this research is to understand the impact of tailoring criteria on the adoption or selection of agile practices. In our approach, we developed a model for the adoption of agile practices based on software method tailoring criteria defined by Kalus and Kuhrmann (2013) to analyze the impact of tailoring criteria on agile practices adoption. Multivariate statistical analysis techniques allowed the model to be created and validated. In the proposed model, tailoring criteria and agile practices have been represented using PLS-SEM (partial least squares structural equation modeling) (Hair Jr, Hult, Ringle, Sarstedt, 2013, Wong, 2013). We conducted a survey among novice agile practitioners in Brazil and gathered the data among agile practitioners to feed and validate the model. We used the SmartPLS 3.0 tool (Ringle et al., 2015) to validate the model and results show that three out of six tailoring criteria have a relevant impact on the adoption of agile practices.

The remainder of the paper is organized as follows. Section 2 provides technical background while Section 3 presents the related work. Section 4 discusses the research methodology, data gathering and analysis procedures. The results of the study are presented in Section 5, and the findings are discussed in Section 6. The conclusions and future work opportunities are outlined in Section 7.

Section snippets

Background

This section provides background on software method tailoring, the need to execute software method tailoring and describes the method tailoring criteria used in this paper.

Related work

The research work on agile methods tailoring addresses different types of needs and approaches for tailoring. It includes papers listing the most used practices (Kurapati, Manyam, Petersen, May 21–25, 2012, Jalali, Wohlin, 23–26 August, 2010, Manyam, Kurapati, 2012), proposing methods for agile practices adoption based on multiple criteria (Esfahani, Yu, Annosi, June 22–24, 2011, Saleh, 2013), comparing agile practices and quality levels (Abbas et al., 2010), and assessing the agile methods and

Research

The intention of the research was to understand the impacts of tailoring criteria on the adoption of agile practices. To fulfill this objective, we first gathered data from a population of agile practitioners, then correlated it, to draw conclusions. This was an exploratory research, as we did not have clear previous knowledge and could not find any empirical data in the literature about the relationships of the constructs used in this study (Hair et al., 2013).

Results

We used the data from the survey, applied it to validate and adapt the model to then get to the results. The validation and adaptation processes are iterative and incremental and lead to a predictive model based on the data set provided.

In the validation process, we applied the guidelines proposed by Hair et al. (2011); 2013) and (Wong, 2013) and for modeling and evaluation, we chose the SmartPLS 3.0 tool (Ringle et al., 2015). We used the SmartPLS tool multiple times to draw the model and

Discussion

Results are discussed in 2 fronts: impact of tailoring criteria and adoption of agile practices. Section 6.1 shows the effect of each of the tailoring criteria on the adoption process while Section 6.2 shows the most adopted practices for the sample of this research and provides insights into results patterns compared to the literature.

Conclusions

The objective of this research was to understand the impact of software method tailoring criteria on the adoption or selection of agile practices. To achieve this objective, we proposed a model to represent the tailoring criteria and practices, and validated this model with data from a survey between agile practitioners in the city of Belo Horizonte, Brazil. The model was validated using the PLS-SEM technique to represent the most relevant tailoring criteria for the adoption of agile practices

Amadeu Silveira Campanelli is a PhD student at FUMEC University, Brazil. His research is in software engineering with focus on agile methods. Received a master's degree in Information Systems and Knowledge Management at FUMEC University in 2015. He works as a software architect at HNI Corporation.

References (58)

  • S. de Cesare et al.

    Tailoring software development methodologies in practice: a case study

    Comput. Inf. Technol.

    (2008)
  • ChinW.W.

    The partial least squares approach to structural equation modeling

    Modern Methods Business Res.

    (1998)
  • Cohen, J., 1988. Statistical Power Analysis for the Behavioral Sciences. second edn. Hillsdale, New...
  • K. Conboy et al.

    Method and developer characteristics for effective agile method tailoring: a study of XP expert opinion

    ACM Trans. Softw. Eng. Methodol.

    (2010)
  • Deemer, P., Benefield, G., Larman, C., Vodde, B., 2010. The scrum primer....
  • P. Diebold et al.

    Agile practices in practice: a mapping study

    Proceedings of the Eighteenth International Conference on Evaluation and Assessment in Software Engineering, EASE ’14

    (2014)
  • M. Doyle et al.

    Agile software development in practice

    Proceedings of the Fifteenth International Conference on Agile Processes in Software Engineering and Extreme Programming, XP 2014

    (2014)
  • H.C. Esfahani et al.

    Capitalizing on empirical evidence during agile adoption

    Proceedings of the 2010 Agile Conference, AGILE 2010

    (2010)
  • H.C. Esfahani et al.

    Towards the strategic analysis of agile practices

    Proceedings of the CAiSE Forum 2011

    (2011)
  • F. Faul et al.

    Statistical power analyses using G*power 3.1: tests for correlation and regression analyses

    Behav Res. Methods

    (2009)
  • B. Fitzgerald et al.

    An empirical study of system development method tailoring in practice

    Proceedings of the Eightth European Conference on Information Systems, Trends in Information and Communication Systems for the 21st Century, ECIS 2000

    (2000)
  • B. Fitzgerald et al.

    Software development method tailoring at motorola

    Commun. ACM

    (2003)
  • J.F. Hair et al.

    PLS-SEM: indeed a silver bullet

    J. Market. Theory Pract.

    (2011)
  • J.F. Hair Jr et al.

    A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM)

    (2013)
  • B. Henderson-Sellers et al.

    Situational method engineering: state-of-the-art review

    J. Univ. Comput. Sci.

    (2010)
  • J. Henseler et al.

    Using PLS path modeling in new technology research: updated guidelines

    Indust. Manag. Data Syst.

    (2016)
  • R. Hoda et al.

    Becoming agile: A grounded theory of agile transitions in practice

    Proceedings of the Thirty-ninth International Conference on Software Engineering

    (2017)
  • E. Hossain et al.

    Towards an understanding of tailoring scrum in global software development: a multi-case study

    Proceedings of the International Conference on Software and Systems Process, ICSSP 2011

    (2011,)
  • S. Jalali et al.

    Agile practices in global software engineering – a systematic map

    Proceedings of the Fifth IEEE International Conference on Global Software Engineering, ICGSE 2010

    (2010)
  • Cited by (32)

    • Becoming agile together: Customer influence on agile adoption within commissioned software teams

      2022, Information and Management
      Citation Excerpt :

      Moreover, agile adoption requires a commissioned software team to transition from fixed to agile development planning [15]. Fixed planning routines do not enable the flexibility required for self-organization, without which the software team will likely fail to transition from managed to self-organized teamwork practices [8, 9, 16, 24]. These transitions require a collaborative and self-organized customer as planning iterations become more frequent [17, 20].

    • Scrum versus Rational Unified Process in facing the main challenges of product configuration systems development

      2020, Journal of Systems and Software
      Citation Excerpt :

      Various studies have focused on the two methods’ pros and cons in general software development projects (Cho, 2009; Larman, 2004; Noordeloos et al., 2012; Usman et al., 2014). Other studies have investigated the tailoring/adaptation of agile methods (Campanelli et al., 2018; Campanelli and Parreiras, 2015), and others agile methods’ challenges (Drury-Grogan et al., 2017) in general software development projects. However, the authors cannot guess how applicable the results of these studies are to PCS projects due to the numerous differences between PCS projects and other software development projects.

    • Requirements for adopting software process lines

      2020, Journal of Systems and Software
      Citation Excerpt :

      Some of the papers focused directly on tailoring a specific methodology type; for example, in (Fitzgerald et al., 2006), customization of XP and Scrum methodologies with software practices is discussed. However, some of the papers concentrate on tailoring agile methodologies in general (e.g., Campanelli and Parreiras, 2015; Campanelli et al., 2018) and do not mention any specific methodology. Some of the papers first propose an approach for method tailoring and then evaluate it by applying the approach on a specific methodology.

    • The effect of transactive memory systems on process tailoring in software projects: The moderating role of task conflict and shared temporal cognitions

      2020, Journal of Systems and Software
      Citation Excerpt :

      However, faced with the volatile nature of software development, software teams need to alter and adapt their process to fit projects’ particularities and dynamic environment (Fitzgerald et al., 2003). The activity of customizing standard software development processes to meet projects’ needs is called software process tailoring (SPT) (Ginsberg and Quinn, 1995; Fitzgerald et al., 2003; Xu and Ramesh 2007, 2008; Tripp et al., 2018; Campanelli et al., 2018). SPT plays a critical role in contemporary software development environments, including sequential (e.g., waterfall) or iterative (e.g., agile) development modes when deviation from the standard or planned process occurs (Xu and Ramesh 2007; Park and Bae, 2013; Conboy and Fitzgerald, 2010; Bass, 2016; Campanelli et al., 2018).

    View all citing articles on Scopus

    Amadeu Silveira Campanelli is a PhD student at FUMEC University, Brazil. His research is in software engineering with focus on agile methods. Received a master's degree in Information Systems and Knowledge Management at FUMEC University in 2015. He works as a software architect at HNI Corporation.

    Ronaldo Darwich Camilo is a professor at FUMEC University, Brazil. Received a PhD in metallurgical engineering from UFMG, Brazil. Prior to joining the FUMEC University, held positions as professor at CEFET-MG, Brazil.

    Fernando Silva Parreiras is a professor at FUMEC University, Brazil, leading the Laboratory of Advanced Information Systems (LAIS). His research involves technology for Semantic Web (OWL ontology, reasoning) and model driven development (MDE, UML, metamodel, model design). Received a PhD in Computer Science from the University of Koblenz Landau, Germany, summa cum laude, supervised by Prof. Steffen Staab. He was the lead developer of a tool for Model Driven Semantic Web and Semantic Web Enabled Software Engineering -- the TwoUse Toolkit. Prior to joining the FUMEC University, held positions as researcher and project leader at the University of Koblenz Landau.

    View full text