Abstract
A systematic literature review (SLR) is an empirical method used to provide an overview of existing knowledge and to aggregate evidence within a domain. For computer science, several threats to the completeness of such reviews have been identified, leading to recommendations and guidelines on how to improve their quality. However, few studies address to what extent researchers can replicate an SLR. To conduct a replication, researchers have to first understand how the set of primary studies has been identified in the original study, and can ideally retrieve the same set when following the reported protocol. In this article, we focus on this initial step of a replication and report a two-fold empirical study: Initially, we performed a tertiary study using a sample of SLRs in computer science and identified what information that is needed to replicate the searches is reported. Based on the results, we conducted a descriptive, multi-case study on digital libraries to investigate to what extent these allow replications. The results reveal two threats to replications of SLRs: First, while researchers have improved the quality of their reports, relevant details are still missing—we refer to a reporting threat. Second, we found that some digital libraries are inconsistent in their query results—we refer to a searching threat. While researchers conducting a review can only overcome the first threat and the second may not be an issue for all kinds of replications, researchers should be aware of both threats when conducting, reviewing, and building on SLRs.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abdelmaboud A, Jawawi D N, Ghani I, Elsafi A (2015) A comparative evaluation of cloud migration optimization approaches: a systematic literature review. J Theor Appl Inf Technol 79(3):395–414
Afzal W, Alone S, Glocksien K, Torkar R (2016) Software test process improvement approaches: a systematic literature review and an industrial case study. J Syst Softw 111:1–33. https://doi.org/10.1016/j.jss.2015.08.048
Babar MA, Zhang H (2009) Systematic Literature Reviews in Software Engineering: Preliminary Results from Interviews with Researchers. In: International Symposium on Empirical Software Engineering and Measurement. IEEE, pp 346–355. https://doi.org/10.1109/ESEM.2009.5314235
Badampudi D, Wohlin C, Petersen K (2015) Experiences from Using Snowballing and Database Searches in Systematic Literature Studies. In: International Conference on Evaluation and Assessment in Software Engineering. ACM, pp 17:1–17:10. https://doi.org/10.1145/2745802.2745818
Bailey J, Zhang C, Budgen D, Turner M, Charters S (2007) Search Engine Overlaps: Do They Agree or Disagree? In: International Workshop on Realising Evidence-Based Software Engineering. IEEE, pp 2–2. https://doi.org/10.1109/REBSE.2007.4
Bandara W, Miskon S, Fielt E (2011) A systematic Tool-Supported method for conducting literature reviews in information systems. In: European Conference on Information Systems
Biolchini J, Mian PG, Natali ACC, Travassos GH (2005) Systematic Review in Software Engineering. Technical Report. RT - ES 679 / 05, Federal University of Rio de Janeiro
Boell S K, Cecez-Kecmanovic D (2015) Debating Systematic Literature Reviews (SLR) and their Ramifications for IS: A Rejoinder to Mike Chiasson, Briony Oates, Ulrike Schultze, and Richard Watson. J Inf Technol 30(2):188–193. https://doi.org/10.1057/jit.2015.15
Booth A, Sutton A, Papaioannou D (2012) Systematic Approaches to a Successful Literature Review. Sage, Newbury Park
Brereton O P, Kitchenham B A, Budgen D, Turner M, Khalil M (2007) Lessons from applying the systematic literature review process within the software engineering domain. J Syst Softw 80(4):571–583. https://doi.org/10.1016/j.jss.2006.07.009
Budgen D, Brereton OP (2006) Performing Systematic Literature Reviews in Software Engineering. In: International Conference on Software Engineering. ACM, pp 1051–1052. https://doi.org/10.1145/1134285.1134500
Budgen D, Brereton O P, Drummond S, Williams N (2018a) Reporting systematic reviews: Some lessons from a tertiary study. Inf Softw Technol 95:62–74. https://doi.org/10.1016/j.infsof.2017.10.017
Budgen D, Brereton O P, Williams N, Drummond S (2018b) The Contribution that Empirical Studies Performed in Industry make to the Findings of Systematic Reviews: A Tertiary Study. Inf Softw Technol 94:234–244. https://doi.org/10.1016/j.infsof.2017.10.012
Carver J C (2010) Towards reporting guidelines for experimental replications: a proposal. In: International Workshop on Replication in Empirical Software Engineering
Collins J A, Fauser B C (2005) Balancing the strengths of systematic and narrative reviews. Hum Reprod Update 11(2):103–104. https://doi.org/10.1093/humupd/dmh058
da Silva F Q, Santos A L, Soares S, França A C C, Monteiro C V, Maciel F F (2011) Six years of systematic literature reviews in software engineering: an updated tertiary study. Inf Softw Technol 53(9):899–913. https://doi.org/10.1016/j.infsof.2011.04.004
Dresch A, Lacerda D P, Antunes JAV Jr (2014) Design Science Research: A Method for Science and Technology Advancement. Springer, Berlin. https://doi.org/10.1007/978-3-319-07374-3
Dybå T, Dingsøyr T (2008) Strength of Evidence in Systematic Reviews in Software Engineering. In: International Symposium on Empirical Software Engineering and Measurement. ACM, pp 178–187, https://doi.org/10.1145/1414004.1414034
Dybå T, Kitchenham BA, Jørgensen M (2005) Evidence-Based Software engineering for practitioners. IEEE Softw 22(1):58–65. https://doi.org/10.1109/MS.2005.6
Dybå T, Dingsøyr T, Hanssen GK (2007) Applying Systematic Reviews to Diverse Study Types: An Experience Report. In: International Symposium on Empirical Software Engineering and Measurement. IEEE, pp 225–234, https://doi.org/10.1109/ESEM.2007.59
Falagas M E, Pitsouni E I, Malietzis G A, Pappas G (2008) Comparison of PubMed, Scopus, Web of Science, and Google Scholar: Strengths and Weaknesses. FASEB J 22(2):338–342. https://doi.org/10.1096/fj.07-9492LSF
Felizardo KR, Mendes E, Kalinowski M, Souza EF, Vijaykumar NL (2016) Using Forward Snowballing to Update Systematic Reviews in Software Engineering. In: International Symposium on Empirical Software Engineering and Measurement. ACM, pp 53:1–53:6. https://doi.org/10.1145/2961111.2962630
Fuhr N, Tsakonas G, Aalberg T, Agosti M, Hansen P, Kapidakis S, Klas C P, Kovács L, Landoni M, Micsik A, Papatheodorou C, Peters C, Sølvberg I (2007) Evaluation of Digital Libraries. Int J Digit Libr 8(1):21–38. https://doi.org/10.1007/s00799-007-0011-z
Galvan J L, Galvan MC (2016) Writing Literature Reviews: A Guide for Students of the Social and Behavioral Sciences. Routledge, Evanston
Giles CL (2006) The Future of Citeseer: CiteseerX. In: European Conference on Principle and Practice of Knowledge Discovery in Databases. Springer, pp 2–2, https://doi.org/10.1007/11871637_2
Gómez O S, Juristo N, Vegas S (2014) Understanding replication of experiments in software engineering: a classification. Inf Softw Technol 56(8):1033–1048
Harzing A W, Alakangas S (2017) Microsoft Academic: Is the Phoenix Getting Wings?. Scientometrics 110(1):371–383. https://doi.org/10.1007/s11192-016-2185-x
Hassler E, Carver J C, Hale D, Al-Zubidy A (2016) Identification of SLR tool needs – results of a community workshop. Inf Softw Technol 70:122–129. https://doi.org/10.1016/j.infsof.2015.10.011
Ilyas M, Khan S U (2015) Software integration in global software development: Success factors for GSD vendors. In: International conference on software engineering, artificial intelligence, Networking and Parallel/Distributed Computing. IEEE, pp 1–6. https://doi.org/10.1109/SNPD.2015.7176187
Imtiaz S, Bano M, Ikram N, Niazi M (2013) A Tertiary Study: Experiences of Conducting Systematic Literature Reviews in Software Engineering. In: International Conference on Evaluation and Assessment in Software Engineering. ACM, pp 177–182. https://doi.org/10.1145/2460999.2461025
Jalali S, Wohlin C (2012) Systematic Literature Studies: Database Searches vs. Backward Snowballing. In: International Symposium on Empirical Software Engineering and Measurement. ACM, pp 29–38. https://doi.org/10.1145/2372251.2372257
Khan K S, Kunz R, Kleijnen J, Antes G (2003) Five steps to conducting a systematic review. J R Soc Med 96(3):118–121. https://doi.org/10.1177/014107680309600304
Kitchenham B A, Brereton O P (2013) A systematic review of systematic review process research in software engineering. Inf Softw Technol 55(12):2049–2075. https://doi.org/10.1016/j.infsof.2013.07.010
Kitchenham BA, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering. Tech. Rep EBSE-2007-01. Keele University, University of Durham
Kitchenham B A, Brereton O P, Budgen D, Turner M, Bailey J, Linkman S (2009) Systematic literature reviews in software engineering - a systematic literature review. Inf Softw Technol 51(1):7–15. https://doi.org/10.1016/j.infsof.2008.09.009
Kitchenham B A, Pretorius R, Budgen D, Brereton O P, Turner M, Niazi M, Linkman S (2010) Systematic literature reviews in software engineering – a tertiary study. Inf Softw Technol 52(8):792–805. https://doi.org/10.1016/j.infsof.2010.03.006
Kitchenham BA, Brereton OP, Li Z, Budgen D, Burn A (2011) Repeatability of Systematic Literature Reviews. In: International Conference on Evaluation and Assessment in Software Engineering. IET, pp 46–55
Kitchenham B A, Budgen D, Brereton OP (2016) Evidence-Based Software Engineering and Systematic Reviews. CRC Press, Boca Raton
Levy Y, Ellis T J (2006) A systems approach to conduct an effective literature review in support of information systems research. Inform Sci Int J Emerging Transdiscip 9:181–212. https://doi.org/10.28945/479
Lex A, Gehlenborg N, Strobelt H, Vuillemot R, Pfister H (2014) Upset: Visualization of Intersecting Sets. IEEE Trans Vis Comput Graph 20(12):1983–1992. https://doi.org/10.1109/TVCG.2014.2346248
Lindsay R M, Ehrenberg A S C (1993) The design of replicated studies. Amer Stat 47(3):217–228. https://doi.org/10.1080/00031305.1993.10475983
MacDonell S, Shepperd M, Kitchenham B A, Mendes E (2010) How Reliable Are Systematic Reviews in Empirical Software Engineering?. IEEE Trans Softw Eng 36(5):676–687. https://doi.org/10.1109/TSE.2010.28
Mbiydzenyuy G (2015) Arrival Times with Hours of Service Regulations for Truck Drivers-Tracks and Gaps from Current Research. In: International Conference on Intelligent Transportation Systems. IEEE, pp 2631–2636. https://doi.org/10.1109/ITSC.2015.423
Moher D, Liberati A, Tetzlaff J, Altman DG, Group TP (2009) Preferred reporting items for systematic reviews and Meta-Analyses: The PRISMA statement. PLOS Med 6(7):1–6. https://doi.org/10.1371/journal.pmed.1000097
Okoli C, Schabram K (2010) A Guide to Conducting a Systematic Literature Review of Information Systems Research. Sprouts Working Papers on Information Systems. https://doi.org/10.2139/ssrn.1954824
Orduña-Malea E, Martín-Martín A, Ayllon JM, Delgado Lopez-Cozar E (2014) The Silent Fading of an Academic Search Engine: The Case of Microsoft Academic Search. Online Inf Rev 38(7):936–953. https://doi.org/10.1108/OIR-07-2014-0169
Petersen K, Feldt R, Mujtaba S, Mattsson M (2008) Systematic Mapping Studies in Software Engineering. In: International Conference on Evaluation and Assessment in Software Engineering. BCS, pp 68–77
Riaz M, Sulayman M, Salleh N, Mendes E (2010) Experiences Conducting Systematic Reviews from Novices’ Perspective. In: International Conference on Evaluation and Assessment in Software Engineering. BCS, pp 44–53
Riedl R (2007) On the Replication of Positivist Case Study Research. In: European Conference on Information Systems, pp 1515–1526
Sackett D L, Straus S E, Richardson W S, Rosenberg W, Haynes RB (1997) Evidence-Based Medicine: How to Practice and Teach EBM. WB Saunders Company, Philadelphia
Shakeel Y, Krüger J, von Nostitz-Wallwitz I, Lausberger C, Campero Durand G, Saake G, Leich T (2018) (Automated) Literature Analysis - Threats and Experiences. In: International Workshop on Software Engineering for Science. ACM, pp 20–27. https://doi.org/10.1145/3194747.3194748
Shaw M (2003) Writing Good Software Engineering Research Papers. In: International Conference on Software Engineering. IEEE, pp 726–736. https://doi.org/10.1109/ICSE.2003.1201262
Soni G, Kodali R (2011) A critical analysis of supply chain management content in empirical research. Bus Process Manag J 17(2):238–266. https://doi.org/10.1108/14637151111122338
Tranfield D, Denyer D, Smart P (2003) Towards a methodology for developing Evidence-Informed management knowledge by means of systematic review. Br J Manag 14(3):207–222. https://doi.org/10.1111/1467-8551.00375
vom Brocke J, Simons A, Riemer K, Niehaves B, Plattfaut R, Cleven A (2015) Standing on the shoulders of giants: Challenges and recommendations of literature search in information systems research. Commun Assoc Inf Syst 37(9):205–224
von Nostitz-Wallwitz I, Krüger J, Siegmund J, Leich T (2018) Knowledge Transfer from Research to Industry: A Survey on Program Comprehension. In: International Conference on Software Engineering. ACM, pp 300–301. https://doi.org/10.1145/3183440.3194980
Webster J, Watson RT (2002) Analyzing the Past to Prepare for the Future: Writing a Literature Review. Manag Inf Syst Q 26(2):xiii–xxiii
Wohlin C (2014) Guidelines for Snowballing in Systematic Literature Studies and a Replication in Software Engineering. In: International Conference on Evaluation and Assessment in Software Engineering. ACM, pp 1–10. https://doi.org/10.1145/2601248.2601268
Wolfswinkel J F, Furtmueller E, Wilderom C P (2013) Using grounded theory as a method for rigorously reviewing literature. Eur J Inf Syst 22(1):45–55. https://doi.org/10.1057/ejis.2011.51
Yin RK (2018) Case Study Research and Applications: Design and Methods. Sage, Newbury Park
Zhang H, Babar MA (2010) On Searching Relevant Studies in Software Engineering. In: International Conference on Evaluation and Assessment in Software Engineering. BCS Learning & Development Ltd., pp 111–120
Zhang H, Babar M A, Tell P (2011) Identifying relevant studies in software engineering. Inf Softw Technol 53(6):625–637. https://doi.org/10.1016/j.infsof.2010.12.010
Zhang H, Babar M A (2013) Systematic reviews in software engineering: an empirical investigation. Inf Softw Technol 55(7):1341–1354. https://doi.org/10.1016/j.infsof.2012.09.008
Acknowledgments
This research has been supported by the German Research Foundation (DFG) project EXPLANT grants LE 3382/2-1, LE 3382/2-3, SA 465/49-1, and SA 465/49-3.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by: Burak Turhan
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Ivonne von Nostitz-Wallwitz has previously published as Ivonne Schröter.
Appendix
Appendix
Authors | Title | Year |
|---|---|---|
Cruz-Hinojosa, N. J.; Gutiérrez-De-Mesa, J.A. | Literature review of the situation research faces in the application of ITIL in Small and Medium Enterprises | 2016 |
Khosravi, P.; Rezvani, A.; Wiewiora, A. | The impact of technology on older adults’ social isolation | 2016 |
Dikert, K.; Paasivaara, M.; Lassenius, C. | Challenges and success factors for large-scale agile transformations: A systematic literature review | 2016 |
Jafari Navimipour, N.; Charband, Y. | Knowledge sharing mechanisms and techniques in project teams: Literature review, classification, and current trends | 2016 |
Milani, A. S.; Navimipour, N. J. | Load balancing mechanisms and techniques in the cloud environments: Systematic literature review and future trends | 2016 |
Idri, A.; Hosni, M.; Abran, A. | Systematic literature review of ensemble effort estimation | 2016 |
Zare, M.; Pahl, C.; Rahnama, H.; Nilashi, M.; Mardani, A.; Ibrahim, O.; Ahmadi, H. | Multi-criteria decision making approach in E-learning: A systematic review and classification | 2016 |
Costa, E.; Soares, A. L.; De Sousa, J. P. | Information, knowledge and collaboration management in the internationalisation of SMEs: A systematic literature review | 2016 |
Melendez, K.; Dávila, A.; Pessoa, M. | Information technology service management models applied to medium and small organizations: A systematic literature review | 2016 |
Soltani, Z.; Navimipour, N. J. | Customer relationship management mechanisms: A systematic review of the state of the art literature and recommendations for future research | 2016 |
Garousi, V.; Mäntylä, M. V. | When and what to automate in software testing? A multi-vocal literature review | 2016 |
Sánchez Guinea, A.; Nain, G.; Le Traon, Y. | A systematic review on the engineering of software for ubiquitous systems | 2016 |
Tarhan, A.; Turetken, O.; Reijers, H. A. | Business process maturity models: A systematic literature review | 2016 |
Ali, S.; Khan, S. U. | Software outsourcing partnership model: An evaluation framework for vendor organizations | 2016 |
Martins, L. E. G.; Gorschek, T. | Requirements engineering for safety-critical systems: A systematic literature review | 2016 |
Balaid, A.; Abd Rozan, M. Z.; Hikmi, S. N.; Memon, J. | Knowledge maps: A systematic literature review and directions for future research | 2016 |
Bissi, W.; Serra Seca Neto, A. G.; Emer, M. C. F. P. | The effects of test driven development on internal quality, external quality and productivity: A systematic review | 2016 |
McGill, M. M.; Decker, A.; Settle, A. | Undergraduate students’ perceptions of the impact of pre-college computing activities on choices of major | 2016 |
de França, B. B. N.; Travassos, G. H. | Experimentation with dynamic simulation models in software engineering: planning and reporting guidelines | 2016 |
Sajid, A.; Abbas, H. | Data privacy in cloud-assisted healthcare systems: State of the art and future challenges | 2016 |
Souza, D. M.; Felizardo, K. R.; Barbosa, E. F. | A systematic literature review of assessment tools for programming assignments | 2016 |
Anuar, U.; Ahmad, S.; Emran, N. A. | A simplified systematic literature review: Improving Software Requirements Specification quality with boilerplates | 2016 |
Gheni, A. Y.; Jabar, M. A.; Jusoh, Y. Y.; Mohd Ali, N.; Abdullah, R. H. | Factors for communication technologies selection within virtual software teams | 2016 |
Jia, J.; Zhang, P.; Capretz, L. F. | Environmental factors influencing individual decisionmaking behavior in software projects: A systematic literature review | 2016 |
Muccini, H.; Sharaf, M.; Weyns, D. | Self-adaptation for cyber-physical systems: A systematic literature review | 2016 |
Yaseen, M.; Baseer, S.; Ali, S.; Khan, S. U.; Abdullah | Requirement implementation model (RIM) in the context of global software development | 2016 |
Batool, D. -. -.; Molta, Y. H.; Sarwar, A.; Abbasi, M. A.; Jabeen, J. | Software architecture and requirements: A systematic literature review | 2016 |
Luh, R.; Marschalek, S.; Kaiser, M.; Janicke, H.; Schrittwieser, S. | Semantics-aware detection of targeted attacks: a survey | 2016 |
Spanos, G.; Angelis, L. | The impact of information security events to the stock market: A systematic literature review | 2016 |
Soomro, A. B.; Salleh, N.; Mendes, E.; Grundy, J.; Burch, G.; Nordin, A. | The effect of software engineers’ personality traits on team climate and performance: A Systematic Literature Review | 2016 |
Tahir, T.; Rasool, G.; Gencel, C. | A systematic literature review on software measurement programs | 2016 |
Farwick, M.; Schweda, C. M.; Breu, R.; Hanschke, I. | A situational method for semi-automated Enterprise Architecture Documentation | 2016 |
Schatz, D.; Bashroush, R. | Economic valuation for information security investment: A systematic literature review | 2016 |
Kekgathetse, M. B.; Letsholo, K. J. | A survey on database synchronization algorithms for mobile device | 2016 |
Lu, Q.; Zhu, L.; Zhang, H.; Wu, D.; Li, Z.; Xu, X. | MapReduce job optimization: A mapping study | 2016 |
Aris, H. | Sustainable solvers participation in non-profit mobile crowdsourcing initiatives: A review of successful applications | 2016 |
Marçal, I.; Garcia, R. E.; Eler, D. M.; Junior, C. O.; Correia, R. C. M. | Techniques for the identification of crosscutting concerns: A systematic literature review | 2016 |
Da Silva, G. C.; De Figueiredo Carneiro, G. | Software process improvement in small and medium enterprises: A systematic literature review | 2016 |
Li, Z.; Zhang, H.; O’Brien, L.; Jiang, S.; Zhou, Y.; Kihl, M.; Ranjan, R. | Spot pricing in the cloud ecosystem: A comparative investigation | 2016 |
Ali, O.; Soar, J.; Yong, J. | An investigation of the challenges and issues influencing the adoption of cloud computing in Australian regional municipal governments | 2016 |
Qu, M.; Yu, S.; Chen, D.; Chu, J.; Tian, B. | State-of-the-art of design, evaluation, and operation methodologies in product service systems | 2016 |
Soomro, Z. A.; Shah, M. H.; Ahmed, J. | Information security management needs more holistic approach: A literature review | 2016 |
Hassan, M.; Jabar, M. A.; Sidi, F.; Jusoh, Y. Y.; Hassan, S. | Enterprise resource planning adoption lifecycle: A systematic literature review | 2016 |
Hakami, Y. A. A.; Hussei, A. R. C. B.; Adenuga, K. I. | Preliminary model for computer based assessment acceptance in developing countries | 2016 |
Rasti, Z.; Darajeh, A.; Khayami, R.; Sanatnama, H. | Systematic literature review in the area of Enterprise architecture during past 10 years | 2016 |
Oliveira, J. B.; Lima, R. S.; Montevechi, J. A. B. | Perspectives and relationships in supply chain simulation: A systematic literature review | 2016 |
Torrecilla-Salinas, C. J.; Sedeño, J.; Escalona, M. J.; Mejías , M. | Agile, web engineering and capability maturity model integration: A systematic literature review | 2016 |
Gasparic, M.; Janes, A. | What recommendation systems for software engineering recommend: A systematic literature review | 2016 |
Boyle, E. A.; Hainey, T.; Connolly, T. M.; Gray, G.; Earp, J.; Ott, M.; Lim, T.; Ninaus, M.; Ribeiro, C.; Pereira, J. | An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games | 2016 |
Sobernig, S.; Hoisl, B.; Strembeck, M. | Extracting reusable design decisions for UML-based domain-specific languages: A multi-method study | 2016 |
Chen, T. | Technology-supported peer feedback in ESL/EFL writing classes: a research synthesis | 2016 |
Al-Zubidy, A.; Carver, J. C.; Heckman, S.; Sherriff, M. | A (updated) review of empiricism at the SIGCSE technical symposium | 2016 |
Decker, A.; McGill, M. M.; Settle, A. | Towards a common framework for evaluating computing outreach activities | 2016 |
Charband, Y.; Jafari Navimipour, N. | Online knowledge sharing mechanisms: A systematic review of the state of the art literature and recommendations for future research | 2016 |
Smuts, H.; Kotze, P.; Van Der Merwe, A.; Loock, M. | Threats and opportunities for information systems outsourcing | 2016 |
Banaeianjahromi, N.; Smolander, K. | What do we know about the role of enterprise architecture in enterprise integration? A systematic mapping study | 2016 |
Effing, R.; Spil, T. A. M. | The social strategy cone: Towards a framework for evaluating social media strategies | 2016 |
Elbattah, M.; Roushdy, M.; Aref, M.; Salem, A. -. M. | Large-scale ontology storage and query using graph database-oriented approach: The case of Freebase | 2016 |
Yaseen, M.; Baseer, S.; Sherin, S. | Critical challenges for requirement implementation in context of global software development: A systematic literature review | 2016 |
Szvetits, M.; Zdun, U. | Systematic literature review of the objectives, techniques, kinds, and architectures of models at runtime | 2016 |
Thuan, N. H.; Antunes, P.; Johnstone, D. | Factors influencing the decision to crowdsource: A systematic literature review | 2016 |
Najafabadi, M. K.; Mahrin, M. N. | A systematic literature review on the state of research and practice of collaborative filtering technique and implicit feedback | 2016 |
Caron, X.; Bosua, R.; Maynard, S. B.; Ahmad, A. | The internet of things (IoT) and its impact on individual privacy: An Australian perspective | 2016 |
Isern, D.; Moreno, A. | A systematic literature review of agents applied in healthcare | 2016 |
Hosseinzadeh, S.; Hyrynsalmi, S.; Conti, M.; Leppänen, V. | Security and privacy in cloud computing via obfuscation and diversification: A survey | 2016 |
Ngadiman, N.; Sulaiman, S.; Wan Kadir, W. M. N. | A systematic literature review on attractiveness and learnability factors in Web applications | 2016 |
Alasbali, N.; Benatallah, B. | Open source as an innovative approach in computer science education A systematic review of advantages and challenges | 2016 |
Mubasher, M. M.; Syed Waqar Ul Qounain, J. | Systematic literature review of vehicular traffic flow simulators | 2016 |
Benslimane, Y.; Yang, Z.; Bahli, B. | Key topics in cloud computing security: A systematic literature review | 2016 |
Inzunza, S.; Juárez-Ramírez, R.; Ramírez-Noriega, A. | User and context information in context-aware recommender systems: A systematic literature review | 2016 |
Bergström, E.; ÃĚhlfeldt, R. -. | Information classification enablers | 2016 |
Afzal, W.; Alone, S.; Glocksien, K.; Torkar, R. | Software test process improvement approaches: A systematic literature review and an industrial case study | 2016 |
Lawal, M. A.; Sultan, A. B. M.; Shakiru, A. O. | Systematic literature review on SQL injection attack | 2016 |
Nabavi, A.; Taghavi-Fard, M. T.; Hanafizadeh, P.; Taghva, M. R. | Information technology continuance intention: A systematic literature review | 2016 |
Carvalho, J. V.; Rocha, Á.; Abreu, A. | Information systems and technologies maturity models for healthcare: A systematic literature review | 2016 |
Shozi, N. A.; Mtsweni, J. | Big data privacy and security: A systematic analysis of current and future Challenges | 2016 |
Grund, C. K.; Meier, M. C. | Towards game-based management decision support: Using serious games to improve the decision process | 2016 |
Yaman, S. G.; Sauvola, T.; Riungu-Kalliosaari, L.; Hokkanen, L.; Kuvaja, P.; Oivo, M.; Männistö, T. | Customer involvement in continuous deployment: A systematic literature review | 2016 |
Vahida, S.; Lehouxb, N.; De Santa-Eulaliac, L. A.; D’Amoursb, S.; Frayret, J. -.; Venkatadrie, U. | Supply chain modelling frameworks for forest products industry: A systematic literature review | 2016 |
Zander, S.; Kolbe, L. M. | Supplier relationship management in information systems research: A literature review | 2016 |
Aulkemeier, F.; Schramm, M.; Iacob, M. -.; van Hillegersberg, J. | A service-oriented e-commerce reference architecture | 2016 |
Sepúlveda, S.; Cravero, A.; Cachero, C. | Requirements modeling languages for software product lines: A systematic literature review | 2016 |
Alzoubi, Y. I.; Gill, A. Q.; Al-Ani, A. | Empirical studies of geographically distributed agile development communication challenges: A systematic review | 2016 |
Lee, J. | Drivers and consequences in transforming work practices | 2016 |
Febrero, F.; Calero, C.; Moraga, M. Á. | Software reliability modeling based on ISO/IEC SQuaRE | 2016 |
Chauhan, M. A.; Babar, M. A.; Benatallah, B. | Architecting cloud-enabled systems: A systematic survey of challenges and solutions | 2016 |
Haselberger, D. | A literature-based framework of performance-related leadership interactions in ICT project teams | 2016 |
Vichitvanichphong, S.; Talaei-Khoei, A.; Kerr, D.; Ghapanchi, A. H.; Scott-Parker, B. | Good old gamers, good drivers: Results from a correlational experiment among older drivers | 2016 |
Cano, C.; Melgar, A.; Dávila, A.; Pessoa, M. | Comparison of software process models. A systematic literature review | 2015 |
Mohamad Hazawawi, N. A.; Othman, M. F. I.; Emran, M. H.; Zakaria, M. H.; Che Pee, N.; Othman, M. A. | A structured literature review on applied neuroscience in Information Systems (neuroIS) | 2015 |
Al-Arabiat, D.; Wan Ahmad, W. F.; Sarlan, A. | Review on critical factors of adopting cloud mobile learning | 2015 |
Ahmad, M.; Rahim, L. A.; Arshad, N. I. | Modelling educational games through multi-domain framework in light of game play | 2015 |
Piran, F. A. S.; Lacerda, D. P.; Antunes, J. A. V.; Viero, C. F.; Dresch, A. | Modularization strategy: Analysis of published articles on production and operations management (1999 to 2013) | 2015 |
Soleymani, S. A.; Abdullah, A. H.; Hassan, W. H.; Anisi, M. H.; Goudarzi, S.; Rezazadeh Baee, M. A.; Mandala, S. | Trust management in vehicular ad hoc network: a systematic review | 2015 |
Nishida, A. K.; Braga, J. C. | Systematic review of literature: Educational games about electric energy consumption | 2015 |
Brito, J. A.; Amorim, R.; De Sousa Monteiro, B.; Gomes, A. S.; De Melo Filho, I. J. | Effectiveness of practices with sensors in engaging in meaningful learning in higher education: Extending a framework of ubiquitous learning | 2015 |
Ly, L. T.; Maggi, F. M.; Montali, M.; Rinderle-Ma, S.; Van Der Aalst, W. M. P. | Compliance monitoring in business processes: Functionalities, application, and tool-support | 2015 |
Steinhueser, M.; Richter, A.; Smolnik, S. | How to bridge the boundary? Determinants of inter-organizational social software usage | 2015 |
Mater, W.; Ibrahim, R. | Factors supporting teamwork communication in clinical pathways: Systematic literature review | 2015 |
Tosun, A.; Bener, A. B.; Akbarinasaji, S. | A systematic literature review on the applications of Bayesian networks to predict software quality | 2015 |
Hashim, S. N.; Abdullah, R.; Ibrahim, H. | Collaborative knowledge management system strategic planning (CKMS2P): A systematic literature review | 2015 |
Mahmud, F.; Aris, H. | State of mobile crowdsourcing applications: A review | 2015 |
Clear, T. | ’Follow the moon’ development: Writing a systematic literature review on Global Software Engineering Education | 2015 |
Carroll, C.; Falessi, D.; Forney, V.; Frances, A.; Izurieta, C.; Seaman, C. | A mapping study of software causal factors for improving maintenance | 2015 |
Martinez-Fernandez, S.; Medeiros Dos Santos, P. S.; Ayala, C. P.; Franch, X.; Travassos, G. H. | Aggregating empirical evidence about the benefits and drawbacks of software reference architectures | 2015 |
Holm, H.; Sommestad, T.; Bengtsson, J. | Requirements engineering: The quest for the dependent variable | 2015 |
Mbiydzenyuy, G. | Arrival times with hours of service regulations for truck drivers-tracks and gaps from current research | 2015 |
Abdalla, G.; Damasceno, C. D. N.; Guessi, M.; Oquendo, F.; Nakagawa, E. Y. | A systematic literature review on knowledge representation approaches for systems-of-systems | 2015 |
Neto, C. R. L.; Cardoso, M. P. S.; Chavez, C. V. F. G.; Almeida, E. S. D. | Initial evidence for understanding the relationship between product line architecture and software architecture recovery | 2015 |
Hassan, M. M.; Afzal, W.; Blom, M.; Lindstrom, B.; Andler, S. F.; Eldh, S. | Testability and software robustness: A systematic literature review | 2015 |
Dutra, A. C. S.; Prikladnicki, R.; Franca, C. | What do we know about high performance teams in software engineering? Results from a systematic literature review | 2015 |
Santana, C.; Queiroz, F.; Vasconcelos, A.; Gusmao, C. | Software process improvement in agile software development: A systematic literature review | 2015 |
Svensson, R. B.; Taghavianfar, M.; Gren, L. | Creativity techniques for more creative requirements: Theory vs. practice | 2015 |
Oueslati, H.; Rahman, M. M.; Othmane, L. B. | Literature review of the challenges of developing secure software using the agile approach | 2015 |
Decker, A.; McGill, M. M.; Settle, A. | Computing outreach literature review | 2015 |
Afolabi, A. O.; Toivanen, P.; Haataja, K.; Mykkanen, J. | Systematic literature review on empirical results and practical implementations of healthcare recommender systems: Lessons learned and a novel proposal | 2015 |
Eikey, E. V.; Reddy, M. C.; Kuziemsky, C. E. | Examining the role of collaboration in studies of health information technologies in biomedical informatics: A systematic review of 25 years of research | 2015 |
Inayat, I.; Salim, S. S.; Marczak, S.; Daneva, M.; Shamshirband, S. | A systematic literature review on agile requirements engineering practices and challenges | 2015 |
Ermilov, T.; Khalili, A.; Auer, S. | Ubiquitous semantic applications: A systematic literature review | 2015 |
Chagas, A.; Santos, M.; Santana, C.; Vasconcelos, A. | The impact of human factors on agile projects | 2015 |
Abia, M.; Brown, I. | A polymorphic model of information systems success: An outcome of a literature-based grounded theory analysis | 2015 |
Rashid, M.; Anwar, M. W.; Khan, A. M. | Identification of trends for model based development of embedded systems | 2015 |
Salvatori, L.; Marcantoni, F. | Social commerce: A literature review | 2015 |
Mahmood, S.; Niazi, M.; Hussain, A. | Identifying the challenges for managing component-based development in global software development: Preliminary results | 2015 |
Rodriguez, D.; Dolado, J.; Tuya, J. | Bayesian concepts in software testing: An initial review | 2015 |
Jiang, S.; Zhang, H.; Gao, C.; Shao, D.; Rong, G. | Process simulation for software engineering education | 2015 |
Gao, C.; Zhang, H.; Jiang, S. | Constructing hybrid software process simulation models | 2015 |
Hu, Y.; Liu, K.; Zhang, X.; Su, L.; Ngai, E. W. T.; Liu, M. | Application of evolutionary computation for rule discovery in stock algorithmic trading: A literature review | 2015 |
Parkkila, J.; Ikonen, J.; Porras, J. | Where is the research on connecting game worlds? A systematic mapping study | 2015 |
Calderón, A.; Ruiz, M. | A systematic literature review on serious games evaluation: An application to software project management | 2015 |
Hang, F.; Zhao, L. | Supporting end-user service composition: a systematic review of current activities and tools | 2015 |
Van den Berghe, A.; Scandariato, R.; Yskout, K.; Joosen, W. | Design notations for secure software: a systematic literature review | 2015 |
Bianchi, T.; Santos, D. S.; Felizardo, K. R. | Quality attributes of systems-of-systems: A systematic literature review | 2015 |
Ilyas, M.; Khan, S. U. | Software integration in global software development: Success factors for GSD vendors | 2015 |
Weerakkody, V.; Irani, Z.; Lee, H.; Osman, I.; Hindi, N. | E-government implementation: A bird’s eye view of issues relating to costs, opportunities, benefits and risks | 2015 |
Lacerda, T. C.; Nunes, J. V.; Von Wangenheim, C. G. | Usability heuristics for mobile phone applications: A literature review | 2015 |
Ovcjak, B.; Hericko, M.; Polancic, G. | Factors impacting the acceptance of mobile data services - A systematic literature review | 2015 |
Clear, T.; Daniels, M.; Beecham, S.; McDermott, R.; Barr, J.; Oudshoorn, M.; Savickaite, A.; Noll, J. | Challenges and recommendations for the design and conduct of global software engineering courses: A systematic review | 2015 |
Alam, K. A.; Ahmad, R.; Akhunzada, A.; Nasir, M. H. N. M.; Khan, S. U. | Impact analysis and change propagation in service-oriented enterprises: A systematic review | 2015 |
Börjesson, P.; Barendregt, W.; Eriksson, E.; Torgersson, O. | Designing technology for and with developmentally diverse children - A systematic literature review | 2015 |
Woznowski, P.; Kaleshi, D.; Oikonomou, G.; Craddock, I. | Classification and suitability of sensing technologies for activity recognition | 2015 |
Jabangwe, R.; Börstler, J.; Smite, D.; Wohlin, C. | Empirical evidence on the link between object-oriented measures and external quality attributes: A systematic literature review | 2015 |
Sangupamba Mwilu, O.; Comyn-Wattiau, I.; Prat, N. | Design science research contribution to business intelligence in the cloud - A systematic literature review | 2015 |
Kilubi, I. | Strategic technology partnering: A framework extension | 2015 |
Hasan, M. M. | ICTD systems development: Analysis of requirements elicitation approaches | 2015 |
Moghaddam, F. A.; Lago, P.; Grosso, P. | Energy-efficient networking solutions in cloud-based environments: A systematic literature review | 2015 |
Siavashi, F.; Truscan, D. | Environment modeling in model-based testing: Concepts, prospects and research challenges: A systematic literature review | 2015 |
Mahmood, S.; Anwer, S.; Niazi, M.; Alshayeb, M.; Richardson, I. | Identifying the factors that influence task allocation in global software development: Preliminary results | 2015 |
Zhou, Y.; Zhang, H.; Huang, X.; Yang, S.; Babar, M. A.; Tang, H. | Quality assessment of systematic reviews in software engineering: A tertiary study | 2015 |
Liu, G.; Rong, G.; Zhang, H.; Shan, Q. | The adoption of capture-recapture in software engineering: A systematic literature review | 2015 |
Guessi, M.; Neto, V. V. G.; Bianchi, T.; Felizardo, K. R.; Oquendo, F.; Nakagawa, E. Y. | A systematic literature review on the description of software architectures for systems of systems | 2015 |
Hainey, T.; Connolly, T. M.; Chaudy, Y.; Boyle, E.; Beeby, R.; Soflano, M. | Assessment integration in serious games | 2015 |
Hussain, A.; Abubakar, H. I.; Hashim, N. B. | Evaluating mobile banking application: Usability dimensions and measurements | 2015 |
Steinmacher, I.; Conte, T. U.; Gerosa, M. A.; Redmiles, D. F. | Social barriers faced by newcomers placing their first contribution in open source software projects | 2015 |
Myllärniemi, V.; Savolainen, J.; Raatikainen, M.; Männistö, T. | Performance variability in software product lines: Proposing theories from a case study | 2015 |
Dermeval, D.; Vilela, J.; Bittencourt, I. I.; Castro, J.; Isotani, S.; Brito, P.; Silva, A. | Applications of ontologies in requirements engineering: a systematic review of the literature | 2015 |
Misbhauddin, M.; Alshayeb, M. | UML model refactoring: a systematic literature review | 2015 |
Benslimane, Y.; Plaisent, M.; Bernard, P.; Bahli, B. | Key challenges and opportunities in cloud computing and implications on service requirements: Evidence from a systematic literature review | 2015 |
Dobreva, M.; Angelova, G.; Agre, G. | Bridging the gap between digital libraries and e-learning | 2015 |
Danciu, A.; Kroß, J.; Brunnert, A.; Willnecker, F.; Vögele, C.; Kapadia, A.; Krcmar, H. | Landscaping performance research at the ICPE and its predecessors: A systematic literature review | 2015 |
Akour, M.; Alazzam, I.; Hanandeh, F.; Akour, I. | A systematic literature review to classify pre and post test suite reduction techniques | 2015 |
Hydara, I.; Sultan, A. B. M.; Zulzalil, H.; Admodisastro, N. | Current state of research on cross-site scripting (XSS) - A systematic literature review | 2015 |
Rashid, M.; Anwar, M. W.; Khan, A. M. | Toward the tools selection in model based system engineering for embedded systems - A systematic literature review | 2015 |
Campanelli, A. S.; Parreiras, F. S. | Agile methods tailoring - A systematic literature review | 2015 |
Sheikh Ibrahim, M.; Salleh, N.; Misra, S. | Empirical studies of cloud computing in education: A systematic literature review | 2015 |
Lewis, G.; Lago, P. | Architectural tactics for cyber-foraging: Results of a systematic literature review | 2015 |
Supulniece, I.; Berzisa, S.; Polaka, I.; Grabis, J.; Meiers, E.; Ozolins, E. | Source code driven decomposition of object-oriented legacy systems a systemic literature review and research outlook | 2015 |
Dutra, A. C. S.; Prikladnicki, R.; Conte, T. | What are the main characteristics of high performance teams for software development? | 2015 |
Soares, M. S.; Maia, M. A.; Silva, R. F. G. | Performance evaluation of aspect-oriented programming weavers | 2015 |
de Almeida, M. M. K.; Marins, F. A. S.; Salgado, A. M. P.; Santos, F. C. A.; da Silva, S. L. | Mitigation of the bullwhip effect considering trust and collaboration in supply chain management: a literature review | 2015 |
Bipat, S.; Sneller, L. | A theoretical examination of constructs underlying information technology capability | 2015 |
Meis, R.; Wirtz, R.; Heisel, M. | A taxonomy of requirements for the privacy goal transparency | 2015 |
Mirza, U. M.; Arslan, M. A.; Cedersjo, G.; Sulaman, S. M.; Janneck, J. W. | Mapping and scheduling of dataflow graphs - A systematic map | 2015 |
De Aguiar Beninca, R.; Huzita, E. H. M.; Galdamez, E. V. C.; Leal, G. C. L.; Balancieri, R.; Massago, Y. | Knowledge management practices in GSD: A systematic literature review update | 2015 |
Shaikh, M.; Salleh, N.; Marziana, L. | Social networks event mining: A systematic literature review | 2015 |
Tosi, D.; Morasca, S. | Supporting the semi-automatic semantic annotation of web services: A systematic literature review | 2015 |
Subbaraj, R.; Venkatraman, N. | A systematic literature review on ontology based context management system | 2015 |
Rouhani, B. D.; Mahrin, M. N.; Nikpay, F.; Ahmad, R. B.; Nikfard, P. | A systematic literature review on Enterprise Architecture Implementation Methodologies | 2015 |
Kupiainen, E.; Mäntylä , M. V.; Itkonen, J. | Using metrics in Agile and Lean software development - A systematic literature review of industrial studies | 2015 |
Ha, I. | Technologies and research trends in wireless body area networks for healthcare: A systematic literature review | 2015 |
Bakar, N. H.; Kasirun, Z. M.; Salleh, N. | Feature extraction approaches from natural language requirements for reuse in software product lines: A systematic literature review | 2015 |
Ibukun, E.; Daramola, O. | A systematic literature review of mobile cloud computing | 2015 |
Rizvi, B.; Bagheri, E.; Gasevic, D. | A systematic review of distributed Agile software engineering | 2015 |
Fuentes, C.; Gerea, C.; Herskovic, V.; Marques, M.; Rodríguez, I.; Rossel, P. O. | User interfaces for self-reporting emotions: A systematic literature review | 2015 |
Rosmadi, N. A.; Ahmad, S.; Abdullah, N. | The relevance of software requirement defect management to improve requirements and product quality: A systematic literature review | 2015 |
Sa’Don, N. F.; Alias, R. A.; Ohshima, N. | Nascent research trends in MOOCs in higher educational institutions: A systematic literature review | 2015 |
Riegel, N.; Doerr, J. | A systematic literature review of requirements prioritization criteria | 2015 |
Ming, T. M.; Jabar, M. A.; Sidi, F.; Wei, K. T. | A systematic literature review of computer ethics issues | 2015 |
Procaccianti, G.; Lago, P.; Bevini, S. | A systematic literature review on energy efficiency in cloud software architectures | 2015 |
Malinen, S. | Understanding user participation in online communities: A systematic literature review of empirical studies | 2015 |
Väänänen-Vainio-Mattila, K.; Olsson, T.; Häkkilä, J. | Towards deeper understanding of user experience with ubiquitous computing systems: Systematic literature review and design framework | 2015 |
Zarour, M.; Abran, A.; Desharnais, J. -.; Alarifi, A. | An investigation into the best practices for the successful design and implementation of lightweight software process assessment methods: A systematic literature review | 2015 |
Da Silva Estácio, B. J.; Prikladnicki, R. | Distributed pair programming: A systematic literature review | 2015 |
Gonçalves , R. Q.; Von Wangenheim, C. G. | How to teach the usage of project management tools in computer courses: A systematic literature review | 2015 |
Lenberg, P.; Feldt, R.; Wallgren, L. G. | Behavioral software engineering: A definition and systematic literature review | 2015 |
Ahmed, M. M.; Letchmunan, S. | A systematic literature review on challenges in service oriented software engineering | 2015 |
Noraini, C. P.; Bokolo, A. J.; Haizan Nor, R. N.; Azmi Murad, M. A. | Risk assessment of it governance: A systematic literature review | 2015 |
Vacari, I.; Prikladnicki, R. | Adopting agile methods in the public sector: A systematic literature review | 2015 |
Razavian, M.; Lago, P. | A systematic literature review on SOA migration | 2015 |
Ayora, C.; Torres, V.; Weber, B.; Reichert, M.; Pelechano, V. | VIVACE: A framework for the systematic evaluation of variability support in process-aware information systems | 2015 |
Abdellatif, T. M.; Capretz, L. F.; Ho, D. | Software analytics to software practice: A systematic literature review | 2015 |
Tüzün, E.; Tekinerdogan, B.; Kalender, M. E.; Bilgen, S. | Empirical evaluation of a decision support model for adopting software product line engineering | 2015 |
Al Dallal, J. | Identifying refactoring opportunities in object-oriented code: A systematic literature review | 2015 |
Rochimah, S.; Arifiani, S.; Insanittaqwa, V. F. | Non-source code refactoring: A systematic literature review | 2015 |
Sharafi, Z.; Soh, Z.; Guéhéneuc, Y. -. | A systematic literature review on the usage of eye-tracking in software engineering | 2015 |
Dos Santos Rocha, R.; Degrossi, L. C.; De Albuquerque, J. P. | A systematic literature review of geospatial web service composition | 2015 |
Ulziit, B.; Warraich, Z. A.; Gencel, C.; Petersen, K. | A conceptual framework of challenges and solutions for managing global software maintenance | 2015 |
Santos, J. A. M.; Santos, A. R.; De Mendonça, M. G. | Investigating bias in the search phase of Software Engineering secondary studies | 2015 |
Nakic, J.; Granic, A.; Glavinic, V. | Anatomy of student models in adaptive learning systems: A systematic literature review of individual differences from 2001 to 2013 | 2015 |
Chuene, D.; Mtsweni, J. | The adoption of crowdsourcing platforms in South Africa | 2015 |
Kocbek, M.; Jošt, G.; Hericko, M.; Polancic, G. | Business process model and notation: The current state of affairs | 2015 |
Ghanbarzadeh, R.; Ghapanchi, A. H.; Blumenstein, M. | Characteristics of research on the application of three-dimensional immersive virtual worlds in health | 2015 |
Al-Wosabi, A. A. A.; Shukur, Z. | Software tampering detection in embedded systems - A systematic literature review | 2015 |
Hyrynsalmi, S.; Seppänen, M.; Nokkala, T.; Suominen, A.; Järvi, A. | Wealthy, healthy and/or happy — What does ’Ecosystem Health’ stand for? | 2015 |
Cohn-Muroy, D.; Pow-Sang, J. A. | Can user stories and use cases be used in combination in a same project? A systematic review | 2015 |
Niazi, M.; Mahmood, S.; Alshayeb, M.; Hroub, A. | Empirical investigation of the challenges of the existing tools used in global software development projects | 2015 |
Wagner, I.; Eckhoff, D. | Privacy assessment in vehicular networks using simulation | 2015 |
Franco-Bedoya, O.; Ameller, D.; Costal, D.; Franch, X. | Measuring the quality of open source software ecosystems using QuESo | 2015 |
Eze, B.; Peyton, L. | Systematic literature review on the anonymization of high dimensional streaming datasets for health data sharing | 2015 |
Khosravi, P.; Ghapanchi, A. H.; Blumenstein, M. | Investigating various technologies applied to assist seniors | 2015 |
El Ouirdi, A.; El Ouirdi, M.; Segers, J.; Henderickx, E. | Employees’ use of social media technologies: A methodological and thematic review | 2015 |
Jamil, N. B. C. E.; Ishak, I. B.; Sidi, F.; Affendey, L. S.; Mamat, A. | A systematic review on the profiling of digital news portal for big data veracity | 2015 |
Anthony, B.; Pa, N. C. | A review on tools of risk mitigation for information technology management | 2015 |
Abade, A.; Ferrari, F.; Lucrédio, D. | Testing M2T transformations: A systematic literature review | 2015 |
Miramontes, J.; Muñoz, M.; Calvo-Manzano, J. A.; Corona, B. | Establishing the state of the art of frameworks, methods and methodologies focused on lightening software process: A systematic literature review | 2015 |
Sadowska, M. | An approach to assessing the quality of business process models expressed in BPMN | 2015 |
Friedrich, T. | Analyzing the factors that influence consumers’ adoption of social commerce - A literature review | 2015 |
Leyh, C.; Thomschke, J. | Critical success factors for implementing supply chain management systems - The perspective of selected German enterprises: Full paper | 2015 |
Chatfield, A. T.; Reddick, C. G.; Al-Zubaidi, W. H. A. | Capability challenges in transforming government through open and big data: Tales of two cities | 2015 |
Maranhão, R.; Marinho, M.; De Moura, H. | Narrowing impact factors for innovative software project management | 2015 |
Medeiros, J.; Vasconcelos, A.; Silva, C. | Integration of agile practices: An approach to improve the quality of software specifications | 2015 |
Dutra, A. C. S.; Prikladnicki, R.; Conte, T. | Characteristics of high performance software development teams | 2015 |
Heaton, D.; Carver, J. C. | Claims about the use of software engineering practices in science: A systematic literature review | 2015 |
Moreno-Montes De Oca, I.; Snoeck, M.; Reijers, H. A.; Rodríguez-Morffi, A. | A systematic literature review of studies on business process modeling quality | 2015 |
Bano, M.; Zowghi, D. | A systematic review on the relationship between user involvement and system success | 2015 |
Steinmacher, I.; Graciotto Silva, M. A.; Gerosa, M. A.; Redmiles, D. F. | A systematic literature review on the barriers faced by newcomers to open source software projects | 2015 |
Nguyen-Duc, A.; Cruzes, D. S.; Conradi, R. | The impact of global dispersion on coordination, team performance and software quality-A systematic literature review | 2015 |
Lee, T.; Ghapanchi, A. H.; Talaei-Khoei, A.; Ray, P. | Strategic information system planning in healthcare organizations | 2015 |
Xu, Y.; Liu, Y.; Zheng, J. | To enlighten hidden facts in the code: A review of software visualization metaphors | 2015 |
Holm, H.; Karresand, M.; Vidström, A.; Westring, E. | A survey of industrial control system testbeds | 2015 |
Younoussi, S.; Roudies, O. | All about software reusability: A systematic literature review | 2015 |
Pa, N. C.; Anthony, B. | A review on decision making of risk mitigation for software management | 2015 |
Santhosh Kumar, R.; Prabu, M.; Venkatesh, P.; Vijaya Rani, S. | An automatic solar panel based street lighting system: A systematic literature review | 2015 |
Méndez-Porras, A.; Quesada-López, C.; Jenkins, M. | Automated testing of mobile applications: A systematic map and review | 2015 |
De Magalhães , C. V. C.; Da Silva, F. Q. B.; Santos, R. E. S.; Suassuna, M. | Investigations about replication of empirical studies in software engineering: A systematic mapping study | 2015 |
Horvath, R.; Nedbal, D.; Stieninger, M. | A literature review on challenges and effects of software defined networking | 2015 |
Saide; Mahendrawathi, E. R. | Knowledge management support for enterprise resource planning implementation | 2015 |
Eyers, D. R.; Potter, A. T. | E-commerce channels for additive manufacturing: An exploratory study | 2015 |
Abdelmabou, A.; Jawawi, D. N. A.; Ghani, I.; Elsafi, A. | A comparative evaluation of cloud migration optimization approaches: A systematic literature review | 2015 |
Tüzün, E.; Tekinerdogan, B. | Analyzing impact of experience curve on ROI in the software product line adoption process | 2015 |
Díaz, O.; Arellano, C. | The augmented web: Rationales, opportunities, and challenges on browser-side transcoding | 2015 |
Petersen, K.; Vakkalanka, S.; Kuzniarz, L. | Guidelines for conducting systematic mapping studies in software engineering: An update | 2015 |
Svahnberg, M.; Gorschek, T.; Nguyen, T. T. L.; Nguyen, M. | Uni-REPM: A framework for requirements engineering process assessment | 2015 |
Seufert, S.; Stanoevska-Slabeva, K.; Müller, S.; Scheffler, N. | The design of personal learning environments (PLE) with scope on information literacy in high school | 2015 |
Niazi, M. | A comparative study of software process improvement implementation success factors | 2015 |
Ampatzoglou, A.; Ampatzoglou, A.; Chatzigeorgiou, A.; Avgeriou, P. | The financial aspect of managing technical debt: A systematic literature review | 2015 |
Imam, A. A.; Basri, S.; Ahmad, R. | Data synchronization between mobile devices and server-side databases: A systematic literature review | 2015 |
Cremona, L.; Ravarini, A.; Sutanto, J. | KMS in a cluster of firms: The role of a digital platform | 2015 |
Bellisario, A.; Appolloni, A.; Ranalli, F. | Reviewing strategy matters to gain an understanding of balanced scorecard’s possible benefits within lean production contexts: A management control perspective | 2015 |
De Mello, R. M.; Travassos, G. H. | Characterizing sampling frames in software engineering surveys | 2015 |
Akhigbe, O.; Amyot, D.; Richards, G. | Information technology artifacts in the regulatory compliance of business processes: A meta-analysis | 2015 |
Lema, L.; Calvo-Manzano, J. -.; Colomo-Palacios, R.; Arcilla, M. | ITIL in small to medium-sized enterprises software companies: Towards an implementation sequence | 2015 |
Ravarini, A.; Cremona, L. | Digital platorms as knowledge artifacts for clusters of SMEs | 2015 |
Akkineni, H.; Lakshmi, P. V. S.; Babu, B. V. | Online crowds opinion-mining it to analyze current trend: A review | 2015 |
Jaramillo Franco, A. | Requirements elicitation approaches: A systematic review | 2015 |
Blignaut, A. S. | Infinite possibilities for using eyetracking for mobile serious games in order to improve user learning experiences | 2015 |
Theocharis, G.; Kuhrmann, M.; Münch, J.; Diebold, P. | Is water-scrum-fall reality? On the use of agile and traditional development practices | 2015 |
Abedin, B.; Babar, A.; Abbasi, A. | Characterization of the use of social media in natural disasters: A systematic review | 2015 |
Morente-Molinera, J. A.; Pérez, I. J.; Ureña , M. R.; Herrera-Viedma, E. | On multi-granular fuzzy linguistic modeling in group decision making problems: A systematic review and future trends | 2015 |
Schenkel, M.; Caniëls, M. C. J.; Krikke, H.; Van Der Laan, E. | Understanding value creation in closed loop supply chains - Past findings and future directions | 2015 |
Elbattah, M.; Molloy, O. | Towards improving modeling and simulation of clinical pathways: Lessons learned and future insights | 2015 |
Nawi, H. S. A.; Ibrahim, O.; Shukor, N. S. A.; Omar, S. F.; Ishak, I. S.; Rahman, A. A. | Understanding sustainability: An exploration of the is literature | 2015 |
Matalonga, S.; Rodrigues, F.; Travassos, G. H. | Matching context aware software testing design techniques to ISO/IEC/IEEE 29119 | 2015 |
Koç, H. | Methods in designing and developing capabilities: A systematic mapping study | 2015 |
Rahim, N. H. A.; Hamid, S.; Kiah, L. M.; Shamshirband, S.; Furnell, S. | A systematic review of approaches to assessing cybersecurity awareness | 2015 |
Pelone, F.; Kringos, D. S.; Romaniello, A.; Archibugi, M.; Salsiri, C.; Ricciardi, W. | Primary care efficiency measurement using data envelopment analysis: a systematic review | 2015 |
Azarm-Daigle, M.; Kuziemsky, C.; Peyton, L. | A review of cross organizational healthcare data sharing | 2015 |
Shawky, D.; Badawi, A.; Said, T.; Hozayin, R. | Affordances of computer-supported collaborative learning platforms: A systematic review | 2015 |
Cruz, S.; Da Silva, F. Q. B.; Capretz, L. F. | Forty years of research on personality in software engineering: A mapping study | 2015 |
Nye, B. D. | Intelligent tutoring systems by and for the developing world: A review of trends and approaches for educational technology in a global context | 2015 |
Carroll, N.; Helfert, M. | Service capabilities within open innovation: Revisiting the applicability of capability maturity models | 2015 |
Malhotra, R. | A systematic review of machine learning techniques for software fault prediction | 2015 |
Selleri Silva, F.; Soares, F. S. F.; Peres, A. L.; Azevedo, I. M. D.; Vasconcelos, A. P. L. F.; Kamei, F. K.; Meira, S. R. D. L. | Using CMMI together with agile software development: A systematic review | 2015 |
Tiwari, S.; Gupta, A. | A systematic literature review of use case specifications research | 2015 |
Panahifar, F.; Heavey, C.; Byrne, P. J.; Fazlollahtabar, H. | A framework for Collaborative Planning, Forecasting and Replenishment (CPFR): State of the Art | 2015 |
Idri, A.; Amazal, F. A.; Abran, A. | Analogy-based software development effort estimation: A systematic mapping and review | 2015 |
Nguyen, P. H.; Kramer, M.; Klein, J.; Traon, Y. L. | An extensive systematic review on the Model-Driven Development of secure systems | 2015 |
Brhel, M.; Meth, H.; Maedche, A.; Werder, K. | Exploring principles of user-centered agile software development: A literature review | 2015 |
Mohanarajah, S.; Jabar, M. A. | An improved adaptive and dynamic hybrid agile methodology to enhance software project success deliveries | 2015 |
Rights and permissions
About this article
Cite this article
Krüger, J., Lausberger, C., von Nostitz-Wallwitz, I. et al. Search. Review. Repeat? An empirical study of threats to replicating SLR searches. Empir Software Eng 25, 627–677 (2020). https://doi.org/10.1007/s10664-019-09763-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10664-019-09763-0