skip to main content
10.1145/3084226.3084261acmotherconferencesArticle/Chapter ViewAbstractPublication PageseaseConference Proceedingsconference-collections
research-article

On the Use of Ontologies in Software Process Assessment: A Systematic Literature Review

Published: 15 June 2017 Publication History

Abstract

Software process assessment (SPA) is the foundation step for software process improvement. ISO/IEC 15504 defines the term process assessment as "the systematic evaluation of an organization's processes against a process reference model (PRM)". In process assessment, there is a need to set and maintain a mapping between an organization's processes and a PRM, where process experts transform the gap between the two into opportunities for process improvement. To maintain such a mapping requires a continuous tracking and alignment between the organization's processes and the PRM(s). The use of ontologies might be a suitable solution to provide computerized tool support for SPA that becomes erroneous and time-consuming if done manually. With an aim to understand the use and usefulness of ontologies in SPA, in this study, we have performed a systematic literature review (SLR). We have searched the most known digital libraries and selected 14 studies out of 54 initially selected and 571 initially retrieved. We analyzed the selected studies with respect to a number of research questions that address; contribution facet, targeted software processes, research facet, process improvement model used, process assessment model used, ontology representation language, purpose of ontology use, qualitative and quantitative benefits reported, and challenges faced. As a result, we synthesized a conceptual model of ontology-based support in SPA. We hope the results of our work will be useful for researchers and practitioners to direct their future studies on the use of ontologies for SPA.

References

[1]
Humphrey WS (1995) A Discipline for Software Engineering. Addison-Wesley Longman Publishing Co., Inc.
[2]
ISO/IEC (2004) ISO/IEC 15504-1:2004 Information technology --- Process assessment --- Part 1: Concepts and vocabulary.
[3]
ISO/IEC (2015) ISO/IEC 33001:2015 Information technology -- Process assessment -- Concepts and terminology.
[4]
CMU/SEI Capability Maturity Model Integration for Development v1.3, CMU/SEI-2010-TR-033.
[5]
ISO/IEC (2008) ISO/IEC 12207: Systems and software engineering - Software life cycle processes.
[6]
Feloni DFG, Braga RTV (2015) Methodologies for Evaluation and Improvement of Software Processes in the Context of Quality and Maturity Models: a Systematic Mapping. In: 18th Ibero Am. Conf. Softw. Eng. pp 1--14
[7]
Mora M, Cervantes-Pérez F, Garrido L, et al (2010) On KM, KMS and ontology-based KMS in the domain of SwE standards and models of processes: A conceptual survey. Intell Decis Technol 4:75--98.
[8]
EBSE (2007) Guidelines for performing Systematic Literature Reviews in Software Engineering, Version 2.3, EBSE-2007-01.
[9]
ISO/IEC (2015) ISO/IEC 33014:2015 Information technology -- Process assessment -- Guide for process improvement.
[10]
ISO/IEC (2012) ISO/IEC 15504-5:2012 Information technology --- Process Assessment --- Part 5: An exemplar Process Assessment Model.
[11]
SCAMPI Team (2011) Standard CMMI Appraisal Method for Process Improvement (SCAMPI) A, Ver.1.3.
[12]
SCAMPI Team (2011) Appraisal Requirements for CMMI, Version 1.3 (ARC, V1.3), CMU/SEI-2011-TR-006.
[13]
ISO/IEC (2003) ISO/IEC 15504-2:2003 Information technology --- Process assessment --- Part 2: Performing an assessment.
[14]
ISO/IEC (2004) ISO/IEC 15504-3:2004 Information technology --- Process assessment --- Part 3: Guidance on performing an assessment.
[15]
Leung HKN, Liao L, Qu Y (2007) Automated support of software quality improvement. Int J Qual Reliab Manag 24:230--243.
[16]
Gazel S, Sezer EA, Tarhan A (2012) An ontology based infrastructure to support CMMI-based software process assessment. Gazi Univ J Sci 25:155--164.
[17]
Tarhan A, Turetken O, Ilisulu F (2015) Business Process Maturity Assessment: State of the Art and Key Characteristics. 2015 41st Euromicro Conf Softw Eng Adv Appl 430--437.
[18]
Apprasial Assistant. https://www.sqi.griffith.edu.au/AppraisalAssistant/about.html. Accessed 31 Jan 2017
[19]
CMMiPal. http://chemuturi.com/pmpal/MSI-CMMiPal.html. Accessed 31 Jan 2017
[20]
CMM-Quest v1.3. http://www.cmm-quest.com/cms/en/. Accessed 31 Jan 2017
[21]
SPiCE 1-2-1. http://www.spice121.com/cms/en/. Accessed 31 Jan 2017
[22]
{Online} SPiCE-Lite. http://www.spicelite.com/cms/en/. Accessed 31 Jan 2017
[23]
{Online} Appraisal Wizard. http://isd-inc.com/tools.appraisalWizard/. Accessed 31 Jan 2017
[24]
Gruber TR (1993) A Translation Approach to Portable Ontology Specifications. Knowl Acquis 5:199--220.
[25]
Borst WN (1997) Construction of engineeriing ontologies for knowledge sharing and reuse.
[26]
Studer R, Benjamins VR, Fensel D (1998) Knowledge engineering: Principles and methods. Data Knowl Eng 25:161--197.
[27]
Rungratri S, Usanavasin S (2008) Project Assets Ontology (PAO) to support gap analysis for organization process improvement based on CMMI v.1.2. In: ICSP 2008, Lect. Notes Comput. Sci. pp 76--87
[28]
Guarino N, Oberle D and, Staab S (2009) What is an Ontology? In: Handb. Ontol. Part Ser. Int. Handbooks Inf. Syst. pp 1--17
[29]
W3C (2012) OWL 2 - Web Ontology Language Primer (Second Edition), W3C Recommendation.
[30]
Zhao Y, Dong J, Peng T (2009) Ontology Classification for Semantic Web Based Software Engineering. Science (80-) 2:303--317.
[31]
Ruiz F, Hilera JR (2006) Using Ontologies in Software Engineering and Technology. Ontol Softw Eng Softw Technol 49--102.
[32]
Fitsilis P, Gerogiannis V, Anthopoulos L (2014) Ontologies for Software Project Management: A Review. 1096--1110.
[33]
Zualkernan IA (2008) An ontology driven approach for generating assessments for the SCRUM software process. In: New Trends Softw. Methodol. Tools Tech. (Proceedings 7th SoMeT). pp 190--205
[34]
Bourque P and, Fairley RE (2014) Guide to the Software Engineering Body of Knowledge (SWEBOK), Version 3.0. IEEE Computer Society
[35]
Wieringa R, Maiden N, Mead N, Rolland C (2006) Requirements engineering paper classification and evaluation criteria: A proposal and a discussion. Requir Eng 11:102--107.
[36]
Webster J, Watson RT (2002) Analyzing the past to prepare for the future: writing a literature review. MIS Q 26:xiii--xxiii.
[37]
Daconta MC, Smith KT, Obrst LJ (2003) The Semantic Web: A Guide to the Future of XML, Web Services, and Knowledge Management, 1st ed. John Wiley & Sons, Inc., New York, NY, USA
[38]
Liao L, Qu Y, Leung HKN (2005) A Software Process Ontology and Its Application. In: Work. Semant. Web Enabled Softw. Eng. pp 1--10
[39]
Liao L, Qu Y, Leung H (2005) An Ontology-based Approach to Express Software Processes. ISFST 2005
[40]
Soydan GH, Kokar MM (2006) An OWL Ontology for Representing the CMMI-SW Model. In: Int. Work. ofn Semant. Web Enabled Softw. Eng. SWEESE 2006. p 14
[41]
Ryu H, Ryu DK, Baik J (2008) A strategic test process improvement approach using an ontological description for MND-TMM. In: 7th IEEE/ACIS Int. Conf. Comput. Inf. Sci. conjunction with 2nd IEEE/ACIS Int. Work. e-Activity, IEEE/ACIS IWEA. pp 561--566
[42]
Lee CS, Wang MH, Chen JJ, Hsu CY (2008) Ontology-based intelligent decision support agent for CMMI project monitoring and control. Int J Approx Reason 48:62--76.
[43]
Gazel S, Tarhan A, Sezer E (2009) A CMMI Ontology for an Ontology-Based Software Process Assessment Tool. In: Proc. EuroSPI2 Conf. DELTA Series About Process Improvement (ISBN: 978-87-7398-151-1), p 9.1--9.7
[44]
Lee CS, Wang MH (2009) Ontology-based computational intelligent multi-agent and its application to CMMI assessment. Appl Intell 30:203--219.
[45]
Štolfa S, Kožusznik J, Košinár M, et al (2010) Building process definition with ontology background. In: Int. Conf. Comput. Inf. Syst. Ind. Manag. Appl. pp 328--334
[46]
Soydan GH, Kokar MM (2012) A Partial Formalization of the CMMI-DEV --- A Capability Maturity Model for Development. 2012:777--788.
[47]
Grambow G, Oberhauser R, Reichert M (2012) Towards Automated Process Assessment in Software Engineering. In: 7th International Conf. Softw. Eng. Adv. Lisbon, p paper 862
[48]
Grambow G (2013) Automated Software Engineering Process Assessment: Supporting Diverse Models using an Ontology. Int J Adv Softw 6 (1 & 2):213--224.
[49]
Kabaale E, Wen L, Wang Z, Rout T (2016) Representing software process in description logics: An ontology approach for software process reasoning and verification. In: 16th Int. SPICE Conf. Commun. Comput. Inf. Sci. pp 362--376

Cited By

View all
  • (2024)An Ontology Based Approach to the Software Engineering Lifecycle: Application to Software Quality Assurance in the Aerospace IndustrySSRN Electronic Journal10.2139/ssrn.4703235Online publication date: 2024
  • (2024)Risk Assessment Method of Software Development Process Based on D-S TheoryProceedings of the 13th International Conference on Computer Engineering and Networks10.1007/978-981-99-9243-0_18(166-174)Online publication date: 2-Feb-2024
  • (2023)On the use of deep learning in software defect predictionJournal of Systems and Software10.1016/j.jss.2022.111537195:COnline publication date: 1-Jan-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
EASE '17: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering
June 2017
405 pages
ISBN:9781450348041
DOI:10.1145/3084226
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • School of Computing, BTH: Blekinge Institute of Technology - School of Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Software process
  2. ontology
  3. process assessment
  4. systematic literature review

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

EASE'17

Acceptance Rates

Overall Acceptance Rate 71 of 232 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)1
Reflects downloads up to 23 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)An Ontology Based Approach to the Software Engineering Lifecycle: Application to Software Quality Assurance in the Aerospace IndustrySSRN Electronic Journal10.2139/ssrn.4703235Online publication date: 2024
  • (2024)Risk Assessment Method of Software Development Process Based on D-S TheoryProceedings of the 13th International Conference on Computer Engineering and Networks10.1007/978-981-99-9243-0_18(166-174)Online publication date: 2-Feb-2024
  • (2023)On the use of deep learning in software defect predictionJournal of Systems and Software10.1016/j.jss.2022.111537195:COnline publication date: 1-Jan-2023
  • (2023)A decade of code comment quality assessmentJournal of Systems and Software10.1016/j.jss.2022.111515195:COnline publication date: 1-Jan-2023
  • (2022)A software engineering perspective on engineering machine learning systemsJournal of Systems and Software10.1016/j.jss.2021.111031180:COnline publication date: 22-Apr-2022
  • (2022)Applications of deep learning for phishing detection: a systematic literature reviewKnowledge and Information Systems10.1007/s10115-022-01672-x64:6(1457-1500)Online publication date: 1-Jun-2022
  • (2022)Applications of deep learning for mobile malware detection: A systematic literature reviewNeural Computing and Applications10.1007/s00521-021-06597-034:2(1007-1032)Online publication date: 1-Jan-2022
  • (2021)Ontologies in human–computer interactionApplied Ontology10.3233/AO-21025516:4(421-452)Online publication date: 5-Nov-2021
  • (2021)A Proposal for a Software Tool to Perform Business Process Smart Assessment in EnterprisesIFAC-PapersOnLine10.1016/j.ifacol.2021.08.10754:1(900-905)Online publication date: 2021
  • (2020)Bad Smell Detection Using Machine Learning Techniques: A Systematic Literature ReviewArabian Journal for Science and Engineering10.1007/s13369-019-04311-w45:4(2341-2369)Online publication date: 7-Jan-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media