Abstract
Academic literature on machine learning modeling fails to address how to make machine learning models work for enterprises. For example, existing machine learning processes cannot address how to define business use cases for an AI application, how to convert business requirements from product managers into data requirements for data scientists, and how to continuously improve AI applications in term of accuracy and fairness, how to customize general purpose machine learning models with industry, domain, and use case specific data to make them more accurate for specific situations etc. Making AI work for enterprises requires special considerations, tools, methods and processes. In this paper we present a maturity framework for machine learning model lifecycle management for enterprises. Our framework is a re-interpretation of the software Capability Maturity Model (CMM) for machine learning model development process. We present a set of best practices from authors’ personal experience of building large scale real-world machine learning models to help organizations achieve higher levels of maturity independent of their starting point.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Humphrey, W.S.: Characterizing the software process: a maturity framework. IEEE Softw. 5(2), 73–79 (1988)
Braun, H.T.: Evaluation of big data maturity models–a benchmarking study to support big data maturity assessment in organizations (2015)
Halper, F., Krishnan, K.: TDWi big data maturity model guide. Interpreting your assessment score. TDWI Research 1, 16 (2013)
Nott, C.: A maturity model for big data and analytics. IBM (2015). https://www.ibm.com/developerworks/community/blogs/bigdataanalytics/entry/A_maturity_model_for_big_data_and_analytics?lang=en_us
Schmarzo, B.: Big data business model maturity index guide. Dell EMC (2016). https://infocus.dellemc.com/william_schmarzo/big-data-business-model-maturity-index-guide/
Dhanuka, V.: Hortonworks big data maturity model. Hortonworks (2017). http://hortonworks.com/wp-content/uploads/2016/04/Hortonworks-Big-Data-Maturity-Assessment.pdf
El-Darwiche, B., Koch, V., Meer, D., Shehadi, R.T., Tohme, W.: Big data maturity: an action plan for policymakers and executives. Glob. Inf. Technol. Rep. 43, 51 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendix A
Appendix A
A snippet of our Machine Learning Maturity Framework is attached below. A more detailed one could not be attached due to space limitations but will be made available upon request or posted on the company website shortly.
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Akkiraju, R. et al. (2020). Characterizing Machine Learning Processes: A Maturity Framework. In: Fahland, D., Ghidini, C., Becker, J., Dumas, M. (eds) Business Process Management. BPM 2020. Lecture Notes in Computer Science(), vol 12168. Springer, Cham. https://doi.org/10.1007/978-3-030-58666-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-58666-9_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-58665-2
Online ISBN: 978-3-030-58666-9
eBook Packages: Computer ScienceComputer Science (R0)