Skip to main content

Active Learning Approach for Safe Process Parameter Tuning

  • Conference paper
  • First Online:
Machine Learning, Optimization, and Data Science (LOD 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11943))

Abstract

The amount of sensor data in industry increases dramatically due to the digitization of plants and the Industrial Internet of Things (IIoT) evolution. This rapid technological revolution creates new opportunities in intelligent automation, but also challenges. As the complexity of the manufacturing processes increases accordingly, it becomes increasingly difficult to understand how a process is affected by physical conditions, not to mention optimizing process parameters with traditional methods.

In order to deal with the latter problem, an active learning approach is presented that can be used during production processes and that guarantees a user-defined minimum performance during learning. Based on Gaussian processes it is also possible to contribute already existing domain expertise to the learning process. We demonstrate that an additional solid expertise prevents an increase in the risk of failure throughout the automated optimization process.

With the proposed method manufacturers are able to evaluate their expertise based policy or even gain further knowledge about correlations by made performance improvements. The approach is generic and suitable for applications in mass production or frequently recurring tasks. Since the test results are promising, the next step is to create initial industrial prototypes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Akametalu, A.K., Fisac, J.F., Gillula, J.H., Kaynama, S., Zeilinger, M.N., Tomlin, C.J.: Reachability-based safe learning with Gaussian processes. In: 53rd IEEE Conference on Decision and Control, pp. 1424–1431. IEEE (2014)

    Google Scholar 

  2. Audet, C., Denni, J., Moore, D., Booker, A., Frank, P.: A surrogate-model-based method for constrained optimization. In: 8th Symposium on Multidisciplinary Analysis and Optimization, p. 4891 (2000)

    Google Scholar 

  3. Berkenkamp, F., Krause, A., Schoellig, A.P.: Bayesian optimization with safety constraints: safe and automatic parameter tuning in robotics. arXiv preprint arXiv:1602.04450 (2016)

  4. Berkenkamp, F., Schoellig, A.P., Krause, A.: Safe controller optimization for quadrotors with Gaussian processes. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 491–496. IEEE (2016)

    Google Scholar 

  5. Chatzilygeroudis, K., Vassiliades, V., Stulp, F., Calinon, S., Mouret, J.B.: A survey on policy search algorithms for learning robot controllers in a handful of trials. arXiv preprint arXiv:1807.02303 (2018)

  6. Fisac, J.F., Akametalu, A.K., Zeilinger, M.N., Kaynama, S., Gillula, J., Tomlin, C.J.: A general safety framework for learning-based control in uncertain robotic systems. IEEE Trans. Autom. Control 64(7), 2737–2752 (2019). https://doi.org/10.1109/TAC.2018.2876389

    Article  MathSciNet  MATH  Google Scholar 

  7. GPy: a Gaussian process framework in Python (2012). http://github.com/SheffieldML/GPy

  8. Jones, D.R., Schonlau, M., Welch, W.J.: Efficient global optimization of expensive black-box functions. J. Glob. Optim. 13(4), 455–492 (1998)

    Article  MathSciNet  Google Scholar 

  9. Krause, A., Ong, C.S.: Contextual Gaussian process bandit optimization. In: Advances in Neural Information Processing Systems (NIPS), pp. 2447–2455 (2011)

    Google Scholar 

  10. Mockus, J.: Bayesian Approach to Global Optimization: Theory and Applications, vol. 37. Springer, Heidelberg (2012)

    MATH  Google Scholar 

  11. Rasmussen, C.E., Williams, C.: Gaussian Processes for Machine Learning, vol. 1. MIT press, Cambridge (2006). 39, 40–43

    MATH  Google Scholar 

  12. Sacks, J., Welch, W.J., Mitchell, T.J., Wynn, H.P.: Design and analysis of computer experiments. Stat. Sci. 4, 409–423 (1989)

    Article  MathSciNet  Google Scholar 

  13. Settles, B.: Active learning literature survey. Computer Sciences Technical report 1648, University of Wisconsin-Madison Department of Computer Sciences (2009)

    Google Scholar 

  14. Shen, W., Hao, Q., Yoon, H.J., Norrie, D.H.: Applications of agent-based systems in intelligent manufacturing: an updated review. Adv. Eng. Inf. 20(4), 415–431 (2006)

    Article  Google Scholar 

  15. Sui, Y., Gotovos, A., Burdick, J., Krause, A.: Safe exploration for optimization with Gaussian processes. In: International Conference on Machine Learning, pp. 997–1005 (2015)

    Google Scholar 

  16. Vu, K.K., D’Ambrosio, C., Hamadi, Y., Liberti, L.: Surrogate-based methods for black-box optimization. Int. Trans. Oper. Res. 24(3), 393–424 (2017)

    Article  MathSciNet  Google Scholar 

  17. Wang, Z., Zoghi, M., Hutter, F., Matheson, D., De Freitas, N.: Bayesian optimization in high dimensions via random embeddings. In: Twenty-Third International Joint Conference on Artificial Intelligence, pp. 1778–1784 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stefano De Blasi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

De Blasi, S. (2019). Active Learning Approach for Safe Process Parameter Tuning. In: Nicosia, G., Pardalos, P., Umeton, R., Giuffrida, G., Sciacca, V. (eds) Machine Learning, Optimization, and Data Science. LOD 2019. Lecture Notes in Computer Science(), vol 11943. Springer, Cham. https://doi.org/10.1007/978-3-030-37599-7_57

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-37599-7_57

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-37598-0

  • Online ISBN: 978-3-030-37599-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics