Skip to main content
SpringerLink
Log in

Data-Driven Soft Sensor Model Based on Deep Learning for Quality Prediction of Industrial Processes

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Fermentation process is a time-varying, nonlinear and multivariable dynamic coupling system. Therefore, it is difficult to directly measure the key biological variables using traditional physical sensors during the process of fermentation, which makes the monitoring and real-time control impossible. To resolve this problem, a data-driven soft sensor modeling method based on deep neural network (DNN) is proposed in this paper. This method is suitable for large amount of data and it enjoys high efficiency and robustness. At the same time, an adaptive moment estimation (Adam) algorithm is used to optimize the hyper-parameters of the DNN model, which is a technique for efficient stochastic optimization that only requires first-order gradients with little memory requirement. The consistent correlation method is used to determine the auxiliary variables of the soft sensor model. The penicillin and l-lysine fermentation processes are taken as the research object, substrate concentration, cell concentration, and product concentration are selected as a target variable. The performance of established soft sensor model is evaluated through the indexes of mean square error (MSE), root-mean-square error (RMSE), and mean absolute error (MAE). The simulation results show that the prediction performance of the soft sensor model based on DNN-Adam is good and compared with model based on stochastic gradient descent (SGD) with momentum optimization algorithm. It is verified that the proposed method can make a more accurate real-time prediction of quality variables in the fermentation process, and it has higher prediction accuracy than DNN-SGD method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Kadlec P, Gabrys B, Strandt S. Data-driven soft sensors in the process industry. Comput Chem Eng. 2009;33(4):795–814.

    Article  Google Scholar 

  2. Chéruy A. Software sensors in bioprocess engineering. J Biotechnol. 1997;52(3):193–9.

    Article  Google Scholar 

  3. Luttmann R, Bracewell DG, Cornelissen G, Gernaey KV, Glassey J, Hass VC, Kaiser C, Preusse C, Striedner G, Mandenius CF. Soft sensors in bioprocessing: a status report and recommendations. Biotechnol J. 2012;7(8):1040–8.

    Article  Google Scholar 

  4. Randek J, Mandenius C-F. On-line soft sensing in upstream bioprocessing. Crit Rev Biotechnol. 2018;38(1):106–21.

    Article  Google Scholar 

  5. Zhu X, Rehman KU, Wang B, Shahzad M. Modern soft-sensing modeling methods for fermentation processes. Sensors. 2020;20(6):1771.

    Article  Google Scholar 

  6. Nasr N, Hafez H, El Naggar MH, Nakhla G. Application of artificial neural networks for modeling of biohydrogen production. Int J Hydrogen Energy. 2013;38(8):3189–95.

    Article  Google Scholar 

  7. Sivapathasekaran C, Sen R. Performance evaluation of an ANN–GA aided experimental modeling and optimization procedure for enhanced synthesis of marine biosurfactant in a stirred tank reactor. J Chem Technol Biotechnol. 2013;88(5):794–9.

    Article  Google Scholar 

  8. Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273–97.

    MATH  Google Scholar 

  9. Wang B, Sun Y, Ji X, Huang Y, Ji L, Huang L. Soft-sensor modeling for lysine fermentation processes based on PSO-SVM inversion. CIESC J. 2012;63(9):3000–7.

    Google Scholar 

  10. Gu Y, Zhao W, Wu Z. Least squares support vector machine algorithm [J]. J Tsinghua Univ (Sci Technol). 2010;7:1063–6.

    MathSciNet  MATH  Google Scholar 

  11. Ou Yang H-B, Li S, Zhang P, Kong X. Model penicillin fermentation by least squares support vector machine with tuning based on amended harmony search. Int J Biomath. 2015;8(03):1550037.

    Article  MathSciNet  Google Scholar 

  12. Kresta J, Marlin T, MacGregor J. Development of inferential process models using PLS. Comput Chem Eng. 1994;18(7):597–611.

    Article  Google Scholar 

  13. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, 2012. pp 1097–1105

  14. Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. arXiv preprint; 2013. arXiv:1301.3781

  15. Qian N. On the momentum term in gradient descent learning algorithms. Neural Networks. 1999;12(1):145–51.

    Article  Google Scholar 

  16. Sutton R. Two problems with back propagation and other steepest descent learning procedures for networks. In: Proceedings of the Eighth Annual Conference of the Cognitive Science Society, 1986, 1986. pp 823–832

  17. Tieleman T, Hinton G. Lecture 6.5-rmsprop, coursera: Neural networks for machine learning. University of Toronto, Technical Report; 2012

  18. Kingma DP, Ba J. Adam: A method for stochastic optimization. arXiv preprint; 2014. arXiv:1412.6980

  19. Lin Y, Yan W Study of soft sensor modeling based on deep learning. In: 2015 American Control Conference (ACC), 2015. IEEE, pp 5830–5835

  20. Hinton GE, Osindero S, Teh Y-W. A fast learning algorithm for deep belief nets. Neural Comput. 2006;18(7):1527–54.

    Article  MathSciNet  Google Scholar 

  21. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks. 1991;4(2):251–7.

    Article  MathSciNet  Google Scholar 

  22. Plaut D, Nowlan S, Hinton G. Experiments on learning by back propagation. Computer Science Department Carnegie-Mellon University Pittsburgh; 1986.

  23. Chollet F. Deep learning mit Python und Keras: Das Praxis-Handbuch vom Entwickler der Keras-Bibliothek. Wachtendonk: MITP-Verlags GmbH & Co; 2018.

    Google Scholar 

  24. Wang B, Shahzad M, Zhu X, Rehman KU, Uddin S. A non-linear model predictive control based on grey-wolf optimization using least-square support vector machine for product concentrationcontrol in l-lysine fermentation. Sensors. 2020;20:3335.

    Article  Google Scholar 

  25. Wang B, Shahzad M, Zhu X, et al. Soft-sensor modeling for L-lysine fermentation process based on hybrid ICS-MLSSVM. Sci Rep. 2020;10:11630.

    Article  Google Scholar 

Download references

Acknowledgements

The National Science Research Foundation of China (41376175), The Natural Science Foundation of Jiangsu Province (BK20140568, BK20151345), and a project funded by the priority academic program development of Jiangsu higher education institutions (PAPD).

Author information

Authors and Affiliations

  1. School of Electrical and Information Engineering, Jiangsu University, Zhenjiang, 212013, Jiangsu, China

    Xianglin Zhu, Khalil Ur Rehman, Wang Bo & Muhammad Shahzad

  2. School of Computer and Information Engineering, Jiangxi Normal University, Nanchang, 330022, China

    Ahmad Hassan

Authors
  1. Xianglin Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Khalil Ur Rehman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wang Bo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Muhammad Shahzad
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ahmad Hassan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Khalil Ur Rehman.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, X., Rehman, K.U., Bo, W. et al. Data-Driven Soft Sensor Model Based on Deep Learning for Quality Prediction of Industrial Processes. SN COMPUT. SCI. 2, 40 (2021). https://doi.org/10.1007/s42979-020-00440-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-020-00440-4

Keywords

Search

Navigation