Abstract
Soft sensors are widely used to predict quality variables which are usually hard to measure. It is necessary to construct an adaptive model to cope with process non-stationaries. In this study, a novel quality-related locally weighted soft sensing method is designed for non-stationary processes based on a Bayesian network with latent variables. Specifically, a supervised Bayesian network is proposed where quality-oriented latent variables are extracted and further applied to a double-layer similarity measurement algorithm. The proposed soft sensing method tries to find a general approach for non-stationary processes via quality-related information where the concepts of local similarities and window confidence are explained in detail. The performance of the developed method is demonstrated by application to a numerical example and a debutanizer column. It is shown that the proposed method outperforms competitive methods in terms of the accuracy of predicting key quality variables.
摘要
在工业过程中, 软测量技术被广泛用于预测难以测量的质量变量. 构建一个应对过程非平稳性的自适应模型非常必要. 本文针对非平稳过程, 设计了一种基于含有隐变量贝叶斯网络的质量相关局部加权软测量方法. 提出一种有监督贝叶斯网络提取质量相关的隐变量, 并应用于一种双层相似度测量算法. 所提软测量方法试图通过质量相关信息为非平稳过程寻找到一般方法, 且详细解释了局部相似度和窗口置信度的概念. 通过一个数值算例和脱丁烷塔的应用验证了所提方法的性能. 结果表明所提方法预测关键质量变量的精确度优于竞争方法.
Similar content being viewed by others
References
Al-Jlibawi A, Othman MLB, Al-Huseiny MS, et al., 2019. Efficient soft sensor modelling for advanced manufacturing systems by applying hybrid intelligent soft computing techniques. Int J Simul Syst Sci Technol, 19(3): 15.1–15.7. https://doi.org/10.5013/IJSSST.a.19.03.15
Atkeson CG, Moore AW, Schaal S, 1997. Locally weighted learning. In: Aha DW (Ed.), Lazy Learning. Springer, Dordrecht, p.11–73. https://doi.org/10.1007/978-94-017-2053-3_2
Ben-Gal I, 2008. Bayesian networks. In: Ruggeri F, Kenett RS, Faltin FW (Eds.), Encyclopedia of Statistics in Quality and Reliability. John Wiley & Sons, Chichester, p.1. https://doi.org/10.1002/9780470061572.eqr089
Bidar B, Sadeghi J, Shahraki F, et al., 2017. Data-driven soft sensor approach for online quality prediction using state dependent parameter models. Chemom Intell Lab Syst, 162:130–141. https://doi.org/10.1016/j.chemolab.2017.01.004
Bishop CM, 1998. Latent variable models. In: Jordan MI (Ed.), Learning in Graphical Models. MIT Press, Cambridge, p.371–403.
Cain C, 2016. Modelling latent variables for Bayesian networks. Undergraduate Research Symp. Available from https://digitalcommons.morris.umn.edu/urs_2016/2/
Chang SY, Baughman EH, McIntosh BC, 2001. Implementation of locally weighted regression to maintain calibrations on FT-NIR analyzers for industrial processes. Appl Spectrosc, 55(9):1199–1206. https://doi.org/10.1366/0003702011953207
Chen GF, Yu HL, 2007. Bayesian network and its application in maize diseases diagnosis. Proc Int Conf on Computer and Computing Technologies in Agriculture, p.917–924. https://doi.org/10.1007/978-0-387-77253-0_22
Fortuna L, Graziani S, Rizzo A, et al., 2007. Soft Sensors for Monitoring and Control of Industrial Processes. Springer, London, UK. https://doi.org/10.1007/978-1-84628-480-9
Frank E, Trigg L, Holmes G, et al., 2000. Technical note: naive Bayes for regression. Mach Learn, 41(1):5–25. https://doi.org/10.1023/A:1007670802811
Frank E, Hall M, Pfahringer B, 2002. Locally weighted naive Bayes. Proc 19th Conf on Uncertainty in Artificial Intelligence, p.249–256.
Ge ZQ, 2016. Supervised latent factor analysis for process data regression modeling and soft sensor application. IEEE Trans Contr Syst Technol, 24(3):1004–1011. https://doi.org/10.1109/TCST.2015.2473817
Ge ZQ, 2018. Process data analytics via probabilistic latent variable models: a tutorial review. Ind Eng Chem Res, 57(38):12646–12661. https://doi.org/10.1021/acs.iecr.8b02913
Ge ZQ, Song ZH, Ding SX, et al., 2017. Data mining and analytics in the process industry: the role of machine learning. IEEE Access, 5:20590–20616. https://doi.org/10.1109/ACCESS.2017.2756872
Geiger D, Heckerman D, 1994. Learning Gaussian networks. In: de Mantaras RL, Poole D (Eds.), Uncertainty in Artificial Intelligence: Proceedings of the Tenth Conference (1994). Morgan Kaufmann Publishers, California, USA, p.235–243. https://doi.org/10.1016/B978-1-55860-332-5.50035-3
Jiang LX, Cai ZH, Zhang H, et al., 2013. Naive Bayes text classifiers: a locally weighted learning approach. J Exp Theor Artif Intell, 25(2):273–286. https://doi.org/10.1080/0952813X.2012.721010
Kadlec P, Gabrys B, Strandt S, 2009. Data-driven soft sensors in the process industry. Comput Chem Eng, 33(4):795–814. https://doi.org/10.1016/j.compchemeng.2008.12.012
Kadlec P, Grbić R, Gabrys B, 2011. Review of adaptation mechanisms for data-driven soft sensors. Comput Chem Eng, 35(1):1–24. https://doi.org/10.1016/j.compchemeng.2010.07.034
Kano M, Fujiwara K, 2012. Virtual sensing technology in process industries: trends and challenges revealed by recent industrial applications. J Chem Eng Jpn, 46(1):1–17. https://doi.org/10.1252/jcej.12we167
Kim JS, Jun CH, 2013. Ranking evaluation of institutions based on a Bayesian network having a latent variable. Knowl-Based Syst, 50:87–99. https://doi.org/10.1016/j.knosys.2013.05.010
Kim S, Okajima R, Kano M, et al., 2013. Development of soft-sensor using locally weighted PLS with adaptive similarity measure. Chemom Intell Lab Syst, 124:43–49. https://doi.org/10.1016/j.chemolab.2013.03.008
Li CQ, Jiang LX, Li HW, 2014. Naive Bayes for value difference metric. Front Comput Sci, 8(2):255–264. https://doi.org/10.1007/s11704-014-3038-5
Liu F, Xu DX, Yuan C, et al., 2006. Image segmentation based on Bayesian network-Markov random field model and its application to in vivo plaque composition. Proc 3rd IEEE Int Symp on Biomedical Imaging: Nano to Macro, p.141–144. https://doi.org/10.1109/ISBI.2006.1624872
Liu Q, Zhuo J, Lang ZQ, et al., 2018. Perspectives on data-driven operation monitoring and self-optimization of industrial processes. Acta Autom Sin, 44(11):1944–1956 (in Chinese). https://doi.org/10.16383/j.aas.2018.c180207
Liu ZW, Ge ZQ, Chen GJ, et al., 2018. Adaptive soft sensors for quality prediction under the framework of Bayesian network. Contr Eng Pract, 72:19–28. https://doi.org/10.1016/j.conengprac.2017.10.018
Masmoudi K, Abid L, Masmoudi A, 2019. Credit risk modeling using Bayesian network with a latent variable. Expert Syst Appl, 127:157–166. https://doi.org/10.1016/j.eswa.2019.03.014
Mohammadi A, Zarghami R, Lefebvre D, et al., 2019. Soft sensor design and fault detection using Bayesian network and probabilistic principal component analysis. J Adv Manuf Process, 1(4):e10027. https://doi.org/10.1002/amp2.10027
Montáns FJ, Chinesta F, Gómez-Bombarelli R, et al., 2019. Data-driven modeling and learning in science and engineering. Compt Rend Mécan, 347(11):845–855. https://doi.org/10.1016/j.crme.2019.11.009
Murphy KP, 2001. The Bayes net toolbox for Matlab. Comput Sci Stat, 33(2):1024–1034.
Nie SQ, Zheng M, Ji Q, 2018. The deep regression Bayesian network and its applications: probabilistic deep learning for computer vision. IEEE Signal Process Mag, 35(1): 101–111. https://doi.org/10.1109/MSP.2017.2763440
Shao WM, Tian XM, Wang P, 2015. Supervised local and non-local structure preserving projections with application to just-in-time learning for adaptive soft sensor. Chin J Chem Eng, 23(12):1925–1934. https://doi.org/10.1016/j.cjche.2015.11.012
Steurtewagen B, van den Poel D, 2020. Machine learning refinery sensor data to predict catalyst saturation levels. Comput Chem Eng, 134:106722. https://doi.org/10.1016/j.compchemeng.2020.106722
Tang H, Liu S, 2007. Basic theory of fuzzy Bayesian networks and its application in machinery fault diagnosis. Proc 4th Int Conf on Fuzzy Systems and Knowledge Discovery, p.132–137. https://doi.org/10.1109/FSKD.2007.202
Vallejo M, de la Espriella C, Gómez-Santamaría J, et al., 2019. Soft metrology based on machine learning: a review. Meas Sci Technol, 31(3):032001. https://doi.org/10.1088/1361-6501/ab4b39
Wang JB, Shao WM, Song ZH, 2019. Semi-supervised variational Bayesian student’s t mixture regression and robust inferential sensor application. Contr Eng Pract, 92: 104155. https://doi.org/10.1016/j.conengprac.2019.104155
Wu J, Wu B, Pan SR, et al., 2015. Locally weighted learning: how and when does it work in Bayesian networks? Int J Comput Intell Syst, 8(S1):63–74. https://doi.org/10.1080/18756891.2015.1129579
Yao L, Ge ZQ, 2017a. Locally weighted prediction methods for latent factor analysis with supervised and semisupervised process data. IEEE Trans Autom Sci Eng, 14(1): 126–138. https://doi.org/10.1109/TASE.2016.2608914
Yao L, Ge ZQ, 2017b. Moving window adaptive soft sensor for state shifting process based on weighted supervised latent factor analysis. Contr Eng Pract, 61:72–80. https://doi.org/10.1016/j.conengprac.2017.02.002
Yuan XF, Ge ZQ, Song ZH, 2014. Locally weighted kernel principal component regression model for soft sensing of nonlinear time-variant processes. Ind Eng Chem Res, 53(35):13736–13749. https://doi.org/10.1021/ie4041252
Yuan XF, Huang B, Ge ZQ, et al., 2016. Double locally weighted principal component regression for soft sensor with sample selection under supervised latent structure. Chemom Intell Lab Syst, 153:116–125. https://doi.org/10.1016/j.chemolab.2016.02.014
Yuan XF, Huang B, Wang YL, et al., 2018. Deep learning-based feature representation and its application for soft sensor modeling with variable-wise weighted SAE. IEEE Trans Ind Inform, 14(7):3235–3243. https://doi.org/10.1109/TII.2018.2809730
Author information
Authors and Affiliations
Contributions
Yuxue XU and Yuchen HE designed the research. Yuchen HE and Yun WANG processed the data. Yuchen HE, Tianhong YAN, Haiping DU, and Weihua LI drafted the manuscript. Jun WANG helped polish the language. De GU helped organize the manuscript. Yuxue XU and Yuchen HE revised and finalized the paper.
Corresponding authors
Ethics declarations
Yuxue XU, Yun WANG, Tianhong YAN, Yuchen HE, Jun WANG, De GU, Haiping DU, and Weihua LI declare that they have no conflict of interest.
Additional information
Project supported by the National Key Research and Development Program of China (No. 2016YFC0301404), the National Natural Science Foundation of China (Nos. 51379198 and 61903352), the Natural Science Foundation of Zhejiang Province, China (No. LQ19F030007), the Natural Science Foundation of Jiangsu Province, China (No. BK20180594), the Project of Department of Education of Zhejiang Province, China (No. Y202044960), the China Postdoctoral Science Foundation (No. 2020M671721), the Foundation of Key Laboratory of Advanced Process Control for Light Industry (No. APCLI1803), and the Fundamental Research Funds for the Provincial Universities of Zhejiang, China (Nos. 2021YW18 and 2021YW80)
Rights and permissions
About this article
Cite this article
Xu, Y., Wang, Y., Yan, T. et al. Quality-related locally weighted soft sensing for non-stationary processes by a supervised Bayesian network with latent variables. Front Inform Technol Electron Eng 22, 1234–1246 (2021). https://doi.org/10.1631/FITEE.2000426
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/FITEE.2000426