skip to main content
10.1145/3388818.3388823acmotherconferencesArticle/Chapter ViewAbstractPublication PagesivspConference Proceedingsconference-collections
research-article

Condition Monitoring for Confined Industrial Process Based on Infrared Images by Using Deep Neural Network and Variants

Published:18 May 2020Publication History

ABSTRACT

Some industrial processes take place in confined settings only observable by sensors, e.g. infrared (IR) cameras. Drying processes take place while a material is transported by means of a conveyor through a "black box" equipped with internal IR cameras. While such sensors deliver data at high rates, this is beyond what human operators can analyze and calls for automation. Inspired by numerous implementations monitoring techniques that analyse IR images using deep learning, this paper shows how they can be applied to the confined microwave drying of porous foams, with benchmarking their effectiveness at condition monitoring to conduct fault detection. Convolutional neural networks, derived transfer learning, and deep residual neural network methods are already regarded as cutting-edge and are studied here, using a set of conventional approaches for comparative evaluation. Our comparison shows that state-of-the-art deep learning techniques significantly benefit condition monitoring, providing an increase in fault finding accuracy of up to 48% over conventional methods. Nevertheless, we also found that derived transfer learning and deep residual network techniques do not in our case yield increased performance over normal convolutional neural networks.

References

  1. Muhammad Amar, Iqbal Gondal, and Campbell Wilson. 2014. Vibration spectrum imaging: A novel bearing fault classification approach. IEEE transactions on Industrial Electronics 62, 1 (2014), 494--502.Google ScholarGoogle Scholar
  2. Suresh Balakrishnama and Aravind Ganapathiraju. 1998. Linear discriminant analysis-a brief tutorial. Institute for Signal and information Processing 18 (1998), 1--8.Google ScholarGoogle Scholar
  3. Yoshua Bengio, Aaron Courville, and Pascal Vincent. 2013. Representation learning: A review and new perspectives. IEEE transactions on pattern analysis and machine intelligence 35, 8 (2013), 1798--1828.Google ScholarGoogle Scholar
  4. Ana M Bianco and Elena Martínez. 2009. Robust testing in the logistic regression model. Computational Statistics & Data Analysis 53, 12 (2009), 4095--4105.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Jingnian Chen, Houkuan Huang, Shengfeng Tian, and Youli Qu. 2009. Feature selection for text classification with Naïve Bayes. Expert Systems with Applications 36, 3 (2009), 5432--5435.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. ZhiQiang Chen, Chuan Li, and René-Vinicio Sanchez. 2015. Gearbox fault identification and classification with convolutional neural networks. Shock and Vibration 2015 (2015).Google ScholarGoogle Scholar
  7. Youngjun Cho, Nadia Bianchi-Berthouze, Nicolai Marquardt, and Simon J Julier. 2018. Deep Thermal Imaging: Proximate Material Type Recognition in the Wild through Deep Learning of Spatial Surface Temperature Patterns. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 2.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ronan Collobert and Jason Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th international conference on Machine learning. ACM, 160--167.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Machine learning 20, 3 (1995), 273--297.Google ScholarGoogle Scholar
  10. Li Deng, Dong Yu, et al. 2014. Deep learning: methods and applications. Foundations and Trends® in Signal Processing 7, 3-4 (2014), 197--387.Google ScholarGoogle Scholar
  11. William G Fenton, T. Martin McGinnity, and Liam P Maguire. 2001. Fault diagnosis of electronic systems using intelligent techniques: A review. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 31, 3 (2001), 269--281.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Steven Gold, Anand Rangarajan, et al. 1996. Softmax to softassign: Neural net work algorithms for combinatorial optimization. Journal of Artificial Neural Networks 2, 4 (1996), 381--399.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Kasthurirangan Gopalakrishnan, Siddhartha K Khaitan, Alok Choudhary, and Ankit Agrawal. 2017. Deep Convolutional Neural Networks with transfer learning for computer vision-based data-driven pavement distress detection. Construction and Building Materials 157 (2017), 322--330.Google ScholarGoogle ScholarCross RefCross Ref
  14. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.Google ScholarGoogle ScholarCross RefCross Ref
  15. Olivier Janssens, Rik Van de Walle, Mia Loccufier, and Sofie Van Hoecke. 2017. Deep learning for infrared thermal image based machine health monitoring. IEEE/ASME Transactions on Mechatronics 23, 1 (2017), 151--159.Google ScholarGoogle ScholarCross RefCross Ref
  16. Feng Jia, Yaguo Lei, Liang Guo, Jing Lin, and Saibo Xing. 2018. A neural net work constructed by deep learning technique and its application to intelligent fault diagnosis of machines. Neurocomputing 272 (2018), 619--628.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.Google ScholarGoogle Scholar
  18. Shih-Chung B Lo, Heang-Ping Chan, Jyh-Shyan Lin, Huai Li, Matthew T Freedman, and Seong K Mun. 1995. Artificial convolution neural network for medical image pattern recognition. Neural networks 8, 7-8 (1995), 1201--1214.Google ScholarGoogle Scholar
  19. R. Rajavignesh M. Keerthi. 2018. Machine Health Monitoring Using Infrared Thermal Image by Convolution Neural Network. International Journal of Engineering Research Technology (IJERT) 6, 07 (2018), 1--5.Google ScholarGoogle Scholar
  20. Yan Ma, Zhihong Guo, Jianjun Su, Yufeng Chen, Xiuming Du, Yi Yang, Chengqi Li, Ying Lin, and Yujie Geng. 2014. Deep learning for fault diagnosis based on multi-sourced heterogeneous data. In 2014 International Conference on Power System Technology. IEEE, 740--745.Google ScholarGoogle Scholar
  21. Tomáš Mikolov, Martin Karafiát, Lukáš Burget, Jan Černocky, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In Eleventh annual conference of the international speech communication association.Google ScholarGoogle Scholar
  22. Jingwei Qiu, Wei Liang, Laibin Zhang, Xuchao Yu, and Meng Zhang. 2015. The early-warning model of equipment chain in gas pipeline based on DNN-HMM. Journal of Natural Gas Science and Engineering 27 (2015), 1710--1722.Google ScholarGoogle ScholarCross RefCross Ref
  23. C Ruiz-Cárcel, VH Jaramillo, D Mba, JR Ottewill, and Y Cao. 2016. Combination of process and vibration data for improved condition monitoring of industrial systems working under variable operating conditions. Mechanical Systems and Signal Processing 66 (2016), 699--714.Google ScholarGoogle ScholarCross RefCross Ref
  24. B Samanta. 2004. Artificial neural networks and genetic algorithms for gear fault detection. Mechanical Systems and Signal Processing 18 (2004), 1273--1282.Google ScholarGoogle ScholarCross RefCross Ref
  25. Jürgen Schmidhuber. 2015. Deep learning in neural networks: An overview. Neural networks 61 (2015), 85--117.Google ScholarGoogle Scholar
  26. Johan AK Suykens and Joos Vandewalle. 1999. Least squares support vector machine classifiers. Neural processing letters 9, 3 (1999), 293--300.Google ScholarGoogle Scholar
  27. Mien Van and Hee-Jun Kang. 2015. Bearing defect classification based on individual wavelet local fisher discriminant analysis with particle swarm optimization. IEEE Transactions on Industrial Informatics 12, 1 (2015), 124--135.Google ScholarGoogle Scholar
  28. Nishchal K Verma, Vishal Kumar Gupta, Mayank Sharma, and Rahul Kumar Sevakula. 2013. Intelligent condition based monitoring of rotating machines using sparse auto-encoders. In 2013 IEEE Conference on Prognostics and Health Management (PHM). IEEE, 1--7.Google ScholarGoogle ScholarCross RefCross Ref
  29. Raymond E Wright. 1995. Logistic regression. (1995).Google ScholarGoogle Scholar
  30. Junyan Yang, Youyun Zhang, and Yongsheng Zhu. 2007. Intelligent fault diagnosis of rolling element bearing based on SVMs and fractal dimension. Mechanical Systems and Signal Processing 21, 5 (2007), 2012--2024.Google ScholarGoogle ScholarCross RefCross Ref
  31. Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. 2014. How transferable are features in deep neural networks?. In Advances in neural information processing systems. 3320--3328.Google ScholarGoogle Scholar
  32. Guangquan Zhao, Guohui Zhang, Qiangqiang Ge, and Xiaoyong Liu. 2016. Research advances in fault diagnosis and prognostic based on deep learning. In 2016 Prognostics and System Health Management Conference (PHM-Chengdu). IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  33. Rui Zhao, Ruqiang Yan, Zhenghua Chen, Kezhi Mao, Peng Wang, and Robert X Gao. 2019. Deep learning and its applications to machine health monitoring. Mechanical Systems and Signal Processing 115 (2019), 213--237.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Condition Monitoring for Confined Industrial Process Based on Infrared Images by Using Deep Neural Network and Variants

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          IVSP '20: Proceedings of the 2020 2nd International Conference on Image, Video and Signal Processing
          March 2020
          168 pages
          ISBN:9781450376952
          DOI:10.1145/3388818

          Copyright © 2020 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 18 May 2020

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed limited

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader