skip to main content
research-article

Unpaired Self-supervised Learning for Industrial Cyber-Manufacturing Spectrum Blind Deconvolution

Published: 17 November 2023 Publication History

Abstract

Cyber-Manufacturing combines industrial big data with intelligent analysis to find and understand the intangible problems in decision-making, which requires a systematic method to deal with rich signal data. With the development of spectral detection and photoelectric imaging technology, spectral blind deconvolution has achieved remarkable results. However, spectral processing is limited by one-dimensional signal, and there is no available structural information with few training samples. Moreover, in the majority of practical applications, it is entirely feasible to gather unpaired spectrum dataset for training. This training method of unpaired learning is practical and valuable. Therefore, a two-stage deconvolution scheme combining self supervised learning and feature extraction is proposed in this paper, which generates two complementary paired sets through self supervised learning to extract the final deconvolution network. In addition, a new deconvolution network is designed for feature extraction. The spectrum is pre-trained through spectral feature extraction and noise estimation network to improve the training efficiency and meet the assumed noise characteristics. Experimental results show that this method is effective in dealing with different types of synthetic noise.

References

[1]
Hande Baltacıoğlu, Alev Bayındırlı, Mete Severcan, and Feride Severcan. 2015. Effect of thermal treatment on secondary structure and conformational change of mushroom polyphenol oxidase (PPO) as food quality related enzyme: A FTIR study. Food Chemistry 187 (2015), 263–269.
[2]
Coleman Broaddus, Alexander Krull, Martin Weigert, Uwe Schmidt, and Gene Myers. 2020. Removing structured noise with self-supervised blind-spot networks. In 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI). IEEE, 159–163.
[3]
Jingying Chen, Dan Chen, Xiaoli Li, and Kun Zhang. 2013. Towards improving social communication skills with multimodal sensory information. IEEE Transactions on Industrial Informatics 10, 1 (2013), 323–330.
[4]
Qiong Chen, Weiping Ding, Xiaomeng Huang, and Hao Wang. 2022. Generalized interval type II fuzzy rough model based feature discretization for mixed pixels. IEEE Transactions on Fuzzy Systems (2022), 1–15.
[5]
Qiong Chen, Mengxing Huang, Hao Wang, and Guangquan Xu. 2022. A feature discretization method based on fuzzy rough sets for high-resolution remote sensing big data under linear spectral model. IEEE Transactions on Fuzzy Systems 30, 5 (2022), 1328–1342.
[6]
Fabien Chraim, Yusuf Bugra Erol, and Kris Pister. 2015. Wireless gas leak detection and localization. IEEE Transactions on Industrial Informatics 12, 2 (2015), 768–779.
[7]
L. Z. Deng, L. Cao, and H. Zhu. 2014. Spectral semi-blind deconvolution with hybrid regularization. Infrared Physics & Technology 64 (2014), 91–96.
[8]
Lizhen Deng, Chunming He, Guoxia Xu, Hu Zhu, and Hao Wang. 2022. PcGAN: A noise robust conditional generative adversarial network for one shot learning. IEEE Transactions on Intelligent Transportation Systems (2022), 1–10.
[9]
Lizhen Deng, Guoxia Xu, Yanyu Dai, and Hu Zhu. 2022. A dual stream spectrum deconvolution neural network. IEEE Transactions on Industrial Informatics 18, 5 (2022), 3086–3094.
[10]
Sabina Jeschke, Christian Brecher, Tobias Meisen, Denis Özdemir, and Tim Eschert. 2017. Industrial internet of things and cyber manufacturing systems. In Industrial Internet of Things. Springer, 3–19.
[11]
Jyrki K. Kauppinen, Douglas J. Moffatt, Henry H. Mantsch, and David G. Cameron. 1981. Fourier self-deconvolution: A method for resolving intrinsically overlapped bands. Applied Spectroscopy 35, 3 (1981), 271–276.
[12]
Wooseok Lee, Sanghyun Son, and Kyoung Mu Lee. 2022. AP-BSN: Self-supervised denoising for real-world images via asymmetric PD and blind-spot network. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 17725–17734.
[13]
Hai Liu, Sanya Liu, Tao Huang, Zhaoli Zhang, Yong Hu, and Tianxu Zhang. 2016. Infrared spectrum blind deconvolution algorithm via learned dictionaries and sparse representation. Applied Optics 55, 10 (2016), 2813–2818.
[14]
Hai Liu, Mo Zhou, Zhaoli Zhang, Jiangbo Shu, Tingting Liu, and Tianxu Zhang. 2015. Multi-order blind deconvolution algorithm with adaptive Tikhonov regularization for infrared spectroscopic data. Infrared Physics & Technology 71 (2015), 63–69.
[15]
Jinghe Yuan and Ziqiang Hu. 2006. High-order statistical blind deconvolution of spectroscopic data with a gauss—newton algorithm. Applied Spectroscopy 60, 6 (2006), 692–697.
[16]
Tingting Liu, Hai Liu, Youfu Li, Zhaoli Zhang, and Sannyuya Liu. 2018. Efficient blind signal reconstruction with wavelet transforms regularization for educational robot infrared vision sensing. IEEE/ASME Transactions on Mechatronics 24, 1 (2018), 384–394.
[17]
Víctor A. Lórenz-Fonfría and Esteve Padrós. 2005. Maximum entropy deconvolution of infrared spectra: Use of a novel entropy expression without sign restriction. Applied Spectroscopy 59, 4 (2005), 474–486.
[18]
Xuezhe Ma, Xiang Kong, Shanghang Zhang, and Eduard Hovy. 2019. MaCow: Masked convolutional generative flow. Advances in Neural Information Processing Systems 32 (2019).
[19]
James Manyika, Michael Chui, Brad Brown, Jacques Bughin, Richard Dobbs, Charles Roxburgh, Angela Hung Byers, et al. 2011. Big Data: The Next Frontier for Innovation, Competition, and Productivity. McKinsey Global Institute.
[20]
Roman Z. Morawski. 2006. Spectrophotometric applications of digital signal processing. Measurement Science and Technology 17, 9 (2006), R117.
[21]
Pin Ni, Yuming Li, Gangmin Li, and Victor Chang. 2021. A hybrid siamese neural network for natural language inference in cyber-physical systems. ACM Transactions on Internet Technology 21, 2 (2021), 1–25.
[22]
Soumen Sarkar, P. K. Dutta, and N. C. Roy. 1998. A blind-deconvolution approach for chromatographic and spectroscopic peak restoration. IEEE Transactions on Instrumentation and Measurement 47, 4 (1998), 941–947.
[23]
Zhongyang Wang, Guoxia Xu, Xiaokang Zhou, Jung Yoon Kim, Hu Zhu, and Lizhen Deng. 2022. Deep tensor evidence fusion network for sentiment classification. IEEE Transactions on Computational Social Systems (2022), 1–9.
[24]
Xiaohe Wu, Ming Liu, Yue Cao, Dongwei Ren, and Wangmeng Zuo. 2020. Unpaired learning of deep image denoising. In European Conference on Computer Vision. Springer, 352–368.
[25]
Guoxia Xu, Xiaoxue Deng, Xiaokang Zhou, Marius Pedersen, Lucia Cimmino, and Hao Wang. 2022. FCFusion: Fractal component-wise modeling with group sparsity for medical image fusion. IEEE Transactions on Industrial Informatics (2022), 1–9.
[26]
Guoxia Xu, Hao Wang, Meng Zhao, Marius Pedersen, and Hu Zhu. 2022. Learning the distribution-based temporal knowledge with low rank response reasoning for UAV visual tracking. IEEE Transactions on Intelligent Transportation Systems (2022), 1–11.
[27]
Minxian Xu, Chenghao Song, Huaming Wu, Sukhpal Singh Gill, Kejiang Ye, and Chengzhong Xu. 2022. esDNN: deep neural network based multivariate workload prediction in cloud computing environments. ACM Transactions on Internet Technology (TOIT) 22, 3 (2022), 1–24.
[28]
Luxin Yan, Hai Liu, Sheng Zhong, and Houzhang Fang. 2012. Semi-blind spectral deconvolution with adaptive Tikhonov regularization. Applied Spectroscopy 66, 11 (2012), 1334–1346.
[29]
Hu Zhu, Lizhen Deng, Haibo Li, and Yujie Li. 2018. Deconvolution methods based on convex regularization for spectral resolution enhancement. Computers & Electrical Engineering 70 (2018), 959–967.
[30]
Hu Zhu, Lizhen Deng, Guoxia Xu, Yixiang Chen, and Yujie Li. 2019. Spectral semi-blind deconvolution methods based on modified \(\varphi\)HS regularizations. Optics & Laser Technology 110 (2019), 24–29.
[31]
Hu Zhu, Yiming Qiao, Guoxia Xu, Lizhen Deng, and Yu-Feng Yu. 2020. DSPNet: A lightweight dilated convolution neural networks for spectral deconvolution with self-paced learning. IEEE Transactions on Industrial Informatics 16, 12 (2020), 7392–7401.

Cited By

View all
  • (2025)AMTrans: Auto-Correlation Multi-Head Attention Transformer for Infrared Spectral DeconvolutionTsinghua Science and Technology10.26599/TST.2024.901013130:3(1329-1341)Online publication date: Jun-2025
  • (2025)Masked Video Pretraining Advances Real-World Video DenoisingIEEE Transactions on Multimedia10.1109/TMM.2024.352181827(622-636)Online publication date: 2025
  • (2025)DHTSD: On discrete Hankel transform spectral description for effective infrared spectra recovery and identificationInfrared Physics & Technology10.1016/j.infrared.2024.105700145(105700)Online publication date: Mar-2025
  • Show More Cited By

Index Terms

  1. Unpaired Self-supervised Learning for Industrial Cyber-Manufacturing Spectrum Blind Deconvolution

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Internet Technology
    ACM Transactions on Internet Technology  Volume 23, Issue 4
    November 2023
    249 pages
    ISSN:1533-5399
    EISSN:1557-6051
    DOI:10.1145/3633308
    • Editor:
    • Ling Liu
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 November 2023
    Online AM: 03 May 2023
    Accepted: 20 March 2023
    Revised: 08 January 2023
    Received: 28 May 2022
    Published in TOIT Volume 23, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Cyber-Manufacturing
    2. spectral blind deconvolution
    3. unpaired learning
    4. two stage training network

    Qualifiers

    • Research-article

    Funding Sources

    • National Natural Science Foundation of China

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)75
    • Downloads (Last 6 weeks)11
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)AMTrans: Auto-Correlation Multi-Head Attention Transformer for Infrared Spectral DeconvolutionTsinghua Science and Technology10.26599/TST.2024.901013130:3(1329-1341)Online publication date: Jun-2025
    • (2025)Masked Video Pretraining Advances Real-World Video DenoisingIEEE Transactions on Multimedia10.1109/TMM.2024.352181827(622-636)Online publication date: 2025
    • (2025)DHTSD: On discrete Hankel transform spectral description for effective infrared spectra recovery and identificationInfrared Physics & Technology10.1016/j.infrared.2024.105700145(105700)Online publication date: Mar-2025
    • (2025)Blind infrared spectral deconvolution with discrete Radon transform regularization for biomedical applicationsInfrared Physics & Technology10.1016/j.infrared.2024.105640144(105640)Online publication date: Jan-2025
    • (2024)Point cloud self-supervised learning for machining feature recognitionJournal of Manufacturing Systems10.1016/j.jmsy.2024.08.02977(78-95)Online publication date: Dec-2024
    • (2024)Discrete wedgelet transform regularization-based spectral deconvolution for infrared spectroscopyInfrared Physics & Technology10.1016/j.infrared.2024.105593143(105593)Online publication date: Dec-2024
    • (2024)SST: Sparse self-attention transformer for infrared spectrum deconvolutionInfrared Physics & Technology10.1016/j.infrared.2024.105384140(105384)Online publication date: Aug-2024

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media