skip to main content
10.1145/3633637.3633667acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

NPTT: Nonlinear Spatial-Temporal Transform for Low-Rank Tensor Recovery in Infrared Small Target Detection

Published: 28 February 2024 Publication History

Abstract

Infrared small target detection is a critical but challenging task in various applications. Existing spatial-temporal tensor methods based on low-rank and sparse decomposition effectively utilize the spatial-temporal information of infrared sequences, however, their tensor rank approximations rely solely on linear transform, leading to significant miss detections and false alarms in complex backgrounds. In this paper, we propose a novel CNN-based nonlinear spatial-temporal transformation (NPTT) for tensor rank approximations. We first establish a basic spatial-temporal tensor detection model based on Tucker rank. Then, we introduce the NPTT to help low-rank tensor recovery, which incorporates both spatial and temporal transforms to extract comprehensive spatial-temporal information from the infrared sequence. Furthermore, the nonlinear activation function LeakyReLU enhances the nonlinear expression of the NPTT. Finally, our model is optimized by the Adaptive Moment Estimation (Adam) algorithm to yield accurate detection results. Experimental results demonstrate the effectiveness and superiority of our proposed model in detecting infrared small targets in real infrared sequences.

References

[1]
Xiangzhi Bai and Fugen Zhou. 2010. Analysis of new top-hat transformation and the application for infrared dim small target detection. Pattern Recognition 43, 6 (2010), 2145–2156.
[2]
Yimian Dai, Yiquan Wu, Fei Zhou, and Kobus Barnard. 2021. Asymmetric contextual modulation for infrared small target detection. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 950–959.
[3]
He Deng, Xianping Sun, Maili Liu, Chaohui Ye, and Xin Zhou. 2016. Small infrared target detection based on weighted local difference measure. IEEE Transactions on Geoscience and Remote Sensing 54, 7 (2016), 4204–4214.
[4]
He Deng, Xianping Sun, Maili Liu, Chaohui Ye, and Xin Zhou. 2017. Entropy-based window selection for detecting dim and small infrared targets. Pattern Recognition 61 (2017), 66–77.
[5]
Lizhen Deng, Jieke Zhang, Guoxia Xu, and Hu Zhu. 2021. Infrared small target detection via adaptive M-estimator ring top-hat transformation. Pattern Recognition 112 (2021), 107729.
[6]
Chenqiang Gao, Deyu Meng, Yi Yang, Yongtao Wang, Xiaofang Zhou, and Alexander G Hauptmann. 2013. Infrared patch-image model for small target detection in a single image. IEEE transactions on image processing 22, 12 (2013), 4996–5009.
[7]
Jinhui Han, Kun Liang, Bo Zhou, Xinying Zhu, Jie Zhao, and Linlin Zhao. 2018. Infrared small target detection utilizing the multiscale relative local contrast measure. IEEE Geoscience and Remote Sensing Letters 15, 4 (2018), 612–616.
[8]
Bingwei Hui, Zhiyong Song, Hongqi Fan, P Zhong, W Hu, X Zhang, J Lin, H Su, W Jin, Y Zhang, 2019. A dataset for infrared image dim-small aircraft target detection and tracking under ground/air background. Sci. Data Bank 5 (2019), 12.
[9]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[10]
Yansheng Li and Yongjun Zhang. 2018. Robust infrared small target detection using local steering kernel reconstruction. Pattern Recognition 77 (2018), 113–125.
[11]
Ji Liu, Przemyslaw Musialski, Peter Wonka, and Jieping Ye. 2012. Tensor completion for estimating missing values in visual data. IEEE transactions on pattern analysis and machine intelligence 35, 1 (2012), 208–220.
[12]
Yisi Luo, Xi-Le Zhao, Deyu Meng, and Tai-Xiang Jiang. 2022. HLRTF: Hierarchical Low-Rank Tensor Factorization for Inverse Problems in Multi-Dimensional Imaging. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 19303–19312.
[13]
Yi-Si Luo, Xi-Le Zhao, Tai-Xiang Jiang, Yi Chang, Michael K Ng, and Chao Li. 2022. Self-supervised nonlinear transform-based tensor nuclear norm for multi-dimensional image recovery. IEEE Transactions on Image Processing 31 (2022), 3793–3808.
[14]
Andrew L Maas, Awni Y Hannun, Andrew Y Ng, 2013. Rectifier nonlinearities improve neural network acoustic models. In Proc. icml, Vol. 30. Atlanta, Georgia, USA, 3.
[15]
Adedeji Olugboja, Zenghui Wang, and Yanxia Sun. 2021. Parallel convolutional neural networks for object detection. Journal of Advances in Information Technology Vol 12, 4 (2021).
[16]
Yaru Su, Xiaohui Wu, and Wenxi Liu. 2019. Low-rank tensor completion by sum of tensor nuclear norm minimization. IEEE Access 7 (2019), 134943–134953.
[17]
Yang Sun, Jungang Yang, Yunli Long, and Wei An. 2019. Infrared small target detection via spatial-temporal total variation regularization and weighted tensor nuclear norm. IEEE access 7 (2019), 56667–56682.
[18]
Michael Teutsch and Wolfgang Krüger. 2010. Classification of small boats in infrared images for maritime surveillance. In 2010 International WaterSide Security Conference. IEEE, 1–7.
[19]
Yimian Dai, Yiquan Wu, Fei Zhou, and Kobus Barnard. 2021. Attentional local contrast networks for infrared small target detection. IEEE Transactions on Geoscience and Remote Sensing 59, 11 (2021), 9813–9824.
[20]
Baorong Xie, Xinzhong Zhu, Chuanzhao Han, Yang Wang, Xian Li, and Yu Zhang. 2019. Research of the space-borne infrared ship target recognition technology based on the complex background. Journal of Advances in Information Technology 10, 2 (2019), 48–53.
[21]
Landan Zhang and Zhenming Peng. 2019. Infrared small target detection based on partial sum of the tensor nuclear norm. Remote Sensing 11, 4 (2019), 382.
[22]
Mingjin Zhang, Rui Zhang, Yuxiang Yang, Haichen Bai, Jing Zhang, and Jie Guo. 2022. ISNET: Shape matters for infrared small target detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 877–886.
[23]
Ping Zhang, Lingyi Zhang, Xiaoyang Wang, Fengcan Shen, Tian Pu, and Chun Fei. 2020. Edge and corner awareness-based spatial–temporal tensor model for infrared small-target detection. IEEE Transactions on Geoscience and Remote Sensing 59, 12 (2020), 10708–10724.
[24]
Tianfang Zhang, Lei Li, Siying Cao, Tian Pu, and Zhenming Peng. 2023. Attention-Guided Pyramid Context Networks for Detecting Infrared Small Target Under Complex Background. IEEE Trans. Aerospace Electron. Systems (2023).

Index Terms

  1. NPTT: Nonlinear Spatial-Temporal Transform for Low-Rank Tensor Recovery in Infrared Small Target Detection

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCPR '23: Proceedings of the 2023 12th International Conference on Computing and Pattern Recognition
    October 2023
    589 pages
    ISBN:9798400707988
    DOI:10.1145/3633637
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 February 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. infrared small target detection
    2. low-rank and sparse decomposition
    3. nonlinear transform
    4. spatial-temporal tensor

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    ICCPR 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 34
      Total Downloads
    • Downloads (Last 12 months)34
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media