Skip to main content
SpringerLink
Log in

Hyperspectral Image Denoising Based on Superpixel Segmentation Low-Rank Matrix Approximation and Total Variation

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

In this paper, we proposed a new method to remove mixed noises in hyperspectral images (HSI’s) denoising using superpixel segmentation, low-rank matrix approximation and total variation (SSLRTV). According to the spectral correlation of the HSI bands, it has a low-rank structure in spectral-domain. So at first, we divide the HSI to the homogeneous regions by superpixel segmentation to save the spectral signature of pixels in the low-rank approximation method. Furthermore, each segmented region’s rank is estimated to determine the principal spectral subspace. We improved algorithm performance by proposing a new TV model for HSIs that saves spatial and spectral smoothness of the HSI; furthermore, it has a fast convergence speed and simple computational based on the gradient descent method. In the proposed SSLRTV method, the optimization problem is solved by an augmented Lagrange multiplier method. Experiments on the real data and simulated data demonstrate that the proposed denoising method has better results than previous in terms of quality and run-time cost.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, S. Süsstrunk, IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2010)

    Article  Google Scholar 

  2. H.K. Aggarwal, A. Majumdar, Hyperspectral image denoising using spatio-spectral total variation. IEEE Geosci. Remote Sens. Lett. 13(3), 442–446 (2016)

    Google Scholar 

  3. A. Beck, M. Teboulle, Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans. Image Process. 18(11), 2419–2434 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  4. J.M. Bioucas-Dias, J.M. Nascimento, Hyperspectral subspace identification. IEEE Trans. Geosci. Remote Sens. 46(8), 2435–2445 (2008)

    Article  Google Scholar 

  5. P. Blomgren, T.F. Chan, Color tv: total variation methods for restoration of vector-valued images. IEEE Trans. Image Process. 7(3), 304–309 (1998)

    Article  Google Scholar 

  6. J.-F. Cai, E.J. Candès, Z. Shen, A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  7. E.J. Candès, X. Li, Y. Ma, J. Wright, Robust principal component analysis? J. ACM 58(3), 1–37 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  8. A. Chambolle, An algorithm for total variation minimization and applications. Journal of Mathematical imaging and vision 20(1–2), 89–97 (2004)

    MathSciNet  MATH  Google Scholar 

  9. S.H. Chan, R. Khoshabeh, K.B. Gibson, P.E. Gill, T.Q. Nguyen, An augmented lagrangian method for total variation video restoration. IEEE Trans. Image Process. 20(11), 3097–3111 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  10. C.-F. Chen, Wei C.-P., Wang Y.-C. F., Low-rank matrix recovery with structural incoherence for robust face recognition, in 2012 IEEE Conference on Computer Vision and Pattern Recognition (2012), pp. 2618–2625. IEEE

  11. G. Chen, S. Qian, Denoising of hyperspectral imagery using principal component analysis and wavelet shrinkage. IEEE Trans. Geosci. Remote Sens. 49(3), 973–980 (2011)

    Article  Google Scholar 

  12. Y. Deng, Q. Dai, R. Liu, Z. Zhang, S. Hu, Low-rank structure learning via nonconvex heuristic recovery. IEEE Trans. Neural Netw. Learn. Syst. 24(3), 383–396 (2013)

    Article  Google Scholar 

  13. F. Fan, Y. Ma, C. Li, X. Mei, J. Huang, J. Ma, Hyperspectral image denoising with superpixel segmentation and low-rank representation. Inf. Sci. 397, 48–68 (2017)

    Article  Google Scholar 

  14. B. Fulkerson, A. Vedaldi, S. Soatto, Class segmentation and object localization with superpixel neighborhoods, in 2009 IEEE 12th International Conference on Computer Vision (2009), pp. 670–677

  15. A.F. Goetz, G. Vane, J.E. Solomon, B.N. Rock, Imaging spectrometry for earth remote sensing. Science 228(4704), 1147–1153 (1985)

    Article  Google Scholar 

  16. W. He, H. Zhang, H. Shen, L. Zhang, Hyperspectral image denoising using local low-rank matrix recovery and global spatial–spectral total variation. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 11(3), 713–729 (2018)

    Article  Google Scholar 

  17. W. He, H. Zhang, L. Zhang, Total variation regularized reweighted sparse nonnegative matrix factorization for hyperspectral unmixing. IEEE Trans. Geosci. Remote Sens. 55(7), 3909–3921 (2017)

    Article  Google Scholar 

  18. W. He, H. Zhang, L. Zhang, H. Shen, Total-variation-regularized low-rank matrix factorization for hyperspectral image restoration. IEEE Trans. Geosci. Remote Sens. 54(1), 178–188 (2015)

    Article  Google Scholar 

  19. D. Hoiem, A.A. Efros, M. Hebert, Automatic photo pop-up, in ACM SIGGRAPH 2005 Papers, SIGGRAPH ’05, New York, NY, USA (2005), pp. 577–584. Association for Computing Machinery

  20. M. Iordache, J.M. Bioucas-Dias, A. Plaza, Sparse unmixing of hyperspectral data. IEEE Trans. Geosci. Remote Sens. 49(6), 2014–2039 (2011)

    Article  Google Scholar 

  21. H. Ji, S. Huang, Z. Shen, Y. Xu, Robust video restoration by joint sparse and low rank matrix approximation. SIAM J. Imag. Sci. 4(4), 1122–1142 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  22. H. Ji, C. Liu, Z. Shen, Y. Xu, Robust video denoising using low rank matrix completion, in 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2010), pp. 1791–1798

  23. S.H. Kang, J.H. Han, New RNN activation technique for deeper networks: LSTCM cells. IEEE Access 8, 214625–214632 (2020)

    Article  Google Scholar 

  24. Khazeiynasab, S. R., J. Qi, and I. Batarseh, Generator parameter estimation by Q-learning based on PMU measurements, in 2021 IEEE Power and Energy Society Innovative Smart Grid Technologies Conference (ISGT) (2021), pp. 01–05. IEEE

  25. S.R. Khazeiynasab, J. Zhao, I. Batarseh, B. Tan, Power plant model parameter calibration using conditional variational autoencoder. IEEE Trans. Power Syst. (2021)

  26. O. Kuybeda, G.A. Frank, A. Bartesaghi, M. Borgnia, S. Subramaniam, G. Sapiro, A collaborative framework for 3d alignment and classification of heterogeneous subvolumes in cryo-electron tomography. J. Struct. Biol. 181(2), 116–127 (2013)

    Article  Google Scholar 

  27. D. Letexier, S. Bourennane, Noise removal from hyperspectral images by multidimensional filtering. IEEE Trans. Geosci. Remote Sens. 46(7), 2061–2069 (2008)

    Article  Google Scholar 

  28. C. Li, Y. Ma, J. Huang, X. Mei, J. Ma, Hyperspectral image denoising using the robust low-rank tensor recovery. JOSA A 32(9), 1604–1612 (2015)

    Article  Google Scholar 

  29. X. Li, H. Shen, L. Zhang, H. Zhang, Q. Yuan, G. Yang, Recovering quantitative remote sensing products contaminated by thick clouds and shadows using multitemporal dictionary learning. IEEE Trans. Geosci. Remote Sens. 52(11), 7086–7098 (2014)

    Article  Google Scholar 

  30. Y. Li, J. Sun, C.-K. Tang, H.-Y. Shum, Lazy snapping. ACM Trans. Graph. 23(3), 303–308 (2004)

    Article  Google Scholar 

  31. D. Needell, R. Ward, Stable image reconstruction using total variation minimization. SIAM J. Imag. Sci. 6(2), 1035–1058 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  32. S. Osher, M. Burger, D. Goldfarb, J. Xu, W. Yin, An iterative regularization method for total variation-based image restoration. Multiscale Model. Simul. 4(2), 460–489 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  33. Y. Qian, M. Ye, Hyperspectral imagery restoration using nonlocal spectral–spatial structured sparse representation with noise estimation. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 6(2), 499–515 (2012)

    Article  Google Scholar 

  34. B. Rasti, J.R. Sveinsson, M.O. Ulfarsson, J.A. Benediktsson, Hyperspectral image denoising using 3d wavelets, in 2012 IEEE International Geoscience and Remote Sensing Symposium (2012), pp. 1349–1352

  35. X. Ren, J. Malik, Learning a classification model for segmentation, in Proceedings Ninth IEEE International Conference on Computer Vision, vol. 1 (2003), pp. 10–17

  36. L.I. Rudin, S. Osher, E. Fatemi, Nonlinear total variation based noise removal algorithms. Physica D 60(1–4), 259–268 (1992)

    Article  MathSciNet  MATH  Google Scholar 

  37. L. Sun, B. Jeon, Y. Zheng, Z. Wu, Hyperspectral image restoration using low-rank representation on spectral difference image. IEEE Geosci. Remote Sens. Lett. 14(7), 1151–1155 (2017)

    Article  Google Scholar 

  38. L. Sun, B. Jeon, Y. Zheng, Z. Wu, A novel weighted cross total variation method for hyperspectral image mixed denoising. IEEE Access 5, 27172–27188 (2017)

    Article  Google Scholar 

  39. M. Wang, J. Yu, J.-H. Xue, W. Sun, Denoising of hyperspectral images using group low-rank representation. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 9(9), 4420–4427 (2016)

    Article  Google Scholar 

  40. Z. Wang, A.C. Bovik, H.R. Sheikh, E.P. Simoncelli, Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  41. D. Wei, H. Hu, Sparse discrete linear canonical transform and its applications. Signal Process. 183, 108046 (2021)

    Article  Google Scholar 

  42. D. Wei, Y.-M. Li, Convolution and multichannel sampling for the offset linear canonical transform and their applications. IEEE Trans. Signal Process. 67(23), 6009–6024 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  43. D. Wei, W. Yang, Y.-M. Li, Lattices sampling and sampling rate conversion of multidimensional bandlimited signals in the linear canonical transform domain. J. Frankl. Inst. 356(13), 7571–7607 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  44. Z. Wu, Q. Wang, J. Jin, Y. Shen, Structure tensor total variation-regularized weighted nuclear norm minimization for hyperspectral image mixed denoising. Signal Process. 131, 202–219 (2017)

    Article  Google Scholar 

  45. F. Yang, X. Chen, L. Chai, Hyperspectral image destriping and denoising using stripe and spectral low-rank matrix recovery and global spatial–spectral total variation. Remote Sens. 13(4), 827 (2021)

    Article  Google Scholar 

  46. Q. Yuan, L. Zhang, H. Shen, Hyperspectral image denoising employing a spectral–spatial adaptive total variation model. IEEE Trans. Geosci. Remote Sens. 50(10), 3660–3677 (2012)

    Article  Google Scholar 

  47. H. Zeng, X. Xie, H. Cui, H. Yin, J. Ning, Hyperspectral image restoration via global l1–2 spatial–spectral total variation regularized local low-rank tensor recovery. IEEE Trans. Geosci. Remote Sens. 59(4), 3309–3325 (2021)

    Article  Google Scholar 

  48. H. Zeng, X. Xie, H. Cui, Y. Zhao, J. Ning, Hyperspectral image restoration via CNN denoiser prior regularized low-rank tensor recovery. Comput. Vis. Image Underst. 197, 103004 (2020)

    Article  Google Scholar 

  49. Z. Zha, X. Yuan, J. Zhou, C. Zhu, B. Wen, Image restoration via simultaneous nonlocal self-similarity priors. IEEE Trans. Image Process. 29, 8561–8576 (2020)

    Article  Google Scholar 

  50. H. Zhang, W. He, L. Zhang, H. Shen, Q. Yuan, Hyperspectral image restoration using low-rank matrix recovery. IEEE Trans. Geosci. Remote Sens. 52(8), 4729–4743 (2013)

    Article  Google Scholar 

  51. H. Zhang, L. Zhang, H. Shen, A super-resolution reconstruction algorithm for hyperspectral images. Signal Process. 92(9), 2082–2096 (2012)

    Article  Google Scholar 

  52. Q. Zhang, Q. Yuan, J. Li, X. Liu, H. Shen, L. Zhang, Hybrid noise removal in hyperspectral imagery with a spatial–spectral gradient network. IEEE Trans. Geosci. Remote Sens. 57(10), 7317–7329 (2019)

    Article  Google Scholar 

  53. Z. Zheng, H. Ma, M.R. Lyu, I. King, Collaborative web service qos prediction via neighborhood integrated matrix factorization. IEEE Trans. Serv. Comput. 6(3), 289–299 (2012)

    Article  Google Scholar 

  54. L. Zhuang, L. Gao, B. Zhang, X. Fu, J.M. Bioucas-Dias, Hyperspectral image denoising and anomaly detection based on low-rank and sparse representations. IEEE Trans. Geosci. Remote Sens. 1–17 (2020)

Download references

Author information

Authors and Affiliations

  1. Department of Communications and Electronics Engineering, School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran

    Y. Behroozi, M. Yazdi & A. Zolghadr asli

Authors
  1. Y. Behroozi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Yazdi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Zolghadr asli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Yazdi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Behroozi, Y., Yazdi, M. & asli, A.Z. Hyperspectral Image Denoising Based on Superpixel Segmentation Low-Rank Matrix Approximation and Total Variation. Circuits Syst Signal Process 41, 3372–3396 (2022). https://doi.org/10.1007/s00034-021-01938-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-021-01938-9

Keywords

Search

Navigation