Skip to main content
Log in

Noise robust image clustering based on reweighted low rank tensor approximation and \(l_{\frac{1}{2}}\) regularization

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In this paper, a noise robust tensor based image clustering approach is proposed which can also perform well in the presence of gross errors. Our major contribution is the improved submodule identification technique in noisy environment by incorporating three important improvements: better low rank representation using reweighted nuclear norm, \(l_\frac{1}{2}\) regularization to accurately capture sparseness and an error term in the model for noise robustness. Reweighted nuclear norm is introduced in the clustering model to capture self-expressiveness property in a better manner. The \(l_\frac{1}{2}\) norm regularization is applied in place of \(l_1\)-norm to properly capture the correlation among data members. An error term is introduced into the model to separate noise and data, which brings a noise robust image clustering technique. Combined effect all the three factors results an accurate clustering method even under the presence of severe noise. The performance of the proposed method is tested on different datasets with varying amount of noise. It is found that the proposed method provides better classification accuracy in almost all conditions as compared with existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Chen, Y., Wang, Y., Li, M., He, G.: Augmented Lagrangian alternating direction method for low-rank minimization via non-convex approximation. Signal Image Video Process. 11, 1271–1278 (2017)

    Article  Google Scholar 

  2. Elhamifar, E., Vidal, R.: Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2765–2781 (2013)

    Article  Google Scholar 

  3. Liu, G., Lin, Z., Yu, Y.: Robust subspace segmentation by low-rank representation. In: Proceedings of the 27th International Conference on Machine Learning, pp. 663–670 (2010)

  4. Mohan, A., Baburaj, M.: Submodule clustering based on latent representation tensor. In: Proceedings of the IEEE 2nd International Conference on Intelligent Computing, Instrumentation and Control Technologies, pp. 1021–1024 (2019)

  5. Ng, A.Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Proccedings of the Advances in Neural Information Processing Systems, pp. 849–856 (2002)

  6. Parsons, L., Haque, E., Liu, H.: Subspace clustering for high dimensional data: a review. ACM sIGKDD Explor. Newslett. 6, 90–105 (2004)

    Article  Google Scholar 

  7. Tang, K., Liu, R., Su, Z., Zhang, J.: Structure-constrained low-rank representation. IEEE Trans. Neural Netw. Learn. Syst. 2, 2167–2179 (2014)

    Article  Google Scholar 

  8. Wu, T.: Graph regularized low-rank representation for submodule clustering. Pattern Recognit. Lett. 100, 107145 (2020)

    Article  Google Scholar 

  9. Zhao, Z., Bai, L., Zhang, Y., Han, J.: Classification via semi-supervised multi-random subspace sparse representation. Signal, Image Video Process. 13, 1387–1394 (2019)

    Article  Google Scholar 

  10. Wu, J., Lin, Z., Zha, H.: Essential tensor learning for multi-view spectral clustering. arXiv preprint arXiv:1807.03602 (2018)

  11. Wu, T., Bajwa, W.U.: A low tensor-rank representation approach for clustering of imaging data. IEEE Signal Process. Lett. 25, 1196–1200 (2018)

    Article  Google Scholar 

  12. Kernfeld, E., Kilmer, M., Aeron, S.: Tensor-tensor products with invertible linear transforms. Linear Algebra Appl. 485, 545–570 (2015)

    Article  MathSciNet  Google Scholar 

  13. Lu, C., Feng, J., Chen, Y,. Liu, W., Lin, Z., Yan, S.: Tensor robust principal component analysis: exact recovery of corrupted low-rank tensors via convex optimization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5249–5257 (2016)

  14. Madathil, B., George, S.N.: Twist tensor total variation regularized-reweighted nuclear norm based tensor completion for video missing area recovery. Inf. Sci. 423, 376–397 (2018)

    Article  MathSciNet  Google Scholar 

  15. Madathil, B., Sagheer, S.V.M., Rahiman, V., Tom, A.J., Francis, J., George, S.N.: Tensor low rank modeling and its applications in signal processing. arXiv preprint arXiv:1912.03435 (2019)

  16. Piao, X., Hu, Y, Gao, J., Sun, Y., Lin, Z., Yin, B.: Tensor sparse and low-rank based submodule clustering method for multi-way data. arXiv preprint arXiv:1601.00149 (2016)

  17. Zhang, Y., Yang, W., Liu, B., Ke, G., Pan, Y., Yin, J.: Multi-view spectral clustering via tensor-svd decomposition. In: Proceedings of the IEEE 29th International Conference on Tools with Artificial Intelligence, pp. 493–497 (2017)

  18. Kernfeld, E., Aeron, S., Kilmer, M.: Clustering multi-way data: a novel algebraic approach. arXiv preprint arXiv:1412.7056 (2014)

  19. Xu, Z., Chang, X., Xu, F., Zhang, H.: \(l_{1/2}\) regularization: a thresholding representation theory and a fast solver. IEEE Trans. Neural Netw. Learn. Syst. 23, 1013–1027 (2012)

    Article  Google Scholar 

  20. Zhu, L., Hao, Y., Song, Y.: \(l_{1/2}\) norm and spatial continuity regularized low-rank approximation for moving object detection in dynamic background. IEEE Signal Process. Lett. 25, 15–19 (2018)

    Article  Google Scholar 

  21. Zeng, J., Lin, S., Wang, Y., Xu, Z.: \(l_{1/2}\) regularization: convergence of iterative half thresholding algorithm. IEEE Trans. Signal Process. 62, 2317–2329 (2014)

    Article  MathSciNet  Google Scholar 

  22. Candes, E.J., Wakin, M.B., Boyd, S.P.: Enhancing sparsity by reweighted \(l_1\) minimization. J. Fourier Anal. Appl. 14, 877–905 (2008)

    Article  MathSciNet  Google Scholar 

  23. Johnson, A., Francis, J., Madathil, B., George, S.N.: A two-way optimization framework for clustering of images using weighted tensor nuclear norm approximation. In: Proceedings of the 26th National Conference on Communications (NCC), pp. 1–5 (2020)

  24. Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2011)

    Article  Google Scholar 

  25. Nene, S.A., Nayar, S.K., Murase, H.: Columbia object image library (Coil-20). Tech. rep (1996)

  26. LeCun, Y.: The mnist database of handwritten digits. http://yann.lecun.com/exdb/mnist/ (MNIST) (1998). Accessed 03 Oct 2019

  27. Mahadevan, V., Vasconcelos, N.: Spatiotemporal saliency in dynamic scenes. IEEE Trans. Pattern Anal. Mach. Intell. 32, 171–177 (2010)

    Article  Google Scholar 

  28. Krizhevsky, A., Hinton, G.: Learning multiple layers of features from tiny images. Tech Report (2009)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Baburaj Madathil.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Madathil, B., George, S.N. Noise robust image clustering based on reweighted low rank tensor approximation and \(l_{\frac{1}{2}}\) regularization. SIViP 15, 341–349 (2021). https://doi.org/10.1007/s11760-020-01752-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-020-01752-x

Keywords

Navigation