Abstract
In this paper, a noise robust tensor based image clustering approach is proposed which can also perform well in the presence of gross errors. Our major contribution is the improved submodule identification technique in noisy environment by incorporating three important improvements: better low rank representation using reweighted nuclear norm, \(l_\frac{1}{2}\) regularization to accurately capture sparseness and an error term in the model for noise robustness. Reweighted nuclear norm is introduced in the clustering model to capture self-expressiveness property in a better manner. The \(l_\frac{1}{2}\) norm regularization is applied in place of \(l_1\)-norm to properly capture the correlation among data members. An error term is introduced into the model to separate noise and data, which brings a noise robust image clustering technique. Combined effect all the three factors results an accurate clustering method even under the presence of severe noise. The performance of the proposed method is tested on different datasets with varying amount of noise. It is found that the proposed method provides better classification accuracy in almost all conditions as compared with existing methods.
Similar content being viewed by others
References
Chen, Y., Wang, Y., Li, M., He, G.: Augmented Lagrangian alternating direction method for low-rank minimization via non-convex approximation. Signal Image Video Process. 11, 1271–1278 (2017)
Elhamifar, E., Vidal, R.: Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 35, 2765–2781 (2013)
Liu, G., Lin, Z., Yu, Y.: Robust subspace segmentation by low-rank representation. In: Proceedings of the 27th International Conference on Machine Learning, pp. 663–670 (2010)
Mohan, A., Baburaj, M.: Submodule clustering based on latent representation tensor. In: Proceedings of the IEEE 2nd International Conference on Intelligent Computing, Instrumentation and Control Technologies, pp. 1021–1024 (2019)
Ng, A.Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Proccedings of the Advances in Neural Information Processing Systems, pp. 849–856 (2002)
Parsons, L., Haque, E., Liu, H.: Subspace clustering for high dimensional data: a review. ACM sIGKDD Explor. Newslett. 6, 90–105 (2004)
Tang, K., Liu, R., Su, Z., Zhang, J.: Structure-constrained low-rank representation. IEEE Trans. Neural Netw. Learn. Syst. 2, 2167–2179 (2014)
Wu, T.: Graph regularized low-rank representation for submodule clustering. Pattern Recognit. Lett. 100, 107145 (2020)
Zhao, Z., Bai, L., Zhang, Y., Han, J.: Classification via semi-supervised multi-random subspace sparse representation. Signal, Image Video Process. 13, 1387–1394 (2019)
Wu, J., Lin, Z., Zha, H.: Essential tensor learning for multi-view spectral clustering. arXiv preprint arXiv:1807.03602 (2018)
Wu, T., Bajwa, W.U.: A low tensor-rank representation approach for clustering of imaging data. IEEE Signal Process. Lett. 25, 1196–1200 (2018)
Kernfeld, E., Kilmer, M., Aeron, S.: Tensor-tensor products with invertible linear transforms. Linear Algebra Appl. 485, 545–570 (2015)
Lu, C., Feng, J., Chen, Y,. Liu, W., Lin, Z., Yan, S.: Tensor robust principal component analysis: exact recovery of corrupted low-rank tensors via convex optimization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5249–5257 (2016)
Madathil, B., George, S.N.: Twist tensor total variation regularized-reweighted nuclear norm based tensor completion for video missing area recovery. Inf. Sci. 423, 376–397 (2018)
Madathil, B., Sagheer, S.V.M., Rahiman, V., Tom, A.J., Francis, J., George, S.N.: Tensor low rank modeling and its applications in signal processing. arXiv preprint arXiv:1912.03435 (2019)
Piao, X., Hu, Y, Gao, J., Sun, Y., Lin, Z., Yin, B.: Tensor sparse and low-rank based submodule clustering method for multi-way data. arXiv preprint arXiv:1601.00149 (2016)
Zhang, Y., Yang, W., Liu, B., Ke, G., Pan, Y., Yin, J.: Multi-view spectral clustering via tensor-svd decomposition. In: Proceedings of the IEEE 29th International Conference on Tools with Artificial Intelligence, pp. 493–497 (2017)
Kernfeld, E., Aeron, S., Kilmer, M.: Clustering multi-way data: a novel algebraic approach. arXiv preprint arXiv:1412.7056 (2014)
Xu, Z., Chang, X., Xu, F., Zhang, H.: \(l_{1/2}\) regularization: a thresholding representation theory and a fast solver. IEEE Trans. Neural Netw. Learn. Syst. 23, 1013–1027 (2012)
Zhu, L., Hao, Y., Song, Y.: \(l_{1/2}\) norm and spatial continuity regularized low-rank approximation for moving object detection in dynamic background. IEEE Signal Process. Lett. 25, 15–19 (2018)
Zeng, J., Lin, S., Wang, Y., Xu, Z.: \(l_{1/2}\) regularization: convergence of iterative half thresholding algorithm. IEEE Trans. Signal Process. 62, 2317–2329 (2014)
Candes, E.J., Wakin, M.B., Boyd, S.P.: Enhancing sparsity by reweighted \(l_1\) minimization. J. Fourier Anal. Appl. 14, 877–905 (2008)
Johnson, A., Francis, J., Madathil, B., George, S.N.: A two-way optimization framework for clustering of images using weighted tensor nuclear norm approximation. In: Proceedings of the 26th National Conference on Communications (NCC), pp. 1–5 (2020)
Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2011)
Nene, S.A., Nayar, S.K., Murase, H.: Columbia object image library (Coil-20). Tech. rep (1996)
LeCun, Y.: The mnist database of handwritten digits. http://yann.lecun.com/exdb/mnist/ (MNIST) (1998). Accessed 03 Oct 2019
Mahadevan, V., Vasconcelos, N.: Spatiotemporal saliency in dynamic scenes. IEEE Trans. Pattern Anal. Mach. Intell. 32, 171–177 (2010)
Krizhevsky, A., Hinton, G.: Learning multiple layers of features from tiny images. Tech Report (2009)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Madathil, B., George, S.N. Noise robust image clustering based on reweighted low rank tensor approximation and \(l_{\frac{1}{2}}\) regularization. SIViP 15, 341–349 (2021). https://doi.org/10.1007/s11760-020-01752-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-020-01752-x