Abstract
Parallel matrix factorization has recently emerged as a powerful tool for low-rank tensor recovery problems. However, using only the low-rank property is often not sufficient for recovering valuable details in images. Generally, incorporating additional prior knowledge shows significant improvement in the recovered results. Therefore, smooth matrix factorization has been introduced for tensor completion in which the smoothness of its spectral factor over the third mode has been recently considered. However, these models may not efficiently characterize the smoothness of the target tensor. Thus, in this work, we are interested in boosting the piecewise smoothness by using the third-mode smoothness of the underlying tensor combined with spectral sparsity of the third factor of the factorization. Therefore, we propose in this paper a parallel matrix factorization-based sparsity constraint with a smoothness prior to the third mode of the target tensor. We develop a multi-block proximal alternating minimization algorithm for solving the proposed model. Theoretically, we show that the generated sequence globally converges to a critical point. The superiority of our model over other tensor completion methods in terms of several evaluation metrics is reported via extensive experiments conducted on real data such as videos, hyperspectral images, and MRI data.








References
Banouar O, Mohaoui S, Raghay S (2018) Collaborating filtering using unsupervised learning for image reconstruction from missing data. EURASIP J Adv Signal Process 2018(1):1–12
Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imag Sci 2(1):183–202
Bengua JA, Phien HN, Tuan HD, Do MN (2017) Efficient tensor completion for color image and video recovery: Low-rank tensor train. IEEE Trans Image Process 26(5):2466–2479
Bolte J, Daniilidis A, Lewis A (2007) The łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems. SIAM J Optim 17(4):1205–1223
Bredies K, Lorenz DA (2008) Linear convergence of iterative soft-thresholding. J Fourier Anal Appl 14(5–6):813–837
Candes EJ, Recht B (2008) Exact low-rank matrix completion via convex optimization. In: 2008 46th annual allerton conference on communication, control, and computing, IEEE, pp 806–812
Carroll JD, Pruzansky S, Kruskal JB (1980) Candelinc: a general approach to multidimensional analysis of many-way arrays with linear constraints on parameters. Psychometrika 45(1):3–24
Combettes PL, Wajs VR (2005) Signal recovery by proximal forward-backward splitting. Multiscale Model Simul 4(4):1168–1200
Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear gauss-seidel method under convex constraints. Oper Res Lett 26(3):127–136
He J, Zheng X, Gao P, Zhou Y (2022) Low-rank tensor completion based on tensor train rank with partially overlapped sub-blocks. Signal Process 190:108339
Hu Y, Zhang D, Ye J, Li X, He X (2012) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130
Iordache M-D, Bioucas-Dias JM, Plaza A (2012) Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans Geosci Remote Sens 50(11):4484–4502
Ji T-Y, Huang T-Z, Zhao X-L, Ma T-H, Liu G (2016) Tensor completion using total variation and low-rank matrix factorization. Inf Sci 326:243–257
Jiang T-X, Huang T-Z, Zhao X-L, Deng L-J (2020) Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm. J Comput Appl Math 372:112680
Jiang T-X, Huang T-Z, Zhao X-L, Ji T-Y, Deng L-J (2018) Matrix factorization for low-rank tensor completion using framelet prior. Inf Sci 436:403–417
Jiang T-X, Ng MK, Zhao X-L, Huang T-Z (2020) Framelet representation of tensor nuclear norm for third-order tensor completion. IEEE Trans Image Process 29:7233–7244
Kilmer ME, Braman K, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172
Kilmer ME, Martin CD (2011) Factorization strategies for third-order tensors. Linear Algebra Appl 435(3):641–658
Liu J, Musialski P, Wonka P, Ye J (2012) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220
Liu Y, Shang F (2013) An efficient matrix factorization method for tensor completion. IEEE Signal Process Lett 20(4):307–310
Ma S, Goldfarb D, Chen L (2011) Fixed point and bregman iterative methods for matrix rank minimization. Math Program 128(1):321–353
Mohaoui S, Hakim A, Raghay S (2021) Tensor completion via bilevel minimization with fixed-point constraint to estimate missing elements in noisy data. Adv Comput Math 47(1):1–27
Mohaoui S, Hakim A, Raghay S (2022) Smooth tensor robust principal component analysis with application to color image recovery. Digit Signal Process, p 103390
Nesterov Y (2013) Gradient methods for minimizing composite functions. Math Program 140(1):125–161
Nesterov YE (1983) A method for solving the convex programming problem with convergence rate o (1/k\(^{2}\)). Dokl akad nauk Sssr 269:543–547
Oseledets IV (2011) Tensor-train decomposition. SIAM J Sci Comput 33(5):2295–2317
Qian Y, Jia S, Zhou J, Robles-Kelly A (2011) Hyperspectral unmixing via \( l_ 1/2 \) sparsity-constrained nonnegative matrix factorization. IEEE Trans Geosci Remote Sens 49(11):4282–4297
Sargent R, Sebastian D (1973) On the convergence of sequential minimization algorithms. J Optim Theory Appl 12(6):567–575
Semerci O, Hao N, Kilmer ME, Miller EL (2014) Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23(4):1678–1693
Tan H, Cheng B, Wang W, Zhang Y-J, Ran B (2014) Tensor completion via a multi-linear low-n-rank factorization model. Neurocomputing 133:161–169
Tucker LR (1966) Some mathematical notes on three-mode factor analysis. Psychometrika 31(3):279–311
Warga J (1963) Minimizing certain convex functions. J Soc Ind Appl Math 11(3):588–593
Wen Z, Yin W, Zhang Y (2012) Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math Program Comput 4(4):333–361
Xu Y, Hao R, Yin W, Su Z (2013) Parallel matrix factorization for low-rank tensor completion. arXiv preprint arXiv:1312.1254
Xu Y, Yin W (2013) A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion. SIAM J Imag Sci 6(3):1758–1789
Xue S, Qiu W, Liu F, Jin X (2018) Low-rank tensor completion by truncated nuclear norm regularization. In: 2018 24th international conference on pattern recognition (ICPR), IEEE, pp 2600–2605
Zhang Z, Ely G, Aeron S, Hao N, Kilmer M (2014) Novel methods for multilinear data completion and de-noising based on tensor-svd. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3842–3849
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mohaoui, S., Hakim, A. & Raghay, S. Parallel matrix factorization-based collaborative sparsity and smooth prior for estimating missing values in multidimensional data. Pattern Anal Applic 25, 963–980 (2022). https://doi.org/10.1007/s10044-022-01082-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-022-01082-3