Abstract
The Genvar criterion, proposed by Steel, is one of the important generalizations of canonical correlation analysis. This paper deals with iterative methods for the Genvar criterion. An alternating variable method is analysed and an inexact version of it is proposed. Two starting point strategies are suggested to enhance these iterative algorithms. Numerical results show that, these starting point strategies not only can improve the rate of convergence, but also boost up the probability of finding a global solution.
Similar content being viewed by others
References
Hotelling, H.: Relations between two sets of variables. Biometrika 28, 321–377 (1936)
Steel, R.G.D.: Minimum generalized variance for a set of linear functions. Ann. Math. Statist. 22, 456–460 (1951)
Kettenring, J.R.: Canonical analysis of several sets of variables. Biometrika 58, 433–451 (1971)
Horst, P.: Relations among m sets of measures. Psychometrika 26, 129–149 (1961)
Van De Geer, J.P.: Linear relations among k sets of variables. Psychometrika 49(1), 70–94 (1984)
Hanafi, M., Kiers, H.A.L.: Analysis of K sets of data, with differential emphasis on agreement between and within sets. Comput. Statist. Data Anal. 51, 1491–1508 (2006)
Vía, J., Santamaría, I., Pérez, J.: Canonical correlation analysis (CCA) algorithms for multiple data sets: an application to blind SIMO equalization. European Signal Processing Conference, EUPSIPCO, Antalya, Turkey (2005)
Vía, J., Santamaría, I., Pérez, J.: A learning algorithm for adaptive canonical correlation analysis of several data sets. Neural Netw. 20, 139–152 (2007)
De leeuw, J.: Multivariate analysis with optimal scaling. In: Das Gupta, S., Ghosh, J.K.( eds.) Proceedings of the International Conference on Advances in Multivariate Statistical Analysis, Calcutta, pp. 127–160 (1988)
Zhang, Y.T., Zhu, X.D.: Correlation of K groups of random variables. Chin. J. Appl. Probab. Statist. 4(1), 27–34 (1988)
Yuan, Y.H., et al.: A novel multiset integrated canonical correlation analysis framework and its application in feature fusion. Pattern Recognit. 44, 1031–1040 (2011)
Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, New York (1999)
Geomans, M.Z., Williamson, D.P.: Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming. J. ACM 42, 1115–1145 (1995)
Golub, G.H., Van Loan, C.F.: Matrix Computations, 3rd edn. Johns Hopkins University Press, Baltimore (1996)
Kiers, H.A.L.: Setting up alternating least squares and iterative majorization algorithms for solving various matrix optimization problems. Comput. Statist. Data Anal. 41, 157–170 (2002)
Acknowledgments
We are very grateful to both referees for their constructive comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was partially supported by NSF of China, Grant 11371333.
Rights and permissions
About this article
Cite this article
Liu, X., You, J. Numerical Methods for the Genvar Criterion of Multiple-Sets Canonical Analysis. J Sci Comput 67, 821–835 (2016). https://doi.org/10.1007/s10915-015-0103-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10915-015-0103-7
Keywords
- Multiple-sets canonical correlation analysis
- Genvar criterion
- Alternating variable method
- Starting point strategy