ABSTRACT
anonical Correlation Analysis (CCA) requires paired multimodal data to ascertain the relation between two variables. However, it is generally difficult to collect a sufficient amount of paired data of two variables as training samples. This fact leads individual samples of unpaired variables to be additional resources for learning CCA, which are not only able to increase the number of training samples; they are also effective to remove the learning bias caused by the variables' missing patterns. As described in this paper, we propose a novel model of probabilistic CCA by considering the mechanism of data missing. Our method enables widespread applications such as semi-supervised learning via partially labeled training samples and analysis of sensory data which are lacking under certain circumstances. We demonstrate the superior performance of parameter estimation as well as an application of image annotation, compared with existing methods.
- P. Duygulu, K. Barnard, J. F. de Freitas, and D. A. Forsyth. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In ECCV, 2002. Google ScholarDigital Library
- Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.Google Scholar
- A. Kimura, H. Kameoka, M. Sugiyama, T. Nakano, E. Maeda, H. Sakano, and K. Ishiguro. SemiCCA: Efficient semi-supervised learning of canonical correlations. In ICPR, 2010. Google ScholarDigital Library
- X.-L. Meng and D. B. Rubin. Maximum likelihood estimation via the ECM algorithm: A general framework. Biometrika, 80:267--278, 1993.Google ScholarCross Ref
- H. Nakayama, T. Harada, and Y. Kuniyoshi. Canonical contextual distance for large-scale image annotation and retrieval. In International Workshop on Large-Scale Multimedia Mining and Retrieval, 2009. Google ScholarDigital Library
- D. B. Rubin. Inference and missing data. Biometrika, 63:581--592, 1976.Google ScholarCross Ref
- K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.Google Scholar
- J. Sun and S. Keates. Canonical correlation analysis on data with censoring and error information. Neural Networks and Learning Systems, 24:1909--1919, 2013.Google ScholarCross Ref
- B. Zhang, J. Hao, G. Ma, J. Yue, and Z. Shi. Semi-paired probabilistic canonical correlation analysis. In ICIIP, 2014.Google ScholarCross Ref
Index Terms
- Probabilistic Semi-Canonical Correlation Analysis
Recommendations
Canonical random correlation analysis
SAC '10: Proceedings of the 2010 ACM Symposium on Applied ComputingCanonical correlation analysis (CCA) is one of the most well-known methods to extract features from multi-view data and has attracted much attention in recent years. However, classical CCA is unsupervised and does not take class label information into ...
Core-Sets For Canonical Correlation Analysis
CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge ManagementCanonical Correlation Analysis (CCA) is a technique that finds how "similar" are the subspaces that are spanned by the columns of two different matrices A έℜ(of size m-x-n) and B έℜ(of size m-x-l). CCA measures similarity by means of the cosines of the ...
Canonical correlation analysis based on information theory
In this article, we propose a new canonical correlation method based on information theory. This method examines potential nonlinear relationships between <i>p</i> × 1 vector Y-set and <i>q</i> × 1 vector X-set. It finds canonical coefficient vectors a ...
Comments