skip to main content
10.1145/1273496.1273569acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmlConference Proceedingsconference-collections
Article

Discriminant analysis in correlation similarity measure space

Published: 20 June 2007 Publication History

Abstract

Correlation is one of the most widely used similarity measures in machine learning like Euclidean and Mahalanobis distances. However, compared with proposed numerous discriminant learning algorithms in distance metric space, only a very little work has been conducted on this topic using correlation similarity measure. In this paper, we propose a novel discriminant learning algorithm in correlation measure space, Correlation Discriminant Analysis (CDA). In this framework, based on the definitions of within-class correlation and between-class correlation, the optimum transformation can be sought for to maximize the difference between them, which is in accordance with good classification performance empirically. Under different cases of the transformation, different implementations of the algorithm are given. Extensive empirical evaluations of CDA demonstrate its advantage over alternative methods.

References

[1]
Barker, M., & Rayens W.(2003). Partial least squares for discrimination. Journal of Chemometrics, Vol 17, pp. 166--173.
[2]
Belhumeur, P. N., Hespanha, J., & Kriegman, D. (1997). Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8, 19(7):711--720.
[3]
Blake, C. L. & Merz, C. J. (1998) UCI repository of machine learning databases, URL http://www.ics.uci.edu/~mlearn/MLRepository.html.
[4]
Brown, M. P, Grundy, W. N., Lin, D., Cristianini, N., Sugnet, C. W., Furey, T. S. & Haussler, D. (2000). Knowledge-based analysis of microarray gene expression data by using support vector machines. Proceedings of the National Academy of Science, 97, pp.262--267.
[5]
Fukunaga, K. (1990). Statistical pattern recognition. Academic Press, San Diego, 2nd edition.
[6]
Golub, G. H. & Van Loan, C. F. (1996) Matrix computations. Johns Hopkins University Press.
[7]
Han, E. H., Karypis, G. & Kuma, V. (2001), Text categorization using weight adjusted k-Nearest Neighbor classification. 5th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), pp.53--65.
[8]
Hardoon, D. R., Szedmak, S. & Taylor, J. S (2004). Canonical correlation analysis: an overview with application to learning method, Neural Computation, Vol. 16, pp: 2639--2664.
[9]
Hillel, A. B., Hertz, T., Shental, N. & Weinshall, D. (2005). Learning a Mahalanobis metric from equivalence constraints. Journal of Machine Learning Research Vol 6, pp.937--965.
[10]
Johansson, B. (2001). On classification: simultaneously reducing dimensionality and finding automatic representation using canonical correlation. Technical report LiTH-ISY-R-2375, ISSN 1400-3902, Linköping University
[11]
Kittler, J., Li, Y. P. & Matas, J. (2000) On matching scores for LDAbased face verification. Proceedings of British Machine Vision Conference (BMVC00), pp. 42--51.
[12]
Kumar, B. V. (1986). Minimum variance synthetic discriminant functions. Journal of the Optical Society of America A: Optics, Image Science, and Vision, Vol 3, Issue 10, pp.1579--1584.
[13]
Loog, M., Ginneken, B. V. & Duin, R. W. (2004) Dimensionality reduction by Canonical Contextual Correlation projections, the 8th European Conference on Computer Vision, pp.562 -- 573.
[14]
Mahalanobis, A., Kumar, B. V, & Casasent, D. (1987). Minimum average correlation energy filters. Applied Optics, Vol. 26, Issue 17, pp. 3633--3645.
[15]
Martinez, A. M. & Zhu, M. L. (2005). Where are linear feature extraction methods applicable. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol 27, Issue 12 pp.1934--1944.
[16]
Peterson, M. R., Doom, T. E. & Raymer, M. L. (2005). Facilitated KNN classifier optimization with varying similarity measures. IEEE Congress on Evolutionary Computation, vol 3, pp. 2514--2521.
[17]
Phillips, P. J., Moon, H., Rauss, P. J. & Rizvi, S.,(2000) The FERET evaluation methodology for face recognition algorithms, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 10, pp. 1756--1760.
[18]
Refregier, P. (1990). Filter design for optical pattern recognition: multi-criteria optimization approach. Optics Letters, Vol 15, Issue 15, pp.854--856
[19]
Rockafellar, R. (1970) Convex analysis. Princeton University Press.
[20]
Smith, R. S., Kittler, J., Hamouz, M.& Illingworth, J. (2006). Face recognition using angular LDA and SVM ensembles. Proceedings of the 18th International Conference on Pattern Recognition (ICPR'06), Vol 3, pp.1008--1012.
[21]
Sun, T. K. & Chen, S. C. (2007), Class label- versus sample label-based CCA. Applied Mathematics and Computation (in press).
[22]
Tipping M. E. (2001) Sparse bayesian learning and the relevance vector machine. Journal of Machine Learning Research, 1, pp.211--214.
[23]
Xie, C. Y., Savvides, M. & Kumar, B. V. (2005). Redundant class-dependence feature analysis based on correlation filters using FRGC2.0 data. Proceedings of the Computer Vision and Pattern Recognition, Vol 3, pp.153--153.
[24]
Xing, E. P., Ng, A. Y., Jordan, M. I. & Russell, S. (2003). Distance metric learning, with application to clustering with side-information. Advances in Neural Information Processing Systems 15, pp. 521--528.
[25]
Yeung, D. Y. & Chang H. (To appear) A kernel approach for semi-supervised metric learning. IEEE Transactions on Neural Networks.
[26]
Vapnik V. (1995), The nature of statistical learning theory. New York: Springer Verlag.

Cited By

View all
  • (2024)Euler Kernel Mapping for Hyperspectral Image Clustering via Self-Paced LearningRemote Sensing10.3390/rs1621409716:21(4097)Online publication date: 2-Nov-2024
  • (2024)Sample Correlation for Fingerprinting Deep Face RecognitionInternational Journal of Computer Vision10.1007/s11263-024-02254-wOnline publication date: 25-Oct-2024
  • (2023)Multi-view Discriminative Fusion on Canonical Correlation Analysis in Event Classification2023 15th International Conference on Computer Research and Development (ICCRD)10.1109/ICCRD56364.2023.10080508(151-155)Online publication date: 10-Jan-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICML '07: Proceedings of the 24th international conference on Machine learning
June 2007
1233 pages
ISBN:9781595937933
DOI:10.1145/1273496
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Machine Learning Journal

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2007

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Article

Conference

ICML '07 & ILP '07
Sponsor:

Acceptance Rates

Overall Acceptance Rate 140 of 548 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)31
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Euler Kernel Mapping for Hyperspectral Image Clustering via Self-Paced LearningRemote Sensing10.3390/rs1621409716:21(4097)Online publication date: 2-Nov-2024
  • (2024)Sample Correlation for Fingerprinting Deep Face RecognitionInternational Journal of Computer Vision10.1007/s11263-024-02254-wOnline publication date: 25-Oct-2024
  • (2023)Multi-view Discriminative Fusion on Canonical Correlation Analysis in Event Classification2023 15th International Conference on Computer Research and Development (ICCRD)10.1109/ICCRD56364.2023.10080508(151-155)Online publication date: 10-Jan-2023
  • (2023)Learning enhanced specific representations for multi-view feature learningKnowledge-Based Systems10.1016/j.knosys.2023.110590272(110590)Online publication date: Jul-2023
  • (2022)Deep Semisupervised Multiview Learning With Increasing ViewsIEEE Transactions on Cybernetics10.1109/TCYB.2021.309362652:12(12954-12965)Online publication date: Dec-2022
  • (2021)Multiview Feature Selection for Single-View ClassificationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2020.298701343:10(3573-3586)Online publication date: 1-Oct-2021
  • (2021)Hyperspectral Image Clustering: Current achievements and future linesIEEE Geoscience and Remote Sensing Magazine10.1109/MGRS.2020.30325759:4(35-67)Online publication date: Dec-2021
  • (2019)Multi-View Linear Discriminant Analysis NetworkIEEE Transactions on Image Processing10.1109/TIP.2019.291351128:11(5352-5365)Online publication date: Nov-2019
  • (2019)Multi-view Classification via Adaptive Discriminant AnalysisIEEE Access10.1109/ACCESS.2019.2905008(1-1)Online publication date: 2019
  • (2018)Generalized Multi-View Embedding for Visual Recognition and Cross-Modal RetrievalIEEE Transactions on Cybernetics10.1109/TCYB.2017.274270548:9(2542-2555)Online publication date: Sep-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media