Skip to main content
Springer Nature Link
Log in

Principal component selection using interactive evolutionary computation

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

We propose a method to solve the selection problem of principal components in machine learning algorithms based on orthogonal transformation using interactive evolutionary computation. The orthogonal transformation presents a linear transformation method that preserves the inner product in the two coordinate systems, the one is before the transformation, and the other is after the transformation. One of the addressed subjects for machine learning algorithms based on orthogonal transformation is how to decide the number of principal components, and which of the principal components should be used to reconstruct the original data. In this work, we use the interactive differential evolution algorithm to study these subjects using real humans’ subjective evaluation in optimization process. An image compression problem using principal component analysis is introduced to study the proposed method. We do not only solve the selection problem of principal components for machine learning algorithms based on orthogonal transformation using interactive evolutionary computation, but also can analyse the human aesthetical characteristics on visual perception and feature selection arising from the designed method and experimental evaluation. We also discuss and analyse potential research subjects and some open topics, which are invited to further investigate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Baudat G, Anouar F (2000) Generalized discriminant analysis using a kernel approach. Neural Comput 12(10):2385–2404

    Article  Google Scholar 

  2. Berger CEH, Koeijer JA, Glas W, Madhuizen HT (2006) Color separation in forensic image processing. J Forensic Sci 51(1):100–102

    Article  Google Scholar 

  3. Dawkins R (1986) Blind watchmaker. Alfred A Knopf, New York

    Google Scholar 

  4. Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7(2):179–188

    Article  Google Scholar 

  5. Lehmann EL, Casella G (1998) Theory of point estimation, vol 31. Springer Science & Business Media, Berlin

    MATH  Google Scholar 

  6. Li Y, Hu C, Minku LL, Zuo H (2013) Learning aesthetic judgements in evolutionary art systems. Genet Program Evolvable Mach 14(3):315–337

    Article  Google Scholar 

  7. Lim IS, Thalmann D (2000) Tournament selection for browsing temporal signals. In: Proceedings of the 2000 ACM Symposium on Applied Computing, vol 2. ACM, pp 570–573

  8. Miller GA (1956) The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychol Rev 63(2):81–97

    Article  Google Scholar 

  9. Ono S, Maeda H, Sakimoto K, Nakayama S (2014) User-system cooperative evolutionary computation for both quantitative and qualitative objective optimization in image processing filter design. Appl Soft Comput 15:203–218

    Article  Google Scholar 

  10. Papoulis A, Pillai SU (2002) Probability, random variables, and stochastic processes. Tata McGraw-Hill Education, New York

    Google Scholar 

  11. Pearson K (1901) Liii. on lines and planes of closest fit to systems of points in space. Lond Edinb Dublin Philos Mag J Science 2(11):559–572

    Article  MATH  Google Scholar 

  12. Pei Y (2013) A chaotic ergodicity based evolutionary computation algorithm. In: 2013 Ninth International Conference on Natural Computation (ICNC2013). 23–25 Jul 2013 IEEE, pp 454–459

  13. Pei Y (2014) Chaotic evolution: fusion of chaotic ergodicity and evolutionary iteration for optimization. Nat Comput 13(1):79–96

    Article  MathSciNet  Google Scholar 

  14. Pei Y (2014) Study on efficient search in evolutionary computation. PhD thesis. Kyushu University

  15. Pei Y (2015) From determinism and probability to chaos: chaotic evolution towards philosophy and methodology of chaotic optimization. Sci World J 2015:14. doi:10.1155/2015/704587

  16. Pei Y (2015) Linear principal component discriminant analysis. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC2015), IEEE, Oct, 9–12 2015, pp 2108–2113

  17. Pei Y, Takagi H (2013) Triple and quadruple comparison-based interactive differential evolution and differential evolution. In: Foundations of Genetic Algorithms Workshop XII (FOGA2013), ACM, Jan, 16–20 2013, pp 173–182

  18. Pei Y, Takagi H, (2015) Local information of fitness landscape obtained by paired comparison-based memetic search for interactive differential evolution. In: 2015 IEEE Congress on Evolutionary Computation (IEEE CEC2015), IEEE, May, 25–28 2015, pp 2215-2221

  19. Price K, Storn RM, Lampinen JA (2006) Differential evolution: a practical approach to global optimization. Springer Science & Business Media, Berlin

  20. Schölkopf B, Smola A, Müller K-R (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10(5):1299–1319

    Article  Google Scholar 

  21. Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27(3):379–423

    Article  MathSciNet  MATH  Google Scholar 

  22. Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359

    Article  MathSciNet  MATH  Google Scholar 

  23. Takagi H (2001) Interactive evolutionary computation: fusion of the capabilities of ec optimization and human evaluation. Proc IEEE 89(9):1275–1296

    Article  Google Scholar 

  24. Takagi H, Pallez D (2009) Paired comparison-based interactive differential evolution. In: World Congress on Nature & Biologically Inspired Computing 2009 (NaBIC 2009). 9–11 Dec 2009 IEEE, pp 475–480

  25. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Division, The University of Aizu, Tsuruga, Ikki-machi, Aizuwakamatsu, Fukushima, 965-8580, Japan

    Yan Pei

Authors
  1. Yan Pei
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Yan Pei.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pei, Y. Principal component selection using interactive evolutionary computation. J Supercomput 73, 3002–3020 (2017). https://doi.org/10.1007/s11227-016-1829-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-016-1829-1

Keywords