Skip to main content
SpringerLink
Log in

Ensemble of Tensor Classifiers Based on the Higher-Order Singular Value Decomposition

  • Conference paper
Hybrid Artificial Intelligent Systems (HAIS 2012)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7209))

Included in the following conference series:

Abstract

In this paper we present an ensemble composed of classifiers operating with multi-dimensional data. Classification is performed in tensor spaces spanned by the basis obtained from the Higher-Order Singular Value Decomposition of the pattern tensors. These showed superior results when processing multi-dimensional data, such as sequences of images. However, multi-dimensionality leads to excessive computational requirements. The proposed method alleviates this problem, first by partitioning the input dataset, and then by feeding each partition into a separate tensor classifiers of the ensemble. Despite the computational advantages, also accuracy of the ensemble showed to be higher compared to a single classifier case. The method was tested in the context of object recognition in computer vision. In the paper we discuss also methods of input image prefiltering in order to increase accuracy. The conducted experiments show high efficacy of the proposed solution.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cichocki, A., Zdunek, R., Amari, S.: Nonnegative Matrix and Tensor Factorization. IEEE Signal Processing Magazine 25(1), 142–145 (2008)

    Article  Google Scholar 

  2. Cyganek, B., Siebert, J.P.: An Introduction to 3D Computer Vision Techniques and Algorithms. Wiley (2009)

    Google Scholar 

  3. Cyganek, B.: An Analysis of the Road Signs Classification Based on the Higher-Order Singular Value Decomposition of the Deformable Pattern Tensors. In: Blanc-Talon, J., Bone, D., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2010, Part II. LNCS, vol. 6475, pp. 191–202. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  4. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley (2001)

    Google Scholar 

  5. Grandvalet, Y.: Bagging equalizes influence. Machine Learning 55, 251–270 (2004)

    Article  MATH  Google Scholar 

  6. Hull, J.: A database for handwritten text recognition research. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(5), 550–554 (1994)

    Article  Google Scholar 

  7. Jackowski, K., Woźniak, M.: Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas. Pattern Analysis and Applications 12, 415–425 (2009)

    Article  Google Scholar 

  8. Kittler, J., Hatef, M., Duing, R.P.W., Matas, J.: On Combining Classifiers. IEEE PAMI 20(3), 226–239 (1998)

    Article  Google Scholar 

  9. Kolda, T.G., Bader, B.W.: Tensor Decompositions and Applications. SIAM Review, 455–500 (2008)

    Google Scholar 

  10. Kuncheva, L.I.: Combining Pattern Classifiers. Methods and Algorithms. Wiley Interscience (2005)

    Google Scholar 

  11. de Lathauwer, L.: Signal Processing Based on Multilinear Algebra. PhD dissertation, Katholieke Universiteit Leuven (1997)

    Google Scholar 

  12. de Lathauwer, L., Moor de, B., Vandewalle, J.: A Multilinear Singular Value Decomposition. SIAM Journal of Matrix Analysis and Applications 21(4), 1253–1278 (2000)

    Article  MATH  Google Scholar 

  13. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-Based Learning Applied to Document Recognition. Proc. IEEE on Speech & Image Processing 86(11), 2278–2324 (1998)

    Google Scholar 

  14. Polikar, R.: Ensemble Based Systems in Decision Making. IEEE Circuits and Systems Magazine, 21–45 (2006)

    Google Scholar 

  15. Savas, B., Eldén, L.: Handwritten digit classification using higher order singular value decomposition. Pattern Recognition 40, 993–1003 (2007)

    Article  MATH  Google Scholar 

  16. Szeliski, R.: Computer Vision. Algorithms and Applications. Springer, Heidelberg (2011)

    MATH  Google Scholar 

  17. Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 4th edn. Academic Press (2009)

    Google Scholar 

  18. Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)

    Article  Google Scholar 

  19. Vasilescu, M.A.O., Terzopoulos, D.: Multilinear Analysis of Image Ensembles: TensorFaces. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part I. LNCS, vol. 2350, pp. 447–460. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  20. http://www-stat.stanford.edu/~tibs/ElemStatLearn/

Download references

Author information

Authors and Affiliations

  1. AGH University of Science and Technology, Al. Mickiewicza 30, 30-059, Kraków, Poland

    Bogusław Cyganek

Authors
  1. Bogusław Cyganek
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Universidad de Salamanca, Plaza de la Merced S/N, 37008, Salamanca, Spain

    Emilio Corchado

  2. VŠB-TU Ostrava 17, Listopadu 15, 70833, Ostrava, Czech Republic

    Václav Snášel

  3. Machine Intelligence Research Labs Machine Intelligence Research Labs(MIR Labs),, Scientific Network for Innovation and Research Excellence, P.O. Box 2259, 98071, Auburn, Washington, USA

    Ajith Abraham

  4. Wroclaw University of Technology, Wybrzeze Wyspianskiego 27, 50-370, Wroclaw, Poland

    Michał Woźniak

  5. University of the Basque Country, Pº Manuel Lardizabal 1, 20018, San Sebastian, Spain

    Manuel Graña

  6. Yonsei University, 134 Shinchon-dong, 120-749, Sudaemoon-ku, Seoul, Korea

    Sung-Bae Cho

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Cyganek, B. (2012). Ensemble of Tensor Classifiers Based on the Higher-Order Singular Value Decomposition. In: Corchado, E., Snášel, V., Abraham, A., Woźniak, M., Graña, M., Cho, SB. (eds) Hybrid Artificial Intelligent Systems. HAIS 2012. Lecture Notes in Computer Science(), vol 7209. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28931-6_55

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28931-6_55

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28930-9

  • Online ISBN: 978-3-642-28931-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation