Skip to main content
Log in

Class-adapted local fisher discriminant analysis to reduce highly-dimensioned data on commodity hardware: application to hyperspectral images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Local Fisher Discriminant Analysis (LFDA) is a supervised feature extraction technique that proved to be efficient in reducing several types of data. However, it depends on the number of samples per class in a way that can lead, when classes are too large, to a consumption of all the memory of a commodity hardware, or to a disability to even run. To work around this limit, we hereby propose to introduce a parameter that adapts LFDA to the data’s classes while accounting for the available resources on the used machine. In fact, according to this parameter, LFDA will consider a larger class as a set of smaller sub-classes and will process these latter instead of the larger one. We are calling our proposed optimization the class-adapted LFDA, noted caLFDA. We also propose a Python implementation of LFDA and prove it more effective than the existent MATLAB implementation. To assess the efficiency of caLFDA, we applied it to reduce several hyperspectral images and compared the results of classifying the reduced images to the ones we get when using the original LFDA to reduce the data. When the hyperspectral images are too large for LFDA to be able to reduce them, we compare caLFDA’s results to the ones we get with the most commonly used Principle Component Analysis (PCA).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. Available online at http://www.ms.k.u-tokyo.ac.jp/software.html#LFDA

  2. All data sets and their respective ground-truth are available online at http://www.ehu.eus/ccwintco/index.php?title=Hyperspectral_Remote_Sensing_Scenes

References

  1. Carbonnelle P (2018) Pypl: Popularity of programming language. http://pypl.github.io/PYPL.html. Accessed: 2018-03-08

  2. Cass S (2017) Ieee spectrum: The 2017 top programming languages. https://spectrum.ieee.org/computing/software/the-2017-top-programming-languages. Accessed: 2018-03-08

  3. Chen HL, Liu DY, Yang B, Liu J, Wang G (2011) A new hybrid method based on local fisher discriminant analysis and support vector machines for hepatitis disease diagnosis. Expert Syst Appl 803(9):11, 796–11

    Article  Google Scholar 

  4. Dalla Mura M, Benediktsson JA, Waske B, Bruzzone L (2010) Extended profiles with morphological attribute filters for the analysis of hyperspectral data. Int J Remote Sens 31(22):5975–5991

    Article  Google Scholar 

  5. Fangohr H (2004) A comparison of c, matlab, and python as teaching languages in engineering. Computational Science-ICCS 2004, pp 1210–1217

  6. Fisher RA (1936) The use of multiple measurements in taxonomic problems. Ann Eugen 7(2):179–188

    Article  Google Scholar 

  7. Guo J, Chen H, Li Y (2014) Palmprint recognition based on local fisher discriminant analysis. JSW 9(2):287–292

    Google Scholar 

  8. Huang H, Li J, Liu J (2012) Enhanced semi-supervised local fisher discriminant analysis for face recognition. Futur Gener Comput Syst 28(1):244–253

    Article  Google Scholar 

  9. Li W, Prasad S, Fowler JE, Bruce LM (2012) Locality-preserving dimensionality reduction and classification for hyperspectral image analysis. IEEE Trans Geosci Remote Sens 50(4):1185–1198

    Article  Google Scholar 

  10. Li W, Prasad S, Fowler JE (2014) Hyperspectral image classification using gaussian mixture models and markov random fields. IEEE Geosci Remote Sens Lett 11 (1):153–157

    Article  Google Scholar 

  11. Liu Z, Wang J, Man J, Li Y, You X, Wang C (2012) Self-adaptive local fisher discriminant analysis for semi-supervised image recognition. International Journal of Biometrics 4(4):338–356

    Article  Google Scholar 

  12. Millman KJ, Aivazis M (2011) Python for scientists and engineers. Comput Sci Eng 13(2):9–12

    Article  Google Scholar 

  13. Niyogi X (2004) Locality preserving projections. In: Neural information processing systems, vol 16. MIT, p 153

  14. O’Grady S (2018) The redmonk programming language rankings: January 2018. http://redmonk.com/sogrady/2018/03/07/language-rankings-1-18/. Accessed: 2018-03-08

  15. Oliphant TE (2006) A guide to NumPy, vol 1. Trelgol Publishing, USA

    Google Scholar 

  16. Oliphant TE (2007) Scipy: Open source scientific tools for python. Comput Sci Eng 9:10–20

    Article  Google Scholar 

  17. Pedagadi S, Orwell J, Velastin S, Boghossian B (2013) Local fisher discriminant analysis for pedestrian re-identification. In: Proceedings of the ieee conference on computer vision and pattern recognition, pp 3318–3325

  18. Rahulamathavan Y, Phan RCW, Chambers JA, Parish DJ (2013) Facial expression recognition in the encrypted domain based on local fisher discriminant analysis. IEEE Trans Affect Comput 4(1):83–92

    Article  Google Scholar 

  19. Shen P, Lu X, Liu L, Kawai H (2016) Local fisher discriminant analysis for spoken language identification. In: 2016 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 5825–5829

  20. Song B, Li J, Dalla Mura M, Li P, Plaza A, Bioucas-Dias JM, Benediktsson JA, Chanussot J (2014) Remotely sensed image classification using sparse representations of morphological attribute profiles. IEEE Trans Geosci Remote Sens 52(8):5122–5136

    Article  Google Scholar 

  21. Stackoverflow developer survey results 2017: Most popular technologies - programming languages. https://insights.stackoverflow.com/survey/2017#most-popular-technologies. Accessed: 2018-03-08

  22. Sugiyama M (2007) Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis. J Mach Learn Res 8:1027–1061

    MATH  Google Scholar 

  23. Sugiyama M (2009) On computational issues of semi-supervised local fisher discriminant analysis. IEICE Trans Inf Syst 92(5):1204–1208

    Article  Google Scholar 

  24. Sugiyama M, Idé T, Nakajima S, Sese J (2008) Semi-supervised local fisher discriminant analysis for dimensionality reduction. In: Pacific-Asia conference on knowledge discovery and data mining. Springer, pp 333–344

  25. The mathworks: Matlab (2018) https://www.mathworks.com. Accessed: 2018-03-08

  26. Tiobe index for December 2017. https://www.tiobe.com/tiobe-index/. Accessed: 2018-03-08

  27. Yu J (2011) Localized fisher discriminant analysis based complex chemical process monitoring. AIChE J 57(7):1817–1828

    Article  Google Scholar 

  28. Zaatour R, Bouzidi S, Zagrouba E (2017) Impact of feature extraction and feature selection techniques on extended attribute profile-based hyperspectral image classification. In: Proceedings of the 12th international joint conference on computer vision, imaging and computer graphics theory and applications - volume 4: VISAPP, (VISIGRAPP 2017). INSTICC, ScitePress, pp 579–586. https://doi.org/10.5220/0006171305790586

  29. Zaatour R, Bouzidi S, Zagrouba E (2018) Parallel and distributed local fisher discriminant analysis to reduce hyperspectral images on cloud computing architectures. In: International conference on advanced concepts for intelligent vision systems. Springer, pp 245–257

  30. Zebin W u, Li Yonglong, Plaza Antonio, Li Jun, Xiao F u, Wei Zhihui (2016) Parallel and distributed dimensionality reduction of hyperspectral data on cloud computing architectures. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 9(6):2270–2278

    Article  Google Scholar 

  31. Zhang S, Lei B, Chen A, Chen C, Chen Y (2010) Spoken emotion recognition using local fisher discriminant analysis. In: 2010 IEEE 10th international conference on Signal processing (ICSP). IEEE, pp 538–540

  32. Zhang S, Zhao X, Lei B (2011) Facial expression recognition using local fisher discriminant analysis. Advances in computer science, environment, ecoinformatics, and education, pp 443–448

  33. Zhang S, Zhao X, Lei B (2012) Facial expression recognition based on local binary patterns and local fisher discriminant analysis. WSEAS Transactions on Signal Processing 8(1):21–31

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rania Zaatour.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zaatour, R., Bouzidi, S. & Zagrouba, E. Class-adapted local fisher discriminant analysis to reduce highly-dimensioned data on commodity hardware: application to hyperspectral images. Multimed Tools Appl 78, 17113–17134 (2019). https://doi.org/10.1007/s11042-018-6887-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6887-3

Keywords

Navigation