Abstract
High-dimensional multi-objective optimization will open promising approaches to many applications on bioinformatics once efficient parallel procedures are available. These procedures have to take advantage of the present heterogeneous architectures comprising multicore CPUs and GPUs. In this paper, we describe and analyze several OpenCL implementations for an application comprising multiobjective feature selection for clustering in an EEG classification task on high-dimensional patterns. These implementation alternatives correspond to different uses of multicore CPU and GPU platforms to process irregular data codes. Depending on the dataset used, we have reached speedups of up to 14.9 and 17.2 with up to 24 threads for the implemented OpenCL CPU kernels and of up to 7.1 and 9.1 with up to 13 SMX processors and 256 local work-items for our OpenCL GPU kernels. Nevertheless, to provide this level of performance, careful considerations about the use of the memory hierarchy of the heterogeneous architecture and different strategies to cope with the irregularity of our target application have to be taken into account.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Mukhopadhyay, A., et al.: A survey of multiobjective evolutionary algorithms for data mining: part I. IEEE Trans. Evol. Comput. 18(1), 4–19 (2014)
Mukhopadhyay, A., et al.: A survey of multiobjective evolutionary algorithms for data mining: part II. IEEE Trans. Evol. Comput. 8(1), 20–35 (2014)
Rupp, R., Kleih, S.C., Leeb, R., Millán, J.R., Kübler, A., Müller-Putz, G.R.: Brain-computer interfaces and assistive technology. In: Grübler, G., Hildt, E. (eds.) Brain-Computer Interfaces in Their Ethical, Social and Cultural Contexts. The International Library of Ethics, Law and Technology, vol. 12, pp. 7–38. Springer Science-Business Media, Dordrecht (2014). doi:10.1007/978-94-017-8996-7_2
Collet, P.: Why GPGPUs for evolutionary computation? In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs. Natural Computing Series, pp. 3–14. Springer, Heidelberg (2013)
Teodoro, G., Kurc, T., Andrade, G., Kong, J., Ferreira, R., Saltz, J.: Application performance analysis and efficient execution on systems with multi-core CPUs, GPUs, and MICs: a case study with microscopy image analysis. Intl. J. of High Perform. Comput. Appl. 1–20 (2015). doi:10.1177/1094342015594519
Greg, C.: Hazelwood K. Where is the data? Why you cannot debate CPU vs. GPU performances without the answer. In: IEEE International Symposium on Performance Analysis of Systems and Softwareernational(ISPASS), pp.134–144 (2011)
Bellman, G.A.: Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton (1961)
Marinaki, M., Marinakis, Y.: An Island memetic differential evolution algorithm for the feature selection problem. In: Terrazas, G., Otero, F.E., Masegosa, A.D. (eds.) NICSO 2013. SCI, vol. 512, pp. 33–47. Springer, Heidelberg (2014)
Emmanouilidis, C., Hunter, A., MacIntyre, J.: A multiobjective evolutionary setting for feature selection and a commonality-based crossover operator. In: Proceedings of the 2000 Congress on Evolutionary Computation, pp. 309–316. IEEE Press, New York (2000). doi:10.1109/CEC.2000.870311
Handl, J., Knowles, J.: Feature subset selection in unsupervised learning via multiobjective optimization. Int. J. Comput. Intell. Res. 2(3), 217–238 (2006). doi:10.5019/j.ijcir.2006.64
Oliveira, L.S., Sabourin, R., Bortolozzi, F., Suen, C.Y.: A methodology for feature selection using multiobjective genetic algorithms for handwritten digit string recognition. Int. J. Pattern Recognit. Artif. Intell. 17(6), 903–929 (2003). doi:10.1142/S021800140300271X
Kim, Y., Street, W.N., Menczer, F.: Evolutionary model selection in unsupervised learning. Intell. Data Anal. 6(6), 531–556 (2002). doi:10.1145/347090.347169
Morita, M., Sabourin, R., Bortolozzi, F., Suen, C.Y.: Unsupervised feature selection using multi-objective genetic algorithms for handwritten word recognition. In: Proceedings of the 7th International Conference on Document Analysis and Recognition, 666–670. IEEE Press, New York (2003). doi:10.1109/ICDAR.2003.1227746
Mierswa, I., Wurst, M.: Information preserving multi-objective feature selection for unsupervised learning. In: Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, GECCO 2006, pp. 1545–1552. ACM, New York (2006). doi:10.1145/1143997.1144248
de Souza, T., Matwin, J., Japkowitz, N.: Parallelizing feature selection. Algorithmica 45(3), 433–456 (2006). doi:10.1007/s00453-006-1220-3
Zao, Z., Zhang, R., Cox, J., Duling, D., Sarle, W.: Massively parallel feature selection: an approach based on variance preservation. Mach. Learn. 92(1), 195–220 (2013). doi:10.1007/s10994-013-5373-4
Kimovski, D., Ortega, J., Ortiz, A., Baños, R.: Parallel alternatives for evolutionary multi-objective optimization in unsupervised feature selection. Expert Syst. Appl. 42(9), 4239–4252 (2015). doi:10.1016/j.eswa.2015.01.061
Kimovski, D., Ortega, J., Ortiz, A., Baños, R.: Leveraging cooperation for parallel multi-objective feature selection in high-dimensional EEG data. Concurrency: Pract. Experience 27, 5476–5499 (2015)
Arbelaitz, O., Gurrutxaga, I., Muguerza, J., Pérez, J.M., Perona, I.: An externsive comparative study of cluster validity indices. Pattern Recogn. 46(1), 243–256 (2013)
Deb, K., Agrawal, S., Pratab, A., Meyarivan, T.: A fast elitist Non-dominated sorting genetic algorithms for multi-objective optimisation: NSGA-II. In: Deb, K., Rudolph, G., Lutton, E., Merelo, J.J., Schoenauer, M., Schwefel, H.-P., Yao, X. (eds.) PPSN 2000. LNCS, vol. 1917, pp. 849–858. Springer, Heidelberg (2000)
OpenCL registry. www.khronos.org/registry/cl/
Forgy, E.: Cluster analysis of multivariate data: efficiency vs interpretability of classification. Biometrics 21, 768 (1965)
Fonseca, C.M., López-Ibáñez, M., Paquete, L., Guerreiro, A.P.: Computation of the Hypervolume indicator (2014). http://iridia.ulb.ac.be/~manuel/hypervolume
Luong, T.V., Melab, N., Talbi, E.-G.: GPU-based island model for evolutionary algorithms. In: GECCO 2010 Proceedings of the 12th Annual Conference on Genetic and Evolutionary Computation, pp. 1089–1096 (2010)
Alba, E., Luque, G., Nesmachnow, S.: Parrallel Metaheuristics: recent advances and new trends. Intl. Trans. Op. Res. 20, 1–48 (2013)
Pospichal, P., Jaros, J., Schwarz, J.: Parallel genetic algorithm on the CUDA architecture. In: Di Chio, C., Cagnoni, S., Cotta, C., Ebner, M., Ekárt, A., Esparcia-Alcazar, A.I., Goh, C.-K., Merelo, J.J., Neri, F., Preuß, M., Togelius, J., Yannakakis, G.N. (eds.) EvoApplicatons 2010, Part I. LNCS, vol. 6024, pp. 442–451. Springer, Heidelberg (2010)
Sharma, D., Collet, P.: Implementation techniques for massively parallel Multi-objective optimization. In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs, pp. 267–286. Springer, Heidelberg (2013)
Wong, M.L., Cui, G.: Data mining using parallel multi-objective evolutionary algorithms on graphics processing units. In: Tsutsui, S., Collet, P. (eds.) Massively Parallel Evolutionary Computation on GPGPUs, pp. 287–307. Springer, Heidelberg (2013)
Baramkar, P.P., Kulkarni, D.B.: Review for K-means on graphics processing units (GPU). Intl. J. Research & Technology (IJERT) 3(6), 1911–1914 (2014)
Kijsipongse, E., U-ruekolan, S.: Dynamic load balancing on GPU clusters for large-scale K-means clustering. In: Proceedings of Ninth International Joint Conference on Computer Science and Software Engineering (JCSSE), pp. 346–350 (2012)
Farivar, R., Rebolledo, D., Chan, E., Campbell, R.: A Parallel implementation of K-means clustering on GPUs. In: Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA), 14–17 July 2008
Wu, R., Zhang, B., Hsu, M.: Clustering billions of data points using GPUs. In: Proceedings of UCHPC-MAW 2009 (2009). doi:10.1145/1531666.1531668
Zechner, M., Granitzer, M.: Accelerating K-Means on the Graphics Processor via CUDA. In: Proceedings of First International Conference on Intensive Applications and Services, pp. 7–15 (2009)
Fazendeiro, P., Padole, C., Sequeira, P., Prata, P.: OpenCL implementations of a genetic algorithm for feature selection in periocular biometric recognition. In: Panigrahi, B.K., Das, S., Suganthan, P.N., Nanda, P.K. (eds.) SEMCCO 2012. LNCS, vol. 7677, pp. 729–737. Springer, Heidelberg (2012)
Asensio-Cubero, J., Gan, J.Q., Palaniappan, R.: Multiresolution analysis over simple graphs for brain computer interfaces. J. Neural Eng. 10(4), 046014 (2013). doi:10.1088/1741-2560/10/4/046014
Acknowledgements
This work has been funded by projects TIN2012-32039 and TIN2015-67020-P (Spanish “Ministerio de Econ. y Compet.” and FEDER funds).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Escobar, J.J., Ortega, J., González, J., Damas, M. (2016). Assessing Parallel Heterogeneous Computer Architectures for Multiobjective Feature Selection on EEG Classification. In: Ortuño, F., Rojas, I. (eds) Bioinformatics and Biomedical Engineering. IWBBIO 2016. Lecture Notes in Computer Science(), vol 9656. Springer, Cham. https://doi.org/10.1007/978-3-319-31744-1_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-31744-1_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-31743-4
Online ISBN: 978-3-319-31744-1
eBook Packages: Computer ScienceComputer Science (R0)