Abstract
This work introduces vector score integration (VSI), a novel alpha integration method to perform soft fusion of scores in K-class classification problems. The parameters of the method are optimized to achieve the least mean squared error between the fused scores and the ideal scores over a set of training data. VSI was applied to perform soft fusion of multiple classifiers working on two sets of real polysomnographic data from subjects with sleep disorders. In both sets, the signal is automatically staged in three classes: wake, rapid eye movement (REM) sleep, and non-REM sleep. Four single classifiers were considered: linear discriminant analysis, naive Bayes, classification trees, and random forests. VSI was able to successfully combine the scores from the considered classifiers, outperforming all of them and a classical fusion technique (majority voting).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yuksel, S., Wilson, J., Gader, P.: Twenty years of mixture of experts. IEEE Trans. Neural Netw. Learn. Syst. 23, 1177–1193 (2012)
Khaleghi, B., Khamis, A., Karray, F., Razavi, S.: Multisensor data fusion: a review of the state-of-the-art. Inf. Fusion 14, 28–44 (2013)
Rivet, B., Wang, W., Naqvi, S., Chambers, J.: Audiovisual speech source separation: an overview of key methodologies. IEEE Signal Process. Mag. 31(3), 125–134 (2014)
Wang, S., et al.: Fusion of machine intelligence and human intelligence for colonic polyp detection in CT colonography. In: International Symposium on Biomedical Imaging: From Nano to Macro, Chicago, IL, USA, pp. 160–164 (2011)
Mohandes, M., Deriche, M., Aliyu, S.: Classifiers combination techniques: a comprehensive review. IEEE Access 6, 19626–19639 (2018)
Lahat, D., Adali, T., Jutten, C.: Multimodal data fusion: an overview of methods, challenges and prospects. Proc. IEEE 103, 1449–1477 (2015)
Fattah, M.: New term weighting schemes with combination of multiple classifiers for sentiment analysis. Neurocomputing 167, 434–442 (2015)
Abellán, J., Mantas, C.: Improving experimental studies about ensembles of classifiers for bankruptcy prediction and credit scoring. Expert Syst. Appl. 41, 3825–3830 (2014)
Salazar, A., Safont, G., Soriano, A., Vergara, L.: Automatic credit card fraud detection based on non-linear signal processing. In: International Carnahan Conference on Security Technology (ICCST), Boston, MA, USA, pp. 207–212 (2012)
Salazar, A., Safont, G., Vergara, L.: Surrogate techniques for testing fraud detection algorithms in credit card operations. In: International Carnahan Conference on Security Technology (ICCST), Rome, Italy (2014). Article no. 6986987
Salazar, A., Safont, G., Vergara, L.: Semi-supervised learning for imbalanced classification of credit card transaction. In: International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil (2018). Article no. 8489755
Zhang, J., Wu, Y., Bai, J., Chen, F.: Automatic sleep stage classification based on sparse deep belief net and combination of multiple classifiers. Trans. Inst. Meas. Control 38(4), 435–451 (2015)
Kevric, J., Jukic, S., Subasi, A.: An effective combining classifier approach using tree algorithms for network intrusion detection. Neural Comput. Appl. 28(suppl1), 1051–1058 (2017)
Safont, G., Salazar, A., Soriano, A., Vergara, L.: Combination of multiple detectors for EEG based biometric identification/authentication. In: International Carnahan Conference on Security Technology (ICCST), Boston, MA, USA, pp. 230–236 (2012)
Poh, N., Bengio, S.: How do correlation and variance of base experts affect fusion in biometric authentication tasks. IEEE Trans. Signal Process. 53, 4384–4396 (2005)
Vergara, L., Soriano, A., Safont, G., Salazar, A.: On the fusion of non-independent detectors. Digit. Signal Process. 50, 24–33 (2016)
Safont, G., Salazar, A., Bouziane, A., Vergara, L.: Synchronized multi-chain mixture of independent component analyzers. In: Rojas, I., Joya, G., Catala, A. (eds.) IWANN 2017. LNCS, vol. 10305, pp. 190–198. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59153-7_17
Amari, S.: Integration of stochastic models by minimizing α-divergence. Neural Comput. 19, 2780–2796 (2007)
Wu, D.: Parameter estimation for α-GMM based on maximum likelihood criterion. Neural Comput. 21, 1776–1795 (2009)
Soriano, A., Vergara, L., Bouziane, A., Salazar, A.: Fusion of scores in a detection context based on alpha-integration. Neural Comput. 27, 1983–2010 (2015)
Choi, H., Choi, S., Katake, A., Choe, Y.: Learning α-integration with partially-labeled data. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, Dallas, TX, USA, pp. 2058–2061 (2010)
Choi, H., Choi, S., Choe, Y.: Parameter learning for alpha integration. Neural Comput. 25, 1585–1604 (2013)
Heneghan, C.: St. Vincent’s University Hospital/University College Dublin Sleep Apnea Database. https://www.physionet.org/pn3/ucddb/. Accessed 08 Mar 2019
Hjorth, J.: The physical significance of time domain descriptors in EEG analysis. Electro-encephalogr. Clin. Neurophysiol. 34(3), 321–325 (1973)
Motamedi-Fakhr, S., Moshrefi-Torbati, M., Hill, M., Hill, C., White, P.: Signal processing techniques applied to human sleep EEG signals – a review. Biomed. Signal Process. Control 10, 21–33 (2014)
Carletta, J.: Assessing agreement on classification tasks: the kappa statistic. Comput. Linguist. 22(2), 249–254 (1996)
Xie, B., Minn, H.: Real-time sleep apnea detection by classifier combination. IEEE Trans. Inf. Technol. Biomed. 16(3), 469–477 (2012)
Wang, S., Hua, G., Hao, G., Xie, C.: A cycle deep belief network model for multivariate time series classification. Math. Probl. Eng. 2017, 1–7 (2017)
Acknowledgment
This work was supported by Spanish Administration and European Union under grant TEC2017-84743-P.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Safont, G., Salazar, A., Vergara, L. (2019). Combination of Multiple Classification Results Based on K-Class Alpha Integration. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2019. Lecture Notes in Computer Science(), vol 11507. Springer, Cham. https://doi.org/10.1007/978-3-030-20518-8_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-20518-8_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-20517-1
Online ISBN: 978-3-030-20518-8
eBook Packages: Computer ScienceComputer Science (R0)