Abstract
Twin Support Vector Regression (TSVR), a novel regressor, obtaining faster learning speed than classical support vector regression (SVR), has attracted the attention of many scholars. Similar to SVR, TSVR is also sensitive to its parameters. Therefore, how to select the suitable parameters has become an urgent problem for TSVR. In this paper, a parameters selection version for TSVR, termed parameters selections of twin support vector regression based on cloud particle swarm optimization (TSVR-CPSO), is proposed. Using the characteristics of randomness and stable tendency of normal cloud model, the inertia weight of PSO can be generated by the basic cloud generator of cloud model. To do so, we can improve the diversity of population for PSO, thus greatly improve the ability of diagnosis to avoid falling into local optimal. Based on the above idea, the cloud particle swarm optimization (CPSO) model is constructed. At last, CPSO is used to search the optimal combination of TSVR parameters. Simulations show that the proposed algorithm is an effective way to search the TSVR parameters and has good performance in nonlinear function estimation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (1995). https://doi.org/10.1007/978-1-4757-2440-0
Liu, X., Jin, J., Weining, W., Herz, F.: A novel support vector machine ensemble model for estimation of free lime content in cement clinkers. ISA Trans. 99, 479–487 (2020)
Borrero, L.A., Guette, L.S., Lopez, E., Pineda, O.B., Castro, E.B.: Predicting toxicity properties through machine learning. Procedia Comput. Sci. 170, 1011–1016 (2020)
Liu, G., Chen, L., Zhao, W.: Internal model control of permanent magnet synchronous motor using support vector machine generalized inverse. IEEE Trans. Ind. Inf. 9(2), 890–898 (2013)
Tang, X., Ma, Z., Hu, Q., Tang, W.: A real-time arrhythmia heartbeats classification algorithm using parallel delta modulations and rotated linear-kernel support vector machines. IEEE Trans. Bio-Med. Eng. 67(4), 978–986 (2020)
Jayadeva, Reshma, K., Chandra, S.: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 905–910 (2007)
Fung, G., Mangasarian, O.L.: Proximal support vector machine classifiers. In: Proceedings of 7th ACM SIFKDD International Conference on Knowledge Discovery and Data Mining, pp. 77–86 (2001)
Mangasarian, O.L., Wild, E.W.: Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 69–74 (2006)
Mello, A.R., Stemmer, M.R., Koerich, A.L.: Incremental and decremental fuzzy bounded twin support vector machine. Inf. Sci. 526, 20–38 (2020)
Zhang, X.S., Gao, X.B., Wang, Y.: Twin support vector machine for MCs detection. J. Electron. (China) 26(3), 318–325 (2009)
Peng, X.: TSVR: an efficient twin support vector machine for regression. Neural Netw. 23, 365–372 (2010)
Peng, X.: Primal twin support vector regression and its sparse approximation. Neurocomputing 73, 2846–2858 (2010)
Chen, X., Yang, J., Liang, J.: Smooth twin support vector regression. Neural Comput. Appl. 21, 505–513 (2012). https://doi.org/10.1007/s00521-010-0454-9
Sheykh Mohammadi, F., Amiri, A.: TS-WRSVM: twin structural weighted relaxed support vector machine. Connect. Sci. 31(3), 215–243 (2019)
Liu, Y., Li, D., Zhang, G., et al.: Atomized feature in cloud based evolutionary algorithm. J. Electron. 37(8), 1651–1658 (2009)
Li, D., Di, K., et al.: Mining association rules with linguistic cloud models. J. Softw. 11, 143–158 (2000)
Rastogi, R., Saigal, P., Chandra, S.: Angle-based twin parametric-margin support vector machine for pattern classification. Knowl.-Based Syst. 139, 64–77 (2018)
Dai, C., Zhu, Y., et al.: Cloud method based genetic algorithm and its applications, algorithm. J. Electron. (China) 35(7), 1419–1424 (2007)
Dai, C., Zhu, Y., et al.: Adaptive genetic algorithm based on cloud theory. Control Theory Appl. 24(4), 646–650 (2007)
Fu, Q., Cai, Z., Wu, Y.: A novel hybrid method: genetic algorithm based on asymmetrical cloud model. In: 2010 International Conference on Artificial Intelligence and Computational Intelligence (2010)
Acknowledgement
This work is supported by the National Natural Science Foundation of China (61662005). Guangxi Natural Science Foundation (2018GXNSFAA294068, 2017GXNSFAA198008); Basic Ability Improvement Project for Young and Middle-aged Teachers in Colleges and Universities in Guangxi (2019KY0195); Research Project of Guangxi University for Nationalities (2019KJYB006).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Wei, X., Huang, H., Tang, W. (2020). Parameters Selection of Twin Support Vector Regression Based on Cloud Particle Swarm Optimization. In: Huang, DS., Premaratne, P. (eds) Intelligent Computing Methodologies. ICIC 2020. Lecture Notes in Computer Science(), vol 12465. Springer, Cham. https://doi.org/10.1007/978-3-030-60796-8_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-60796-8_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60795-1
Online ISBN: 978-3-030-60796-8
eBook Packages: Computer ScienceComputer Science (R0)