Cited By
View all- Leme JCasaca WColnago MDias M(2020)Towards Assessing the Electricity Demand in Brazil: Data-Driven Analysis and Ensemble Learning ModelsEnergies10.3390/en1306140713:6(1407)Online publication date: 18-Mar-2020
Generalization enhancement of support vector regression in electric load forecasting with model selection
Article No.: 19, Pages 1 - 6
Abstract
Nowadays, feature selection and parameter optimization are two fundamental issues in machine learning. The former improves the quality of the algorithm by selecting a subset of features, while the latter concerns finding the most suitable parameter values. The two issues have the same objective of improving the predictive performance of the algorithm. In particular, machine learning algorithms capacity can be straightened using particle swarm optimization to avoid the problem of overfitting [3] by both feature selection and parameter optimization. This paper focuses on the restriction of this general issue to the support vector regression (SVR) algorithm and the electric load forecasting problem. That is, feature selection and the optimal parameter setting have been considered simultaneously in order to further enhance it generalization capacity. Experimental results on a widely used electric load dataset show that our proposed hybrid method for model selection by both feature selection and parameter optimization of SVR can achieve better generalization capacity when compared with the classical SVR model while using feature selection and without using it.
References
[1]
B. E. Boser, I. M. Guyon, and V. N. Vapnik. 1992. A training algorithm for optimal margin classiffers. 5th Annual ACM Workshop on COLT, Pittsburgh PA (1992), 144--152.
[2]
B.J. Chen, M.W. Chang, and C.J. Lin. 2004. Load forecasting using support vector machines: a study on EUNITE Competition 2001. IEEE Trans Power Syst 19 (2004), 1821--30.
[3]
Hugo Jair Escalante, Manuel Montes, and Luis Enrique Sucar. 2009. Particle swarm model selection. Journal of Machine Learning Research 10, Feb (2009), 405--440.
[4]
Zhongyi Hu, Yukun Bao, and Tao Xiong. 2014. Comprehensive learning particle swarm optimization based memetic algorithm for model selection in short-term load forecasting using support vector regression. Applied Soft Computing 25 (2014), 15--25.
[5]
Zhongyi Hu, Yukun Bao, Tao Xiong, and Raymond Chiong. 2015. Hybrid filterâĂŞwrapper feature selection for short-term load forecasting. Engineering Applications of Artificial Intelligence 40 (2015), 17--27.
[6]
Kyoung jae Kim. 1983. Financial time series forecasting using support vector machines. Neurocomputing 48 (1983), 311--326.
[7]
J. Kennedy and R.C. Eberhart. 1995. Particle swarm optimization. Proceedings of IEEE international conference neural networks IEEE (1995), 1942--8.
[8]
J. Kennedy and R.C. Eberhart. 1997. A discrete binary version of the particle swarm optimization. Proceeding of the conference on System, Man, and Cybernetics 4 (1997), 104--109.
[9]
Rohaifa Khaldi, Raddouane Chiheb, Abdellatif El Afia, Adil Akaaboune, and Rdouan Faizi. 2017. Prediction of Supplier Performance: A Novel Dea-Anfis Based Approach. In Proceedings of the 2nd international Conference on Big Data, Cloud and Applications. ACM, 60.
[10]
Rohaifa Khaldi, Abdellatif El Afia, Raddouane Chiheb, and Rdouan Faizi. 2017. Artificial Neural Network Based Approach for Blood Demand Forecasting: Fez Transfusion Blood Center Case Study. In Proceedings of the 2nd international Conference on Big Data, Cloud and Applications. ACM, 59.
[11]
Chi-Jie Lu. 2014. Sales forecasting of computer products based on variable selection scheme and support vector regression. Neurocomputing 128 (2014), 491--499.
[12]
Xiaoyong Lu and Xiaomeng Geng. 2011. Car Sales Volume Prediction Based on Particle Swarm Optimization Algorithm and Support Vector Regression. International Conference on Intelligent Computation Technology and Automation Shenzhen Guangdong (2011), 71--74.
[13]
Ping-Feng Paia and Wei-Chiang Hong. 2006. Software reliability forecasting by support vector machines with simulated annealing algorithms. Journal of Systems and Software 79, 6 (2006), 747--755.
[14]
S. Piramuthu. 2004. Evaluating feature selection methods for learning in data mining applications. European Journal of Operational Research 156 (2004), 483--494. Issue 2.
[15]
Malek Sarhani and Abellatif El Afia. 2015. Electric Load Forecasting Using Hybrid Machine Learning Model incorporating Feature selection. In Proceeding of the 11th international conference of big data intelligence. Tetuan, Morocco.
[16]
Malek Sarhani and Abdellatif El Afia. 2014. Intelligent System Based Support Vector Regression For Supply Chain Demand Forecasting, In Second World Conference on Complex Systems (WCCS). Electrical and Information Technologies (ICEIT), 2016 International Conference on (2014).
[17]
Malek Sarhani and Abellatif El Afia. 2015. Electric Load Forecasting Using Hybrid Machine Learning Model incorporating Feature selection. In Proceeding of the first international conference of big data intelligence. Tetuan, Morocco.
[18]
Malek Sarhani and Abdellatif El Afia. 2016. Feature selection and parameter optimization of support vector regression for electric load forecasting, In Electrical and Information Technologies (ICEIT), 2016 International Conference on. Electrical and Information Technologies (ICEIT), 2016 International Conference on (2016).
[19]
Malek Sarhani and Abdellatif El Afia. 2017. Forecasting Demand with Support Vector Regression Technique Combined with X13-ARIMA-SEATS Method in the Presence of Calendar Effect. In Artificial Intelligence: Concepts, Methodologies, Tools, and Applications. IGI Global, 2146--2159.
[20]
Malek Sarhani and Abdellatif El Afia. 2018. Forecasting Demand With Support Vector Regression Technique Incorporating Feature Selection in the Presence of Calendar Effect. In Contemporary Approaches and Strategies for Applied Logistics. IGI Global, 302--316.
[21]
Malek Sarhani, Abdellatif El Afia, and Rdouan Faizi. 2017. Hybrid approach based support vector machine for electric load forecasting incorporating feature selection. Int. J. of Big Data Intelligence 4, 3 (2017), 1--8.
[22]
J. W. Taylor and P. E. McSharry. 2008. Short-Term Load Forecasting Methods: An Evaluation Based on European Data. IEEE Transactions on Power Systems 22 (2008), 2213--2219.
[23]
Chung-Jui Tu, Li-Yeh Chuang, Jun-Yang Chang, and Cheng-Hong Yang. 2007. Feature Selection using PSO-SVM. International Journal of Computer Science 33, 1 (2007).
[24]
Vladimir Vapnik and Alexey Chervonenkis. 1974. About structural risk minimization principle. Automation Remote Control 8 (1974), 29--39.
[25]
V. Vapnik, S. Golowich, and A. Smola. 1992 7. Support Vector Method for Function Approximation Regression Estimation and Signal Processings. MIT Press Cambridge 9 (1992 7), 144--152.
[26]
Susana M. Vieira, LuÃŋs F. Mendonca, Goncalo J.Farinha, and JoÃčo M.C. Sousa. 2013. Modified binary PSO for feature selection using SVM applied to mortality prediction of septic patients. Applied Soft Computing 13 (2013), 3494--3504.
[27]
L.J Wang and C. Liu. 2008. Short-term price forecasting based on PSO train BP neural network. Electr. Power Sci. Eng. 24 (2008), 21--25.
Index Terms
- Generalization enhancement of support vector regression in electric load forecasting with model selection
Recommendations
Parameter Selection of Support Vector Regression Based on Particle Swarm Optimization
GRC '10: Proceedings of the 2010 IEEE International Conference on Granular ComputingParameters selection of support vector machine is the key issue that impacts its accurate performance. A method for support vector regression machine with basic particle swarm optimization (BPSO) algorithm is proposed in this paper. Furthermore, in ...
A Novel Hybrid Particle Swarm Optimization for Feature Selection and Kernel Optimization in Support Vector Regression
CIS '10: Proceedings of the 2010 International Conference on Computational Intelligence and SecurityThis study proposed a novel HPSO-SVR model that hybridized the particle swarm optimization (PSO) and support vector regression (SVR) to improve the regression accuracy based on the type of kernel function and kernel parameter value optimization with a ...
Support Vector Regression Based on Particle Swarm Optimization for Rainfall Forecasting
CSO '10: Proceedings of the 2010 Third International Joint Conference on Computational Science and Optimization - Volume 02This study applies a novel neural network technique, support vector regression (SVR), to rainfall forecasting. To build an effective SVR model, SVR's parameters must be set carefully. This study proposes a novel approach, known as particle swarm ...
Comments
Information & Contributors
Information
Published In
May 2018
357 pages
ISBN:9781450353045
DOI:10.1145/3230905
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 May 2018
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
LOPAL '18
Acceptance Rates
LOPAL '18 Paper Acceptance Rate 61 of 141 submissions, 43%;
Overall Acceptance Rate 61 of 141 submissions, 43%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 73Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
Cited By
View all- Leme JCasaca WColnago MDias M(2020)Towards Assessing the Electricity Demand in Brazil: Data-Driven Analysis and Ensemble Learning ModelsEnergies10.3390/en1306140713:6(1407)Online publication date: 18-Mar-2020
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in