Abstract
Sudden changes in weather, in particular extreme temperatures, can result in increased energy expenditures, depleted agricultural resources, and even loss of life. However, these ill effects can be reduced with accurate air temperature predictions that provide adequate advance warning. Support vector regression (SVR) was applied to meteorological data collected across the state of Georgia in order to produce short-term air temperature predictions. A method was proposed for reducing the number of training patterns of massively large data sets that does not require lengthy pre-processing of the data. This method was demonstrated on two large data sets: one containing 300,000 cold-weather training patterns collected during the winter months and one containing 1.25 million training patterns collected throughout the year. These patterns were used to produce predictions from 1 to 12 h ahead. The mean absolute error (MAE) for the evaluation set of winter-only patterns ranged from 0.514°C for the 1-h prediction horizon to 2.303°C for the 12-h prediction horizon. For the evaluation set of year-round patterns, the MAE ranged from 0.513°C for the 1-h prediction horizon to 1.922°C for the 12-h prediction horizon. These results were competitive with previously developed artificial neural network (ANN) models that were trained on the full data sets. For the winter-only evaluation data, the SVR models were slightly more accurate than the ANN models for all twelve of the prediction horizons. For the year-round evaluation data, the SVR models were slightly more accurate than the ANN models for three of the twelve prediction horizons.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Almeida, MB, Braga AP, Braga JP (2000) Speeding svms learning with a prior cluster selection and k-means. In: proceedings of the 6th Brazillian symposium on neural networks, Rio de Jaaneiro, pp 162–167
Bernard SM, McGeehin MA (2004) Municipal heat wave response plans. Am J Public Health 94(9):1520–1522
Chang C, Lin C (2001) LIBSVM: a library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297
Dong B, Cao C, Lee SE (2005) Applying support vector machines to predict building energy consumption in tropical region. Energy and Build 37:545–553
Engelbrecht AP (2002) Computational intelligence an introduction. Wiley, West Sussex
Fonsah EG, Taylor KC, Funderburk F (2007) Enterprise cost analysis for middle Georgia peach production. Technical report AGECON-06-118, The University of Georgia Cooperative Extension
Friess T-T, Cristianini N, Campbell C (1998) The kernel adatron algorithm: a fast and simple learning procedure for support vector machines. In: 15th international conference on machine learning, Morgan Kaufman Publishers, Madison, pp 188–196
Fung G, Mangasarian OL (2003) Finite newton method for lagrangian support vector machine classification. Neurocomputing 55:39–55
Guo G, Zhang J-S (2007) Reducing examples to accelerate support vector regression. Pattern Recognit Let 28:2173–2183
Hoogenboom G (1993) The Georgia automated environmental monitoring network. In: Hatcher KJ (ed) 1993 Georgia water resources conference. The University of Georgia, Orlando, pp 398–402
Hsu C-W, Chang C-C, Lin C-J (2000) A practical guide to support vector classification. Technical report, National Taiwan University
Jain A, McClendon RW, Hoogenboom G (2006) Freeze prediction for specific locations using artificial neural networks. Transactions of the ASABE 49(6):1955–1962
Joachims T (1999) Making large-scale SVM learning practical. In: Scholkopf B, Burges C, Smola A (eds) Advances in kernel methods—support vector learning, Chap. 11. MIT Press, Cambridge, pp 169–184
Jones GM, Stallings CC (1999) Reducing heat stress for dairy cattle. Technical report 404-200, Virginia Cooperative Extension
Khan MS, Coulibaly P (2006) Application of support vector machine in lake water level prediction. J Hydrol Eng 11(3):199–205
Mangasarian OL, Musicant DR (2001) Active set support vector machine classification. In: Leen T, Dietterich T, Tresp V (eds) Advances in neural information processing systems 13. MIT-Press, Cambridge, pp 577–583
Mangasarian OL, Musicant DR (2001) Lagrangian support vector machines. J Mach Learn Res 1:161–177
Mori H, Kanaoka D (2007) Application of support vector regression to temperature forecasting for short-term load forecasting. In: IEEE joint conference on neural networks, IEEE, Orlando, pp 1085–1090
Osuna E, Freund R, Girosi F (1997) An improved training algorithm for support vector machines. In: Neural networks for signal processing VII. Proceedings of the 1997 IEEE workshop, IEEE, New York, pp 276–285
Platt JC (1999) Fast training of svms using sequential minimal optimization. In: Scholkopf B, Burges C, Smola A (eds) Advances in kernel methods—support vector learning. MIT Press, Cambridge, pp 185–208
Qin Z, Yu Q, Li J, yi Wu Z, min Hu B (2005) Application of least squares vector machines in modeling water vapor and carbon dioxide fluxes over a cropland. J Zhejiang Univ 6(6):491–495
Ravagnolo O, Misztal I, Hoogenboom G (2000) Genetic component of heat stress in dairy cattle, development of heat index. J Dairy Sci 83(9):2120–2125
Rychetsky M, Ortmann S, Ullmann M, Glesner M (1999) Accelerated training of support vector machines. In: IJCNN ‘99 international joint conference on neural networks, vol 2, pp 998–1003
Scholkopf B, Burges C, Vapnik V (1996) Incorporating invariances in support vector learning machines. In: von der Malsburg C, Seelen WV, Vorbruggen J, Sendhoff B (eds) ICANN ‘96 international conference on artificial neural networks, vol 1112. Springer, Berlin, pp 47–52
Scholkopf B, Smola AJ (2001) Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT Press, Cambridge
Smith BA, Hoogenboom G, McClendon R (2009) Artificial neural networks for automated year-round temperature prediction. Comput Electron Agri 68:52–61
Smith BA, McClendon RW, Hoogenboom G (2006) Improving air temperature prediction with artificial neural networks. Int J Comput Intell 3(3):179–186
Smola AJ, Scholkopf B (2004) A tutorial on support vector regression. Statistics and Comput 14:199–222
Tsang IW, Kwok JT, Cheung P (2005) Core vector machines: fast svm training on very large data sets. J Mach Learn Res 6:363–392
Vapnik V (1995) The nature of statistical learning theory. Springer, New York
Vishwanathan SVN, Smola AJ, Murty MN (2003) SimpleSVN. In: proceedings of the twentieth international conference on machine learning, Washington, DC, pp 760–767
Ward Systems Group (1993) Manual of neuroShell 2. Ward Systems Group
Yang M-H, Ahuja N (2000) A geometric approach to train support vector regression. In: proceedings of the IEEE conference on computer vision and pattern recognition, Hilton Head, pp 430–437
Acknowledgments
This work was funded in part by a partnership between the USDA-Federal Crop Insurance Corporation through the Risk Management Agency and the University of Georgia and by state and federal funds allocated to Georgia Agricultural Experiment Stations Hatch projects GEO00877 and GEO01654.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chevalier, R.F., Hoogenboom, G., McClendon, R.W. et al. Support vector regression with reduced training sets for air temperature prediction: a comparison with artificial neural networks. Neural Comput & Applic 20, 151–159 (2011). https://doi.org/10.1007/s00521-010-0363-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-010-0363-y