research-article

Performance Analysis of SVM ensemble methods for Air Pollution Data

Authors:

S. S. TirumalaAuthors Info & Claims

ICSPS 2016: Proceedings of the 8th International Conference on Signal Processing Systems

Pages 212 - 216

https://doi.org/10.1145/3015166.3015188

Published: 21 November 2016 Publication History

Abstract

Air pollution is currently considered to be one of the biggest environmental threats. Considering the fact, that air pollution causes health disorders, the data analysis is crucial and is of paramount importance to know the living suitability of the location. New Zealand is one such environment conscious country where the analysis of air pollution data is necessary not only to assess the current situation but also to predict future levels of pollution. Analysis of air pollution data is complex as well as challenging. Support Vector Machines or SVMs have attained good success for data analysis. In this research, we conduct an empirical study of SVM approaches to assess the capability of SVM in handling air pollution data set. We used a real-time dataset obtained from USA environmental research.

We carried out rigorous experiments with single SVM, and ensemble methods like Bagging and AdaboostM1. With the experimental results, it can be concluded that, ensemble methods outperformed single SVM approach in both accuracy and efficiency. It is noteworthy to observe that AdaBoostM1 outperformed other methods for full dataset. The critical review of SVM ensemble and the systematic experimental study are the key contributions of this paper.

Experimental results on air pollution dataset demonstrated that the proposed SVM ensemble method with AdaboostM1 algorithm performs better than other algorithms. The classification accuracy of single SVM method was 76.33%t whereas with Bagging algorithm it was 79.66% However, comparing to those results the best percentage of classification accuracy of 91.28% was achieved through AdaboostM1 algorithm and lesser time of 128 minutes to build ensemble model 20 and 31 minutes less than Single SVM and Bagging respectively.

References

[1]

P. Gosden, A. MacGowan, and G. Bannister. Importance of air quality and related factors in the prevention of infection in orthopaedic implant surgery. Journal of Hospital Infection, 39(3):173--180, 1998.

[2]

L. Wang, C. Jang, Y. Zhang, K. Wang, Q. Zhang, D. Streets, J. Fu, Y. Lei, J. Schreifels, K. He, J. Hao, Y.-F. Lam, J. Lin, N. Meskhidze, S. Voorhees, D. Evarts, and S. Phillips. Assessment of air quality benefits from national air pollution control policies in china. part ii: Evaluation of air quality predictions and air quality benefits assessment. Atmospheric Environment, 44(28):3449--3457, 2010.

[3]

G. State, I. V. Popescu, and A. Gheboianu. Identification of air pollution elements in lichens used as bioindicators by the xrf and aas methods. Applied Physics, 56(1):240--249, 2009.

[4]

M. J. Carlotto, M. B. Lazaroff, and M. W. Brennan. Multispectral image processing for environmental monitoring. SPIE, 1819:113--123, 1992.

[5]

J. Namiesnik. Modern trends in monitoring and analysis of environmental pollutants. Polish Journal of Environmental Studies, 10(3):127--140, 2001.

[6]

Benvenuto and A. Marani. Neuro-fuzzy techniques to estimate and predict atmospheric pollutant levels. Global West International, 2000.

[7]

D. Parikh and R. Polikar. An ensemble-based incremental learning approach to data fusion. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 37(2):437--450, 2007.

Digital Library

[8]

Ali, Shahid; S S Tirumala; Sarrafzadeh, Abdolhossein; ", Ensemble learning methods for decision making: Status and future prospects, "Machine Learning and Cybernetics (ICMLC), 2015 International Conference on", 1, 211-216, 2015, IEEEM. Claesen, F. De Smet, J. A. Suykens, and B. De Moor. Ensemblesvm: a library for ensemble learning using support vector machines. Journal of Machine Learning Research, 15(1):141--145, 2014.

Digital Library

[9]

Y. Liu and X. Yao. Ensemble learning via negative correlation. Neural Networks, 12(10):1399--1404, 1999.

Digital Library

[10]

M. Claesen, F. De Smet, J. A. Suykens, and B. De Moor. Ensemblesvm: a library for ensemble learning using support vector machines. Journal of Machine Learning Research, 15(1):141--145, 2014.

Digital Library

[11]

A. Chandra and X. Yao. Evolving hybrid ensembles of learning machines for better generalisation. Neurocomputing, 69(7):686--700, 2006.

Digital Library

[12]

S. Kang, P. Kang, T. Ko, S. Cho, S.-j. Rhee, and K.-S. Yu. An efficient and effective ensemble of support vector machines for anti-diabetic drug failure prediction. Expert Systems with Applications, 42(9):4265--4273, 2015.

Digital Library

[13]

E. Stamatatos and G. Widmer. Automatic identification of music performers with learning ensembles. Artificial Intelligence, 165(1):37--56, 2005.

Digital Library

[14]

L. Yu, Y. Zhao, and L. Tang. Ensemble forecasting for complex time series using sparse representation and neural networks. Journal of Forecasting, 2016.

[15]

G. I. Webb and Z. Zheng. Multistrategy ensemble learning: Reducing error by combining ensemble learning techniques. Knowledge and Data Engineering, IEEE Transactions on, 16(8):980--991, 2004.

Digital Library

[16]

P. Pezzutto, A. Saulter, L. Cavaleri, C. Bunney, F. Marcucci, L. Torrisi, and S. Sebastianelli. Performance comparison of meso-scale ensemble wave forecasting systems for mediterranean sea states. Ocean Modelling, 104:171--186, 2016.

[17]

Y. Dong and N. Japkowicz. Threaded ensembles of supervised and unsupervised neural networks for

[18]

M. Raj, M. Mirzargar, J. S. Preston, R. M. Kirby, and R. T. Whitaker. Evaluating shape alignment via ensemble visualization. IEEE computer graphics and applications, 36(3):60--71, 2016.

[19]

N. Song, K. Wang, M. Xu, X. Xie, G. Chen, et al. Design and analysis of ensemble classifier for gene expression data of cancer. J Clin Med Genom, 3(134):2, 2015.

[20]

S. Kang, P. Kang, T. Ko, S. Cho, S.-j. Rhee, and K.-S. Yu. An efficient and effective ensemble of support vector machines for anti-diabetic drug failure prediction. Expert Systems with Applications, 42(9):4265--4273, 2015.

Digital Library

[21]

J. Yao and C. Lian. A new ensemble model based support vector machine for credit assessing. International Journal of Grid and Distributed Computing, 9(6):159--168, 2016.

[22]

S. Ali, S. S. Tirumala, and A. Sarrafzadeh. Svm aggregation modelling for spatio-temporal air pollution analysis. In Multi-Topic Conference (INMIC), 2014 IEEE 17th International, pages 249--254, Dec 2014.

[23]

EPA. Environmental protection agency epa dataset, 2010.

[24]

AirNow. Air quality index results, 2010.

[25]

H. Ahn, H. Moon, M. J. Fazzari, N. Lim, J. J. Chen, and R. L. Kodell. Classification by ensembles from random partitions of high-dimensional data. Computational Statistics & Data Analysis, 51(12):6166--6179, 2007.

Digital Library

[26]

I. H. Laradji, M. Alshayeb, and L. Ghouti. Software defect prediction using ensemble learning on selected features. Information and Software Technology, 58:388--402, 2015.

[27]

G. Wu and E. Y. Chang. Kba: Kernel boundary alignment considering imbalanced data distribution. Knowledge and Data Engineering, IEEE Transactions on, 17(6):786--795, 2005.

Digital Library

[28]

B. X. Wang and N. Japkowicz. Boosting support vector machines for imbalanced data sets. In Foundations of Intelligent Systems, pages 38--47. Springer, 2008.

Digital Library

[29]

C. Luo, M. Li, H. Zhang, F. Wang, D. Zhang, and W. Zuo. Metric learning with relative distance constraints: a modified svm approach. In International Conference of Young Computer Scientists, Engineers and Educators, pages 242--249. Springer, 2015.

[30]

R. Akbani, S. Kwek, and N. Japkowicz. Applying support vector machines to imbalanced datasets. In Machine Learning: ECML 2004, pages 39--50. Springer, 2004.

Digital Library

Cited By

Reddy BPraveen CKumar MReddy IR D(2021)Prediction and Comparative Analysis of Air Pollution in Major cities of India using Deep Learning Techniques2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC)10.1109/ICESC51422.2021.9532860(1434-1439)Online publication date: 4-Aug-2021
https://doi.org/10.1109/ICESC51422.2021.9532860

Performance Analysis of SVM ensemble methods for Air Pollution Data
1. Computing methodologies
  1. Machine learning
    1. Learning paradigms
      1. Supervised learning

Recommendations

Ensemble Approaches of Support Vector Machines for Multiclass Classification
Pattern Recognition and Machine Intelligence
Abstract
Support vector machine (SVM) which was originally designed for binary classification has achieved superior performance in various classification problems. In order to extend it to multiclass classification, one popular approach is to consider the ...
SVM training with duplicated samples and its application in SVM-based ensemble methods

Support vector machine (SVM)-based ensemble techniques, such as bagging or boosting, generally involve training SVMs with duplicated samples. A simple derivation illustrates that the same result can be obtained solely by training on those unique samples ...
Weighted multicategory nonparallel planes SVM classifiers

We formulate K-category non-parallel classifiers by using "One-Versus-All" (OVA) approach: Multicategory Generalized Eigenvalue Proximal Support Vector Machine (MGEPSVM) and Multicategory Improved Generalized Eigenvalue Proximal Support Vector Machine (...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICSPS 2016: Proceedings of the 8th International Conference on Signal Processing Systems

November 2016

235 pages

ISBN:9781450347907

DOI:10.1145/3015166

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICSPS 2016

ICSPS 2016: 8th International Conference on Signal Processing Systems

November 21 - 24, 2016

Auckland, New Zealand

Acceptance Rates

ICSPS 2016 Paper Acceptance Rate 46 of 83 submissions, 55%;

Overall Acceptance Rate 46 of 83 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
121
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Reddy BPraveen CKumar MReddy IR D(2021)Prediction and Comparative Analysis of Air Pollution in Major cities of India using Deep Learning Techniques2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC)10.1109/ICESC51422.2021.9532860(1434-1439)Online publication date: 4-Aug-2021
https://doi.org/10.1109/ICESC51422.2021.9532860

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten