Abstract
In Smart Grid, the incompleteness of electricity power collection data is gradually prominent. Thus, this paper presents an electricity power collection big data oriented missing data imputation solution, which comprises a big data processing framework and a missing data imputation method for power consumption data. Based on big data techniques, the given framework supports the large-scale electricity power collection data acquisition, storage and processing. To get a better result, the proposed method takes advantage of the correlation between the loss rate of power and the user power consumption. The feasibility and the effectiveness of the proposed method is evaluated. Experimental results show the proposed method is able to convert incomplete data set into complete data set, and has good imputation stability. Compared with the KNN algorithm, the proposed method has a lower imputation error, and is a positive attempt to combine domain-specific algorithms with traditional algorithms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ahmed, O., Fatima, Z.B., Ayoub, A.L., Samir, B.: Big data technologies: a survey. J. King Saud Univ. Comput. Inf. Sci. 1–18 (2017)
Ejaz, A., Ibrar, Y., Ibrahim, A., et al.: The role of big data analytics in Internet of Things. Comput. Netw. 129, 1–13 (2017)
Song, Q., Shepperd, M.: A new imputation method for small software project data sets. J. Syst. Softw. 80(1), 51–62 (2007)
Penny, K.I., Chesney, T.: Imputation methods to deal with missing values when data mining trauma injury data. In: The 28th International Conference on Information Technology Interfaces, pp. 213–218. IEEE Press, Cavtat (2006)
Fabio, L., Claudomiro, S., Igor, A., et al.: Multi-objective genetic algorithm for missing data imputation. Pattern Recognit. Lett. 68, 126–131 (2015)
Mehran, A., Richard, J.: Missing data imputation using fuzzy-rough methods. Neurocomputing 205, 152–164 (2016)
Im, J., Kim, S.: Multiple imputation for nonignorable missing data. J. Korean Stat. Soc. (2017, in press)
Archana, P., Sandeep, K.S.: Hybrid prediction model with missing value imputation for medical data. Expert Syst. Appl. 42, 5621–5631 (2015)
Zheng, L., Jun, Z., Ying, L., Wei, W.: Data imputation for gas flow data in steel industry based on non-equal-length granules correlation coefficient. Inf. Sci. 367–368, 311–323 (2016)
Celestino, O.G., Fernando, S.L., Francisco, J., et al.: Missing data imputation of questionnaires by means of genetic algorithms with different fitness functions. J. Comput. Appl. Math. 311, 704–717 (2017)
Buuen, S., Groothuis, O.: MICE: multivariate imputation by chained equation in R. J. Stat. Softw. 45, 1–67 (2011)
Shyam, R., Bharathi, G.H., Sachin, K.S., et al.: Apache spark a big data analytics platform for smart grid. Proc. Technol. 21, 171–178 (2015)
Amr, A., Munshi, Y.A., Mohamed, R.I.: Big data framework for analytics in smart grid. Electr. Power Syst. Res. 151, 369–380 (2017)
Acknowledgments
This paper is supported by research project of State Grid Corporation of China “Research on big data application technology and model in the company key areas” SGRIJSKJ(2016) 1104 project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Chen, J., Li, H., Zhao, T., Liu, H. (2018). An Electricity Power Collection Data Oriented Missing Data Imputation Solution. In: Romdhani, I., Shu, L., Takahiro, H., Zhou, Z., Gordon, T., Zeng, D. (eds) Collaborative Computing: Networking, Applications and Worksharing. CollaborateCom 2017. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 252. Springer, Cham. https://doi.org/10.1007/978-3-030-00916-8_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-00916-8_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00915-1
Online ISBN: 978-3-030-00916-8
eBook Packages: Computer ScienceComputer Science (R0)