Abstract
The empirical solution parameters for the Density-Based Spatial Clustering of Applications with Noise(DBSCAN) resulted in poor Clustering effect and low execution efficiency, An adaptive DBSCAN algorithm based on genetic algorithm and MapReduce programming framework is proposed. The genetic algorithm (minPts) and scanning radius size (Eps) optimized intensive interval threshold, at the same time, combined with the similarities and differences of data sets using the Hadoop cluster parallel computing ability of two specifications, the data is reasonable of serialization, finally realizes the adaptive parallel clustering efficiently. Experimental results show that the improved algorithm (GA) - DBSCANMR when dealing with the data set of magnitude 3 times execution efficiency is improved DBSCAN algorithm, clustering quality improved by 10%, and this trend increases as the amount of data, provides a more precise threshold DBSCAN algorithm to determine the implementation of the method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, G., Liu, B.Q., Wu, Y.: An adaptive DBSCAN algorithm based on gaussian distribution. Microelectron. Comput. 30(03), 27–30 (2013)
Feng, Z., Qian, X., Zhao, N.: Greedy DBSCAN: a DBSCAN improvement algorithm for multi-density clustering. Comput. Appl. Res. (9) (2016)
Ester, M., Kriegel, H.P., Sander, J., et al.: A Density-based algorithm for discovering clusters in large spatial databases with noise. pp. 226–231 (2008)
Wang, W.T., Wu, Y.L., Tang, C.Y., et al.: Adaptive density-based spatial clustering of applications with noise (DBSCAN) according to data. In: International Conference on Machine Learning and Cybernetics, IEEE (2015)
Uncu, O., Gruver, W.A., Kotak, D.B., et al.: GRIDBSCAN: grid density-based spatial clustering of applications with noise. vol. 4, pp. 2976–2981 (2006)
Shufen, L., Dongxue, M., Xiaoyan, W.: Study on DBSCAN Algorithm Based on Grid Element. J. Jilin Univ. Eng. Sci. 44(4), 1135–1139 (2014)
Luo, Q.: DBSCAN algorithm based on cloud computing. Wuhan University of Technology (2013)
Yang, Y.: Study on adaptive density clustering algorithm based on MapReduce. Tianjin University (2013)
He, Y., Tan, H., Luo, W., et al.: MR-DBSCAN: an efficient parallel density-based clustering algorithm using MapReduce. In: IEEE 17th International Conference on Parallel and Distributed Systems, IEEE Computer Society 2011, pp. 473–480 (2011)
Lei, L., Nie, R., Wang, J., et al.: Improved DBSCAN algorithm based on MapReduce. Comput. Sci. (s2) 396–399 (2015)
Li, L., Xi, Y.: Research on clustering algorithm and its parallelization strategy. In: International Conference on Computational and Information Sciences, pp. 325–328 (2011)
Design, application and application of data clustering algorithm based on MapReduce. J. East China Inst. Technol
Song, J., Xu, S., Guo, C., et al.: A task distribution algorithm for optimizing energy consumption of MapReduce system. J. Comput. 39(2), 323–338 (2016)
Wang, Z., Chen, Q., Li, Z., et al.: MapReduce data equalization method based on incremental partition strategy. J. Comput. (1) 19–35 (2016)
Yaling, X., Jifu, Z., Xiao, Q.: Data placement strategy in MapReduce cluster environment. J. Softw. (8), 2056–2073 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wu, Y., Zhang, Z. (2018). Research on a New Density Clustering Algorithm Based on MapReduce. In: Yuan, H., Geng, J., Liu, C., Bian, F., Surapunt, T. (eds) Geo-Spatial Knowledge and Intelligence. GSKI 2017. Communications in Computer and Information Science, vol 849. Springer, Singapore. https://doi.org/10.1007/978-981-13-0896-3_55
Download citation
DOI: https://doi.org/10.1007/978-981-13-0896-3_55
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-0895-6
Online ISBN: 978-981-13-0896-3
eBook Packages: Computer ScienceComputer Science (R0)