Abstract
In construction of smart city, numerous vehicles’ trajectory data are produced by Global Positioning System (GPS) to track their real time location. When these GPS data are processed by map matching, results can be used to support a large number of ITS applications such as real time road condition calculation, inspection of traffic event and emergency treatment. However, as the fast explosive growth of monitored vehicle number, massive GPS data proposes overwhelming challenges for map matching. Consequently, traditional map matching algorithms can hardly satisfy high demands for matching speed and accuracy. Therefore, a real time map matching algorithm for numerous GPS data is proposed to guarantee high matching accuracy and matching efficiency. Meanwhile, it can meet demands of GPS data processing required by the monitor of numerous vehicles within the city. Main contributions of the method are: (1) A Kalman filter based correcting algorithm is proposed to improve the matching accuracy of the traditional topological algorithm on the complicated road sections such as intersections and parallel roads. (2) Based on the Spark streaming framework, the serial map-matching algorithm is converted into a parallelized map-matching algorithm, which significantly improves the processing efficiency of the map matching. (3) A gridding method being applicable to the parallelized algorithm was proposed by the paper. The GPS data in the same grid were allocated to the same computing unit to improve the efficiency of the parallelized computation. Experimental results show that the matching accuracy of the algorithm demonstrated by the paper is increased by 10%; the matching efficiency is 25% higher than same amount of stand-alone computers. A cluster of 15 computers that operates the proposed algorithm is capable for the real time map matching for GPS data produced by 800 thousand vehicles, which can effectively and extensively support the lastingly increased demand for processing numerous GPS data.









Similar content being viewed by others
References
Apache storm. [EB/OL]. http://storm.apache.org/
Chen, Y., Li, F., Fan, J.: Mining association rules in big data with ngep. Clust. Comput. 18(2), 577–585 (2015)
Goh, C.Y., Dauwels, J., Mitrovic, N., Asif, M.T.: Online map-matching based on hidden markov model for real-time traffic sensing applications. In: International IEEE Conference on Intelligent Transportation Systems, pp. 776–781 (2012)
Hashemi, M., Karimi, H.A.: A critical review of real-time map-matching algorithms: current issues and future directions. Comput. Environ. Urban Syst. 48(8), 153–165 (2014)
Huang, J., Qie, J., Liu, C., Li, S., Weng, J., Lv, W.: Cloud computing-based map-matching for transportation data center. Electron. Commer. Res. Appl. 14(6), 431–443 (2015)
Hunter, T., Abbeel, P., Bayen, A.: The path inference filter: model-based low-latency map matching of probe vehicle data. IEEE Trans. Intell. Transp. Syst. 15(2), 507–529 (2011)
Iqbal, M.H., Soomro, T.R.: Big data analysis: apache storm perspective. Int. J. Comput. Trends Technol. 19(1), 9–14 (2015)
Kinoshita, A., Takasu, A., Adachi, J.: Real-time traffic incident detection using a probabilistic topic model. Inf. Syst. 54(C), 169–188 (2015)
Li, Q., Zhang, T., Yu, Y.: Using cloud computing to process intensive floating car data for urban traffic surveillance. Int. J. Geogr. Inf. Sci. 25(8), 1303–1322 (2011)
Lin, W.H., Tan, X.J., Liu, F.J., Yu, Y., Wang, W.M.: A new directional query method for polygon dataset in spatial database. Earth Sci. Inform. 8(4), 775–786 (2015)
Lint, H.V.: Network-wide traffic state estimation using loop detector and floating car data. J. Intell. Transp. Syst. 18(1), 41–50 (2014)
Liu, S., Liu, C., Luo, Q., Ni, L.M., Krishnan, R.: Calibrating large scale vehicle trajectory data. In: IEEE International Conference on Mobile Data Management, pp. 222–231 (2012)
Moore, T., Smith, M.: Adaptive Kalman filtering for low-cost ins/gps. J. Navig. 56(1), 143–152 (2003)
Roumeliotis, S.I., Sukhatme, G.S., Bekey, G.A.: Circumventing dynamic modeling: evaluation of the error-state kalman filter applied to mobile robot localization. In: IEEE International Conference on Robotics and Automation, 1999. Proceedings, vol. 2, pp. 1656–1663 (1999)
Spark streaming. [EB/OL]. http://spark.apache.org/streaming/
Velaga, N.R., Quddus, M.A., Bristow, A.L.: Developing an enhanced weight-based topological map-matching algorithm for intelligent transport systems. Transp. Res. Part C 17(6), 672–683 (2009)
Wang, L., Tao, J., Ranjan, R., Marten, H., Streit, A., Chen, J., Chen, D.: G-hadoop: mapreduce across distributed data centers for data-intensive computing. Future Gener. Comput. Syst. 29(3), 739–750 (2013)
Wang, Y., Liu, Z., Liao, H., Li, C.: Improving the performance of gis polygon overlay computation with mapreduce for spatial big data processing. Clust. Comput. 18(2), 507–516 (2015)
Zaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., Mccauley, M., Franklin, M.J., Shenker, S., Stoica, I.: Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. In: Usenix Conference on Networked Systems Design and Implementation, pp. 141–146 (2012)
Zhao, J., Wang, L., Jie, T., Chen, J., Sun, W., Ranjan, R., Kolodziej, J., Streit, A., Georgakopoulos, D.: A security framework in g-hadoop for big data computing across distributed cloud data centres. J. Comput. Syst. Sci. 80(5), 994–1007 (2014)
Acknowledgements
This work was supported by National Natural Science Foundation of China (No. 61472091), Natural Science Foundation of Guangdong Province for Distinguished Young Scholars (2014A030306020), Guangzhou scholars project for universities of Guangzhou (No. 1201561613) and Science and Technology Planning Project of Guangdong Province, China (2015B010129015).
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Wang, H., Li, J., Hou, Z. et al. Research on parallelized real-time map matching algorithm for massive GPS data. Cluster Comput 20, 1123–1134 (2017). https://doi.org/10.1007/s10586-017-0869-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-017-0869-5