Abstract
Big data is playing an important role in daily life and has developed into a new subject. Especially, an efficient big data transmission is the foundation. This is because even with a high-efficient data analysis, a limited transmission speed still cannot satisfy the requirement of real-time big data. In this article, we first make an extensive analysis on the tendency of investing short- and long-distance big data transmission, and then summarize future challenge issues urgently to be solved: (1) in short-distance big data transmission, MapReduce well satisfies the requirement of big data processing, and it will be integrated with an optical-wireless hybrid data center network. The seamless convergence of wireless and optical subnets with different physical devices and protocols cannot be ignored; (2) to mitigate the pressures of data analysis and link capacity expansion caused by using traditional transparent-bit-rate transmission, the correlated data transmission should be considered. Some enabling technologies are proposed by us for solving the challenge issues above, along with simulation results that will guide the future work.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhang, H., Zhang, Q., Zhou, Z.: Processing geo-dispersed big data in an advanced MapReduce framework. IEEE Netw. 29(5), 29–30 (2015)
Suto, K., Nishiyama, H., Kato, N., et al.: Toward integrating overlay and physical networks for robust parallel processing architecture. IEEE Netw. 28(4), 36–42 (2014)
Khan, A., Othman, M., Madani, S., et al.: A survey of mobile cloud computing application models. IEEE Commun. Surv. Tutor. 16(2), 393–413 (2014)
Bari, M., Boutaba, R., Esteves, R.: Data center network virtualization: a survey. IEEE Commun. Surv. Tutor. 15(2), 909–928 (2013)
Liu, J., Liu, F., Ansari, N.: Monitoring and analyzing big traffic data of a large-scale cellular network with Hadoop. IEEE Netw. 28(27), 32–39 (2014)
Yi, X., Liu, F., Liu, J., et al.: Building a network highway for big data: architecture and challenges. IEEE Netw. 28(27), 5–13 (2014)
Suto, K., Nishiyama, H., Katoi, N.: Context-aware task allocation for fast parallel big data processing in optical-wireless networks. In: Proceedings of the IWCMC, pp. 423–428 (2014)
Lu, P., Zhang, L., Liu, X., et al.: Highly efficient data migration and backup for big data applications in elastic optical inter-data-center networks. IEEE Netw. 29(5), 36–42 (2015)
Tan, C., Zou, J., Wang, M., et al.: Correlated data gathering on dynamic network coding policy and opportunistic routing in wireless sensor network. In: Proceedings of the ICC, pp. 1–5 (2011)
Bandari, D., Pottie, G., Frossard, P.: Correlation-aware resource allocation in multi-cell networks. IEEE Trans. Wirel. Commun. 11(12), 4438–4445 (2012)
Li, Y., Zou, J., Xiong, H.: Global correlated data gathering in wireless sensor networks with compressive sensing and randomized gossiping. In: Proceedings of the GLOBECOM, pp. 1–5 (2011)
Rashid, M., Gondal, I., Kamruzzaman, J.: Mining associated patterns from wireless sensor networks. IEEE Trans. Comput. 64(7), 1998–2011 (2015)
Cheng, B., Xu, Z., Chen, C.: Spatial correlated data collection in wireless sensor networks with multiple sinks. In: Proceedings of the INFOCOM, pp. 578–583 (2011)
Acknowledgements
This work was supported in part by Fundamental Research Funds for the Central Universities (Grant Nos. N130817002, N140405005), National Natural Science Foundation of China (Grant Nos. 61302070, 61401082, 61471109, 61502075).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Hou, W., Zhang, X., Guo, L., Sun, Y., Wang, S., Zhang, Y. (2016). Short- and Long-Distance Big Data Transmission: Tendency, Challenge Issues and Enabling Technologies. In: Wang, Y., Yu, G., Zhang, Y., Han, Z., Wang, G. (eds) Big Data Computing and Communications. BigCom 2016. Lecture Notes in Computer Science(), vol 9784. Springer, Cham. https://doi.org/10.1007/978-3-319-42553-5_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-42553-5_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42552-8
Online ISBN: 978-3-319-42553-5
eBook Packages: Computer ScienceComputer Science (R0)