Skip to main content

Short- and Long-Distance Big Data Transmission: Tendency, Challenge Issues and Enabling Technologies

  • Conference paper
  • First Online:
Big Data Computing and Communications (BigCom 2016)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9784))

Included in the following conference series:

Abstract

Big data is playing an important role in daily life and has developed into a new subject. Especially, an efficient big data transmission is the foundation. This is because even with a high-efficient data analysis, a limited transmission speed still cannot satisfy the requirement of real-time big data. In this article, we first make an extensive analysis on the tendency of investing short- and long-distance big data transmission, and then summarize future challenge issues urgently to be solved: (1) in short-distance big data transmission, MapReduce well satisfies the requirement of big data processing, and it will be integrated with an optical-wireless hybrid data center network. The seamless convergence of wireless and optical subnets with different physical devices and protocols cannot be ignored; (2) to mitigate the pressures of data analysis and link capacity expansion caused by using traditional transparent-bit-rate transmission, the correlated data transmission should be considered. Some enabling technologies are proposed by us for solving the challenge issues above, along with simulation results that will guide the future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhang, H., Zhang, Q., Zhou, Z.: Processing geo-dispersed big data in an advanced MapReduce framework. IEEE Netw. 29(5), 29–30 (2015)

    Article  Google Scholar 

  2. Suto, K., Nishiyama, H., Kato, N., et al.: Toward integrating overlay and physical networks for robust parallel processing architecture. IEEE Netw. 28(4), 36–42 (2014)

    Article  Google Scholar 

  3. Khan, A., Othman, M., Madani, S., et al.: A survey of mobile cloud computing application models. IEEE Commun. Surv. Tutor. 16(2), 393–413 (2014)

    Article  Google Scholar 

  4. Bari, M., Boutaba, R., Esteves, R.: Data center network virtualization: a survey. IEEE Commun. Surv. Tutor. 15(2), 909–928 (2013)

    Article  Google Scholar 

  5. Liu, J., Liu, F., Ansari, N.: Monitoring and analyzing big traffic data of a large-scale cellular network with Hadoop. IEEE Netw. 28(27), 32–39 (2014)

    Article  Google Scholar 

  6. Yi, X., Liu, F., Liu, J., et al.: Building a network highway for big data: architecture and challenges. IEEE Netw. 28(27), 5–13 (2014)

    Article  Google Scholar 

  7. Suto, K., Nishiyama, H., Katoi, N.: Context-aware task allocation for fast parallel big data processing in optical-wireless networks. In: Proceedings of the IWCMC, pp. 423–428 (2014)

    Google Scholar 

  8. Lu, P., Zhang, L., Liu, X., et al.: Highly efficient data migration and backup for big data applications in elastic optical inter-data-center networks. IEEE Netw. 29(5), 36–42 (2015)

    Article  MathSciNet  Google Scholar 

  9. Tan, C., Zou, J., Wang, M., et al.: Correlated data gathering on dynamic network coding policy and opportunistic routing in wireless sensor network. In: Proceedings of the ICC, pp. 1–5 (2011)

    Google Scholar 

  10. Bandari, D., Pottie, G., Frossard, P.: Correlation-aware resource allocation in multi-cell networks. IEEE Trans. Wirel. Commun. 11(12), 4438–4445 (2012)

    Article  Google Scholar 

  11. Li, Y., Zou, J., Xiong, H.: Global correlated data gathering in wireless sensor networks with compressive sensing and randomized gossiping. In: Proceedings of the GLOBECOM, pp. 1–5 (2011)

    Google Scholar 

  12. Rashid, M., Gondal, I., Kamruzzaman, J.: Mining associated patterns from wireless sensor networks. IEEE Trans. Comput. 64(7), 1998–2011 (2015)

    Article  MathSciNet  Google Scholar 

  13. Cheng, B., Xu, Z., Chen, C.: Spatial correlated data collection in wireless sensor networks with multiple sinks. In: Proceedings of the INFOCOM, pp. 578–583 (2011)

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by Fundamental Research Funds for the Central Universities (Grant Nos. N130817002, N140405005), National Natural Science Foundation of China (Grant Nos. 61302070, 61401082, 61471109, 61502075).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Weigang Hou .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Hou, W., Zhang, X., Guo, L., Sun, Y., Wang, S., Zhang, Y. (2016). Short- and Long-Distance Big Data Transmission: Tendency, Challenge Issues and Enabling Technologies. In: Wang, Y., Yu, G., Zhang, Y., Han, Z., Wang, G. (eds) Big Data Computing and Communications. BigCom 2016. Lecture Notes in Computer Science(), vol 9784. Springer, Cham. https://doi.org/10.1007/978-3-319-42553-5_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42553-5_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42552-8

  • Online ISBN: 978-3-319-42553-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics