Skip to main content

Software-Defined Networks Towards Big Data: A Survey

  • Conference paper
  • First Online:
Book cover Advanced Machine Learning Technologies and Applications (AMLTA 2021)

Abstract

Both Big Data and Software-Defined Network have a significant impact in both academic and practical aspects. These two areas have been addressed separately, but both did not contribute to the same subset area of contribution. However, Big Data can greatly facilitate, improve, and have a great impact on Software Defined Network, and vice versa. In this paper, we show how SDN helps Big Data solve several issues regarding Big Data applications, including data processing in the data centers, data delivery and traffic monitoring. For Big Data, we also show how it can help SDN as well, including cross-layer design and defeating security attacks. Moreover, we discuss open issues that need to be addressed to consider both Big Data and SDN for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. State of the IoT 2018: Number of IoT devices now at 7B – Market accelerating. https://iot-analytics.com/state-of-the-iot-update-q1-q2-2018-number-of-iot-devices-now-7b/

  2. Cui, Y., Song, J., Li, M., Ren, Q., Zhang, Y., Cai, X.: SDN-based big data caching in ISP networks. IEEE Trans. Big Data 4, 356–367 (2017). https://doi.org/10.1109/tbdata.2017.2651901

    Article  Google Scholar 

  3. Salsano, S., Detti, A., Cancellieri, M., Pomposini, M., Blefari-Melazzi, N.: Transport-Layer Issues in Information Centric Networks (2012)

    Google Scholar 

  4. Badshah, J., Kamran, M., Shah, N., Abid, S.A.: An improved method to deploy cache servers in software defined network-based information centric networking for big data. J. Grid Comput. 17, 255–277 (2019). https://doi.org/10.1007/s10723-019-09477-z

    Article  Google Scholar 

  5. Kaur, K., Garg, S., Kaddoum, G., Bou-Harb, E., Choo, K.K.R.: A big data-enabled consolidated framework for energy efficient software defined data centers in IoT setups. IEEE Trans. Ind. Inf. 16, 2687–2697 (2020). https://doi.org/10.1109/TII.2019.2939573

  6. Big Data in the Cloud: Why Cloud Computing is the Answer to Your Big Data Initiatives - Thorn Technologies. https://www.thorntech.com/2018/09/big-data-in-the-cloud/

  7. Economy, J.L.-D.: Undefined: Data centres of the world will consume 1/5 of earth’s power by 2025 (2017)

    Google Scholar 

  8. Charalampou, P., Sykas, E.D.: An SDN focused approach for energy aware traffic engineering in data centers. Sensors. 19, 3980 (2019). https://doi.org/10.3390/s19183980

    Article  Google Scholar 

  9. Monga, I., Pouyoul, E., Guok, C.: Software-defined networking for big-data science - Architectural models from campus to the WAN. In: Proceedings - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012. pp. 1629–1635. IEEE (2012)

    Google Scholar 

  10. Xu, Y., Sun, Z., Sun, Z.: SDN-based Architecture for Big Data Network. In: Proceedings – 2017 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, CyberC 2017. pp. 513–516. Institute of Electrical and Electronics Engineers Inc. (2017)

    Google Scholar 

  11. Kaur, D., Aujla, G.S., Kumar, N., Zomaya, A.Y., Perera, C., Ranjan, R.: Tensor-Based Big Data Management Scheme for Dimensionality Reduction Problem in Smart Grid Systems: SDN Perspective. IEEE Trans. Knowl. Data Eng. 30, 1985–1998 (2018). https://doi.org/10.1109/TKDE.2018.2809747

  12. Trevisan, M., Drago, I., Mellia, M., Song, H.H., Baldi, M.: AWESoME: big data for automatic web service management in SDN. IEEE Trans. Netw. Serv. Manag. 15, 13–26 (2018). https://doi.org/10.1109/TNSM.2017.2785878

    Article  Google Scholar 

  13. Alqarni, M.A.: Benefits of SDN for big data applications. In: 2017 14th International Conference on Smart Cities: Improving Quality of Life Using ICT and IoT, HONET-ICT 2017, pp. 74–77. Institute of Electrical and Electronics Engineers Inc. (2017)

    Google Scholar 

  14. Zhang, H., Tang, F., Barolli, L.: Efficient flow detection and scheduling for SDN-based big data centers. J. Ambient Intell. Humaniz. Comput. 10, 1915–1926 (2019). https://doi.org/10.1007/s12652-018-0783-6

    Article  Google Scholar 

  15. Aujla, G.S., Kumar, N., Zomaya, A.Y., Ranjan, R.: Optimal decision making for big data processing at edge-cloud environment: An SDN perspective. IEEE Trans. Ind. Informatics. 14, 778–789 (2018). https://doi.org/10.1109/TII.2017.2738841

    Article  Google Scholar 

  16. Apache Hadoop. https://hadoop.apache.org/

  17. Apache SparkTM - Unified Analytics Engine for Big Data. https://spark.apache.org/

  18. Apache Storm. https://storm.apache.org/

  19. Apache Flink: Stateful Computations over Data Streams. https://flink.apache.org/

  20. Apache Kafka. https://kafka.apache.org/

  21. Alwasel, K., Li, Y., Jayaraman, P.P., Garg, S., Calheiros, R.N., Ranjan, R.: Programming SDN-native big data applications: research gap analysis. IEEE Cloud Comput. 4, 62–71 (2017). https://doi.org/10.1109/MCC.2017.4250934

    Article  Google Scholar 

  22. Qin, P., Dai, B., Huang, B., Xu, G.: Bandwidth-aware scheduling with SDN in hadoop: a new trend for big data. IEEE Syst. J. 11, 2337–2344 (2015). https://doi.org/10.1109/jsyst.2015.2496368

    Article  Google Scholar 

  23. Wu, J., Dong, M., Ota, K., Li, J., Guan, Z.: Big data analysis-based secure cluster management for optimized control plane in software-defined networks. IEEE Trans. Netw. Serv. Manag. 15, 27–38 (2018). https://doi.org/10.1109/TNSM.2018.2799000

    Article  Google Scholar 

  24. Unal, E., Sen-Baidya, S., Hewett, R.: Towards prediction of security attacks on software defined Networks: A Big Data Analytic Approach. In: Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018, pp. 4582–4588. Institute of Electrical and Electronics Engineers Inc. (2019)

    Google Scholar 

  25. Cui, Y., Song, J., Li, M., Ren, Q., Zhang, Y., Cai, X.: SDN-Based Big Data Caching in ISP Networks. IEEE Trans. Big Data (2017)

    Google Scholar 

  26. Salsano, S., Detti, A., Cancellieri, M., Pomposini, M., Blefari-Melazzi, N.: Transport- layer issues in information centric networks. In: ACM SIGCOMM Workshop on Information-Centric Networking (ICN 2012), Helsinki, Finland (2012)

    Google Scholar 

  27. Badshah, J., Kamran, M., Shah, N., Abid, S.A.: An improved method to deploy cache servers in software defined network-based information centric networking for big data. J. Grid Comput. (2019)

    Google Scholar 

  28. Chan, M.: Big data in the cloud: why cloud computing is the answer to your big data initiatives. Thorn Technol. (2018)

    Google Scholar 

  29. Lima, J.M.: Data Centres of the World Will Consume 1/5 Of Earth’s Power By 2025, Data Economy, December 2017

    Google Scholar 

  30. Charalampou, P., Sykas, E. D.: An SDN focused approach for energy aware traffic engineering in data centers (2019)

    Google Scholar 

  31. Kaur, K., Garg, S., Kaddoum, G., Bou-Harb, E., Choo, K.K.R.: A Big Data- Enabled Consolidated Framework for Energy Efficient Software Defined Data Centers in IoT Setups. IEEE Trans. Ind. Inform. (2020)

    Google Scholar 

  32. Monga, I., Pouyoul, E., Guok, C.: Software-defined networking for big-data science — architectural models from campus to the WAN. In: Proceedings of the High Performance Computing, Networking, Storage and Analysis (2012)

    Google Scholar 

  33. Xu Y, Sun Z, Sun Z. SDN-based architecture for big data network. In: 2017 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery

    Google Scholar 

  34. Alqarni, M.: Benefits of SDN for Big data applications. In: The 14th International Conference on Smart Cities: Improving Quality of Life Using ICT & IoT (HONET-ICT) (2017)

    Google Scholar 

  35. Alwasel, K., Li, Y., Jayaraman, P.P., Garg, S., Calheiros, R.N., Ranjan, R.: Programming SDN- native big data applications: research gap analysis. IEEE Cloud Computing (2017)

    Google Scholar 

  36. Wu, J., Dong, M., Ota, K., Li, J., Guan, Z.: Big data analysis-based secure cluster management for optimized control plane in software-defined networks. IEEE Trans. Network (2018)

    Google Scholar 

  37. Unal, E., Sen-Baidya, S., Hewett, R.: Towards Prediction of Security Attacks on Software Defined Networks: A Big Data Analytic Approach (2018)

    Google Scholar 

  38. Unal, E., Sen-Baidya, S., Hewett, R.: Towards prediction of security attacks on software defined networks: a big data analytic approach. In: IEEE International Conference on Big Data (Big Data) (2018)

    Google Scholar 

  39. Qin, P., Dai, B., Huang, B., Xu, G.: Bandwidth-aware scheduling with SDN in Hadoop: a new trend for big data. IEEE Syst. J. (2017)

    Google Scholar 

  40. Zhang, H., Tang, F., Barolli, L.: Efficient flow detection and scheduling for SDN-based big data centers. Journal of Ambient Intelligence and Humanized Computing (2019)

    Google Scholar 

  41. Aujla, G., Kumar, N., Zomaya, A., Ranjan, R.: Optimal decision making for big data processing at Edge-Cloud Environment: an SDN Perspective. IEEE Trans. Ind. Inf. (2017)

    Google Scholar 

  42. Kaur, D., Aujla, G., Kumar, N., Zomaya, A., Perera, C., Ranjan, R.: Tensor-based big data management scheme for dimensionality reduction problem in smart grid systems: SDN perspective. IEEE Trans. Knowl. Data Eng. (2018)

    Google Scholar 

  43. Trevisan, M., Drago, I., Mellia, M., Song, H., Baldi, M., Torino, P.:. AWESoME: big data for automatic web service management in SDN. IEEE Trans. Network Service Manage. (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Belal Mohammed .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tarek, A., Mohammed, B., Barakat, R., Eid, Y., El-Kaliouby, S., AbdElbaki, N. (2021). Software-Defined Networks Towards Big Data: A Survey. In: Hassanien, AE., Chang, KC., Mincong, T. (eds) Advanced Machine Learning Technologies and Applications. AMLTA 2021. Advances in Intelligent Systems and Computing, vol 1339. Springer, Cham. https://doi.org/10.1007/978-3-030-69717-4_59

Download citation

Publish with us

Policies and ethics