Skip to main content
Log in

Network policy aware placement of tasks for elastic applications in IaaS-cloud environment

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Using cloud computing as a base, new technologies like data analytics, Internet of Things, machine learning etc., have emerged. Applications that use these technologies, depend on cloud datacenters (DC) for their computing power. Performance of these applications depends on dynamic resource provisioning by DC, as there is unpredictability of rate at which data arrives for immediate processing. Cloud service providers implement this dynamism in Infrastructure-as-a-Service (IaaS) environment, using elastic virtual machines (VM). Placing these VMs onto same physical machines (PM) and/or on the network neighborhood machines is believed to increase application performance as the network latency is minimal. Deploying sub-optimal VM placement schemes creates unwanted cross network traffic resulting in poor application performance and increases the DC operating cost. This paper formulates the policy and elastic aware placement (PEAP) as an optimization problem, with additional constraints such as fixed PM, balanced PM and co-location VMs. Further, we propose PEAP algorithm which considers individual requests demanding for one or more VMs as a whole for placement along with the life-time of requests. Proposed algorithm gives optimal VM placements for increased application performance and DC efficacy. CloudSimPlus based experiments demonstrate that as compared to first fit decreasing (FFD). First fit increasing (FFI) and first come first serve (FCFS) algorithms, the proposed technique leads to reduced resource fragmentation and resource migrations. PEAP achieves placement of all the elastic VMs together with reduced network cost, thereby increasing the application performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. Elasticity and autoscaling are used interchangeably.

  2. Tasks and VMs are used interchangeably.

References

  1. Manvi, S.S., Shyam, G.K.: Resource management for infra-structure as a service (IaaS) in cloud computing: a survey. J. Netw. Comput. Appl. 41, 424–440 (2014)

    Article  Google Scholar 

  2. Barclay: Overview of Autoscale. Barclay (2016) https://aws.amazon.com/blogs/compute/fleet-management-made-easy-with-auto-scaling/

  3. https://docs.microsoft.com/en-us/azure/azuremonitor/platform/autoscale-overview

  4. Lopez-Pires, F., Baran, B.: A many-objective optimization framework for virtualized datacenters. In: Proceedings of the Fifth International Conference on Cloud Computing and Service Science, pp. 439–450, 2015

  5. Zheng, X., Cai, Y.: Dynamic virtual machine placement for cloud computing environments. In: 2014 43rd International Conference on Parallel Processing Workshops, September 2014, pp. 121–128

  6. Singh, A., Korupolu, M., Mohapatra, D.: Server-storage virtualization: integration and load balancing in data centers. In: Proceedings of the 2008 ACM/IEEE Conference on Supercomputing, Ser. SC ’08, pp. 53:1–53:12. IEEE Press, Piscataway (2008). https://dl.acm.org/citation.cfm?id=1413370.1413424

  7. Meng, X., Pappas, V., Zhang, L.: Improving the scalability of data center networks with traffic-aware virtual machine placement. In: Proceedings of IEEE INFOCOM2010, pp. 1–9, 2010

  8. Cui, L., Tso, F., Pezaros, P., Jia, W., Zhao, W.: PLAN: joint policy- and network-aware VM management for cloud data centers. IEEE Trans. Parallel Distrib. Syst. 28(4), 1163–1175 (2017)

    Article  Google Scholar 

  9. Aruna, M., Bhanu, D., Karthik, S.: An improved load balanced metaheuristic scheduling in cloud. Clust. Comput. 22, 10873–10881 (2019)

    Article  Google Scholar 

  10. Muthulakshmi, B., Somasundaram, K.: A hybrid ABC-SA based optimized scheduling and resource allocation for cloud environment. Clust. Comput. 22, 10769–10777 (2019)

    Article  Google Scholar 

  11. Arul Xavier, V.M., Annadurai, S.: Chaotic social spider algorithm for load balance aware task scheduling in cloud computing. Clust. Comput. 22, 287–297 (2019)

    Article  Google Scholar 

  12. Vazirani, V.V.: Approximation Algorithms. Springer, Berlin (2001)

    MATH  Google Scholar 

  13. Abdessamia, F., Zhang, W.-Z., Tian, Y.-C.: Energy-efficiency virtual machine placement based on binary gravitational search algorithm. Clust. Comput. 23, 1577–1588 (2020)

    Article  Google Scholar 

  14. Dong, S., Jain, R.: Energy-efficient scheme based on user task characteristic in virtual cloud platform. Clust. Comput. 23, 1125–1135 (2020)

    Article  Google Scholar 

  15. Panda, S.K., Jana, P.K.: An energy-efficient task scheduling algorithm for heterogeneous cloud computing systems. Clust. Comput. 22, 509–527 (2019)

    Article  Google Scholar 

  16. Geng, X., Mao, Y., Xiong, M., Liu, Y.: An improved task scheduling algorithm for scientific workflow in cloud computing environment. Clust. Comput. 22, 7539–7548 (2019)

    Article  Google Scholar 

  17. Lu, Y., Sun, N.: An effective task scheduling algorithm based on dynamic energy management and efficient resource utilization in green cloud computing environment. Clust. Comput. 22, 513–520 (2019)

    Article  MathSciNet  Google Scholar 

  18. Rahman, M., Graham, P.: Compatibility-based static VM placement minimizing interference. J. Netw. Comput. Appl. 84, 68–81 (2017)

    Article  Google Scholar 

  19. Feller, E., Morin, C., Esnault, A.: A case for fully decentralized dynamic VM consolidation in clouds. In: IEEE 4th International Conference on Cloud Computing Technology and Science (Cloud Com), 2012, pp. 26–33. IEEE (2012)

  20. Beloglazov, A., Abawajy, J., Buyya, R.: Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener. Comput. Syst. 28(5), 755–768 (2012)

    Article  Google Scholar 

  21. Zheng, Q., Li, R., Li, X., Shah, N., Zhang, J., Tian, F., Chao, K.-M., Li, J.: Virtual machine consolidated placement based on multi-objective biogeography-based optimization. Future Gener. Comput. Syst. 54, 95–122 (2016)

    Article  Google Scholar 

  22. Shi, J., Dong, F., Zhang, J., Luo, J., Ding, D.: Two-phase online virtual machine placement in heterogeneous cloud data center. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1369–1374. IEEE (2015)

  23. López-Pires, F., Barán, B., Benítez, L., Zalimben, S., Amarilla, A.: Virtual machine placement for elastic infrastructures in overbooked cloud computing datacenters under uncertainty. Future Gener. Comput. Syst. 79(Part 3), 830–848 (2018)

    Article  Google Scholar 

  24. Mishra, S.K., Deepka, P., Sahoo, B., Jayaraman, P.P., Jung, S., Zomaya, A.Y., Ranjan, R.: Energy-efficient VM-placement in cloud data center. Sustain. Comput. Inform. Syst. (2018). https://doi.org/10.1016/j.suscom.2018.01.002

    Article  Google Scholar 

  25. Yokoyama, D., Schulze, B., Kloh, H., Bandini, M., Rebello, V.: Affinity aware scheduling model of cluster nodes in private clouds. J. Netw. Comput. Appl. 95, 94–104 (2017)

    Article  Google Scholar 

  26. Chen, J., He, Q., Ye, D., Chen, W., Xiang, Y., Chiew, K., Zhu, L.: Joint affinity aware grouping and virtual machine placement. Microprocess. Microsyst. 52, 365–380 (2016)

    Article  Google Scholar 

  27. Meng, X., Isci, C., Kepart, J., Zhang, L., Bouillet, E., Pendarakis, D.: Efficient resource provisioning in compute clouds via VM multiplexing. In: Proceedings of the Seventh International Conference on Autonomous Computing, 2010, pp. 215–228 (2013)

  28. Al-Dulaimy, A., Itani, W., Zantout, R., Zekri, A.: Type-aware virtual machine management for energy efficient cloud data centers. J. Sustain. Comput. Inform. Syst. 19, 185–203 (2018)

    Google Scholar 

  29. Li, K., Wu, J., Blaisse, A.: Elasticity-aware virtual machine placement for cloud datacenters. In: The IEEE International Conference on Cloud Networking (CloudNet), 2013

  30. Bin-packing. In Combinatorial Optimization, Ser. Algorithms and Combinatorics, vol 21, pp. 426–441. Springer, Berlin (2006)

  31. https://www.cloudsimplus.org

  32. Google cluster-usage traces. https://github.com/google/cluster-data. Accessed Oct 2020

  33. Kliazovich, D., Bouvry, P., Khan, S.U.: DENS: data center energy-efficient network aware scheduling. Clust. Comput. 16(1), 65–75 (2013)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to R. Sridharan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sridharan, R., Domnic, S. Network policy aware placement of tasks for elastic applications in IaaS-cloud environment. Cluster Comput 24, 1381–1396 (2021). https://doi.org/10.1007/s10586-020-03194-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-020-03194-z

Keywords

Navigation