Skip to main content

Dynamic Service Migration via Approximate Markov Decision Process in Mobile Edge-Clouds

  • Conference paper
  • First Online:
Internet and Distributed Computing Systems (IDCS 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10794))

Included in the following conference series:

Abstract

By hosting cloud-based services at the network edge, mobile edge cloud has shown great advantage in reducing network overhead and latency of cloud services. In large scale mobile edge cloud, service migration is inevitable with the users movements, to guarantee service quality and reduce service cost. Due to the uncertainty of the users movements, it is very challenging to find the optimal migration strategy. In this paper, we study the problem of dynamic service migration in the mobile edge cloud for cost minimization. We formulate the problem as a Markov Decision Process (MDP) problem, which captures general cost models and provides a mathematical framework to design optimal service migration policies. However, solving the MDP problem suffers from the curse of dimensionality. To deal with this problem, we further exploit the special structure of the problem and propose an approximate MDP-based dynamic service migration method, which reduces the dimension of state space from a multi-dimensional mobility pattern to a two-dimensional mobility pattern. The extensive simulation and numerical results show that the approximate MDP method significantly reduces the cost of migration and transmission.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Deng, R., Lu, R., Lai, C., Luan, T.H.: Towards power consumption-delay tradeoff by workload allocation in cloud-fog computing. In: IEEE IC, pp. 3909–3914 (2015)

    Google Scholar 

  2. Dinh, H.T., Lee, C., Niyato, D., Wang, P.: A survey of mobile cloud computing: architecture, applications, and approaches. In: WCMC, pp. 1587–1611 (2013)

    Article  Google Scholar 

  3. Roman, R., Lopez, J., Mambo, M.: Mobile edge computing, Fog et al.: a survey and analysis of security threats and challenges. FGCS 78, 680–698 (2016)

    Article  Google Scholar 

  4. Bonomi, F., Milito, R., Natarajan, P., Zhu, J.: Fog computing: a platform for Internet of Things and analytics. In: Bessis, N., Dobre, C. (eds.) Big Data and Internet of Things: A Roadmap for Smart Environments. SCI, vol. 546, pp. 169–186. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-05029-4_7

    Chapter  Google Scholar 

  5. Satyanarayanan, M., Chen, Z., Ha, K., Hu, W., Richter, W., Pillai, P.: Cloudlets: at the leading edge of mobile-cloud convergence. In: ICMC, pp. 1–9 (2014)

    Google Scholar 

  6. Taleb, T., Ksentini, A., Frangoudis, P.: Follow-me cloud: when cloud services follow mobile users. IEEE TCC, 1 (2016)

    Google Scholar 

  7. Wang, S., Urgaonkar, R., Zafer, M., He, T., Chan, K., Leung, K.K.: Dynamic service migration in mobile edge-clouds. In: IFIP Networking, pp. 1–9 (2015)

    Google Scholar 

  8. Goswami, A., Patel, R.P.: Service migration in cluster based cloud computing environment. In: ICIP, pp. 468–471 (2015)

    Google Scholar 

  9. Tao, F., Li, C., Liao, T., Laili, Y.: BGM-BLA: a new algorithm for dynamic migration of virtual machines in cloud computing. IEEE TSC 9(6), 910–925 (2016)

    Google Scholar 

  10. Han, Z., Tan, H., Chen, G., Wang, R., Chen, Y., Lau, F.C.: Dynamic virtual machine management via approximate markov decision process. In: INFOCOM, pp. 1–9 (2016)

    Google Scholar 

  11. Wang, H., Li, Y., Zhang, Y., Jin, D.: Virtual machine migration planning in software-defined networks. In: IEEE TCC (2017)

    Google Scholar 

  12. Mach, P., Becvar, Z.: Mobile edge computing: a survey on architecture and computation offloading. IEEE Commun. Surv. Tutor. 1 (2017)

    Google Scholar 

  13. Ksentini, A., Taleb, T., Chen, M.: A Markov decision process-based service migration procedure for follow me cloud. In: ICC, pp. 1350–1354 (2014)

    Google Scholar 

  14. Bokani, A., Hassan, M., Kanhere, S., Zhu, X.: Optimizing http-based adaptive streaming in vehicular environment using Markov decision process. IEEE ToM 17(12), 2297–2309 (2015)

    Google Scholar 

  15. Bellman, R., Kalaba, R.E.: Dynamic programming and modern control theory, vol. 81 (1965)

    Google Scholar 

  16. Bertsekas, D.P.: Dynamic programming and optimal control, vol. 1, no. 2, Athena Scientific Belmont, MA (1995)

    Google Scholar 

Download references

Acknowledgment

This research was supported by the NSF of China (Grant No. 61673354, 61602199, 61672474, 61402425, 61501412) and the Provincial NSF of Hubei (Grant No. 2016CFB107, 2015CFB400). This paper has been subjected to Hubei Key Laboratory of Intelligent Geo-Information Processing, China University of Geosciences, Wuhan 430074, China.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lin Gu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chen, Z., Yao, H., Gu, L., Zeng, D., Zheng, K. (2018). Dynamic Service Migration via Approximate Markov Decision Process in Mobile Edge-Clouds. In: Fortino, G., Ali, A., Pathan, M., Guerrieri, A., Di Fatta, G. (eds) Internet and Distributed Computing Systems. IDCS 2017. Lecture Notes in Computer Science(), vol 10794. Springer, Cham. https://doi.org/10.1007/978-3-319-97795-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-97795-9_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-97794-2

  • Online ISBN: 978-3-319-97795-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics