Skip to main content
Log in

Efficient offloading schemes using Markovian models: a literature review

  • Regular Paper
  • Published:
Computing Aims and scope Submit manuscript

Abstract

The increasing demand for new mobile applications puts a heavy demand for more processing power and resources in smart mobile devices (SMD). Offloading is a promising solution for these issues which tries to move data, code, or computation from the SMDs to the remote or nearby resourceful servers. To increase the effectiveness of the offloading process and make better decisions, various stochastic offloading schemes are proposed in the literature which has adapted different stochastic models. Although offloading issues are vastly studied in the literature, there is a lack of comprehensive paper to focus on stochastic offloading solutions. This paper presents a meticulous review and classification of the stochastic offloading frameworks designed for different environments such as mobile cloud computing, mobile edge computing), and Fog computing. Following this, it first presents the required background concepts and key issues regarding the offloading problem and stochastic models. It then puts forward a taxonomy of the stochastic offloading approaches according to their applied stochastic models and highlights their architectures and contributions. In addition, in each category, a comparison of the stochastic offloading schemes is provided to illuminate their features. Finally, the concluding remarks and open research areas.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30

Similar content being viewed by others

References

  1. Zhang Q, Cheng L, Boutaba R (2010) Cloud computing: state-of-the-art and research challenges. J Internet Serv Appl 1(1):7–18

    Google Scholar 

  2. Chen X et al (2017) Exploiting massive D2D collaboration for energy-efficient mobile edge computing. IEEE Wirel Commun 24(4):64–71

    Google Scholar 

  3. Masdari M et al (2017) A survey of PSO-based scheduling algorithms in cloud computing. J Netw Syst Manag 25(1):122–158

    Google Scholar 

  4. Masdari M, Zangakani M (2019) Green cloud computing using proactive virtual machine placement: challenges and issues. J Grid Comput. https://doi.org/10.1007/s10723-019-09489-9

    Article  Google Scholar 

  5. Zhang K et al (2016) Energy-efficient offloading for mobile edge computing in 5G heterogeneous networks. IEEE Access 4:5896–5907

    Google Scholar 

  6. Shiraz M et al (2015) A study on the critical analysis of computational offloading frameworks for mobile cloud computing. J Netw Comput Appl 47:47–60

    Google Scholar 

  7. Kwon Y et al (2016) Precise execution offloading for applications with dynamic behavior in mobile cloud computing. Pervasive Mob Comput 27:58–74

    Google Scholar 

  8. Masdari M, Jalali M (2016) A survey and taxonomy of DoS attacks in cloud computing. Secur Commun Netw 9(16):3724–3751

    Google Scholar 

  9. Masdari M, Nabavi SS, Ahmadi V (2016) An overview of virtual machine placement schemes in cloud computing. J Netw Comput Appl 66:106–127

    Google Scholar 

  10. Masdari M et al (2016) Towards workflow scheduling in cloud computing: a comprehensive analysis. J Netw Comput Appl 66:64–82

    Google Scholar 

  11. Shiraz M et al (2015) Energy efficient computational offloading framework for mobile cloud computing. J Grid Comput 13(1):1–18

    MathSciNet  Google Scholar 

  12. Lordan F, Badia RM (2017) Compss-mobile: parallel programming for mobile cloud computing. J Grid Comput 15(3):357–378

    Google Scholar 

  13. Panigrahi CR, Sarkar JL, Pati B (2018) Transmission in mobile cloudlet systems with intermittent connectivity in emergency areas. Digit Commun Netw 4(1):69–75

    Google Scholar 

  14. Ghobaei-Arani M, Souri A, Rahmanian AA (2020) Resource management approaches in fog computing: a comprehensive review. J Grid Comput 18:1–42. https://doi.org/10.1007/s10723-019-09491-1

    Article  Google Scholar 

  15. Douc R et al (2018) Markov chains. Springer, Berlin

    MATH  Google Scholar 

  16. Hu M et al (2019) Quantifying the influence of intermittent connectivity on mobile edge computing. IEEE Trans Cloud Comput. https://doi.org/10.1109/TCC.2019.2926702

    Article  Google Scholar 

  17. Amiri M, Mohammad-Khanli L (2017) Survey on prediction models of applications for resources provisioning in cloud. J Netw Comput Appl 82:93–113

    Google Scholar 

  18. Li W et al (2019) Opportunistic computing offloading in edge clouds. J Parallel Distrib Comput 123:69–76

    Google Scholar 

  19. Yu F, Chen H, Xu J (2018) DMPO: dynamic mobility-aware partial offloading in mobile edge computing. Future Gener Comput Syst 89:722–735

    Google Scholar 

  20. Meng T et al (2018) A secure and cost-efficient offloading policy for mobile cloud computing against timing attacks. Pervasive Mob Comput 45:4–18

    Google Scholar 

  21. Nădăban S, Dzitac S, Dzitac I (2016) Fuzzy TOPSIS: a general view. Procedia Comput Sci 91:823–831

    MATH  Google Scholar 

  22. Zhang J et al (2018) Energy-latency tradeoff for energy-aware offloading in mobile edge computing networks. IEEE Internet Things J 5(4):2633–2645

    MathSciNet  Google Scholar 

  23. Shuja J et al (2017) Case of ARM emulation optimization for offloading mechanisms in mobile cloud computing. Future Gener Comput Syst 76:407–417

    Google Scholar 

  24. Tao X et al (2017) Performance guaranteed computation offloading for mobile-edge cloud computing. IEEE Wirel Commun Lett 6(6):774–777

    Google Scholar 

  25. Zhang Y, Niyato D, Wang P (2015) Offloading in mobile cloudlet systems with intermittent connectivity. IEEE Trans Mob Comput 14(12):2516–2529

    Google Scholar 

  26. Gu F et al (2018) Partitioning and offloading in smart mobile devices for mobile cloud computing: state of the art and future directions. J Netw Comput Appl 119:83–96

    Google Scholar 

  27. Pan Y et al (2017) On consideration of content preference and sharing willingness in D2D assisted offloading. IEEE J Sel Areas Commun 35(4):978–993

    Google Scholar 

  28. Flores H et al (2015) Mobile code offloading: from concept to practice and beyond. IEEE Commun Mag 53(3):80–88

    Google Scholar 

  29. Masdari M (2017) Markov chain-based evaluation of the certificate status validations in hybrid MANETs. J Netw Comput Appl 80:79–89

    Google Scholar 

  30. Akherfi K, Gerndt M, Harroud H (2018) Mobile cloud computing for computation offloading: issues and challenges. Appl Comput Inform 14(1):1–16

    Google Scholar 

  31. Pu L et al (2016) D2D fogging: an energy-efficient and incentive-aware task offloading framework via network-assisted D2D collaboration. IEEE J Sel Areas Commun 34(12):3887–3901

    MathSciNet  Google Scholar 

  32. Chen X et al (2015) Efficient multi-user computation offloading for mobile-edge cloud computing. IEEE/ACM Trans Netw 24(5):2795–2808

    Google Scholar 

  33. Kuang Z et al (2018) A quick-response framework for multi-user computation offloading in mobile cloud computing. Future Gener Comput Syst 81:166–176

    Google Scholar 

  34. Barrett E, Howley E, Duggan J (2013) Applying reinforcement learning towards automating resource allocation and application scalability in the cloud. Concurr Comput Pract Exp 25(12):1656–1674

    Google Scholar 

  35. Goudarzi M, Zamani M, Haghighat AT (2017) A fast hybrid multi-site computation offloading for mobile cloud computing. J Netw Comput Appl 80:219–231

    Google Scholar 

  36. Oo TZ et al (2016) Traffic offloading via Markov approximation in heterogeneous cellular networks. In: NOMS 2016–2016 IEEE/IFIP network operations and management symposium

  37. Oo TZ et al (2017) Offloading in HetNet: a coordination of interference mitigation, user association, and resource allocation. IEEE Trans Mob Comput 16(8):2276–2291

    Google Scholar 

  38. Zhang S et al (2016) Energy-aware traffic offloading for green heterogeneous networks. IEEE J Sel Areas Commun 34(5):1116–1129

    Google Scholar 

  39. Xiao L et al (2016) A mobile offloading game against smart attacks. IEEE Access 4:2281–2291

    Google Scholar 

  40. Li X et al (2015) Light-weight performance analysis of Wi-Fi offload using mean-field approximation. In 2015 21st Asia-Pacific conference on communications (APCC)

  41. Meng T, Wolter K, Wang Q (2015) Security and performance tradeoff analysis of mobile offloading systems under timing attacks. Springer, Cham

    Google Scholar 

  42. Wu H, Wolter K (2018) Stochastic analysis of delayed mobile offloading in heterogeneous networks. IEEE Trans Mob Comput 17(2):461–474

    Google Scholar 

  43. Zhang W, Wen Y, Wu DO (2013) Energy-efficient scheduling policy for collaborative execution in mobile cloud computing. In: 2013 proceedings IEEE INFOCOM

  44. Wu H, Wolter K (2016) Analysis of the energy-performance tradeoff for delayed mobile offloading. In: Proceedings of the 9th EAI international conference on performance evaluation methodologies and tools. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)

  45. Tang L, Chen X, He S (2016) When social network meets mobile cloud: a social group utility approach for optimizing computation offloading in Cloudlet. IEEE Access 4:5868–5879

    Google Scholar 

  46. Wu H, Knottenbelt W, Wolter K (2015) Analysis of the energy-response time tradeoff for mobile cloud offloading using combined metrics. In 2015 27th international teletraffic congress

  47. Roostaei R, Movahedi Z (2016) Mobility and context-aware offloading in mobile cloud computing. In: 2016 International IEEE conferences on ubiquitous intelligence and computing, advanced and trusted computing, scalable computing and communications, cloud and Big data computing, internet of people, and smart world congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld)

  48. Mehmeti F, Spyropoulos T (2017) Performance analysis of mobile data offloading in heterogeneous networks. IEEE Trans Mob Comput 16(2):482–497

    Google Scholar 

  49. Zhang X, Cao Y (2018) Mobile data offloading efficiency: a stochastic analytical view. In: 2018 IEEE international conference on communications workshops (ICC Workshops)

  50. Berg F, Dürr F, Rothermel K (2014) Optimal predictive code offloading. In: Proceedings of the 11th international conference on mobile and ubiquitous systems: computing, networking and services. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)

  51. Wu H, Sun Y, Wolter K (2015) Analysis of the energy-response time tradeoff for delayed mobile cloud offloading. ACM SIGMETRICS Perform Eval Rev 43(2):33–35

    Google Scholar 

  52. Ko S et al (2017) Energy efficient mobile computation offloading via online prefetching. In: 2017 IEEE international conference on communications (ICC)

  53. Zhang W et al (2013) Energy-optimal mobile cloud computing under stochastic wireless channel. IEEE Trans Wirel Commun 12(9):4569–4581

    Google Scholar 

  54. Kim J et al (2013) Placement of WiFi access points for efficient WiFi offloading in an overlay network. In: 2013 IEEE 24th annual international symposium on personal, indoor, and mobile radio communications (PIMRC)

  55. Kim S et al (2016) Prediction-based personalized offloading of cellular traffic through WiFi networks. In: 2016 IEEE international conference on pervasive computing and communications (PerCom)

  56. Gao W et al (2014) On exploiting dynamic execution patterns for workload offloading in mobile cloud applications. In: 2014 IEEE 22nd international conference on network protocols

  57. Tong L, Gao W (2016) Application-aware traffic scheduling for workload offloading in mobile clouds. In: IEEE INFOCOM 2016—the 35th annual IEEE international conference on computer communications

  58. Meng T, Wang Q, Wolter K (2015) Model-based quantitative security analysis of mobile offloading systems under timing attacks. Springer, Cham

    Google Scholar 

  59. Yamamoto H et al (2014) Modeling of dynamic trend of latency variations on mobile network using markov regime switching. In: 2014 IEEE 38th international computer software and applications conference workshops

  60. Yu P et al (2015) Energy harvesting personal cells—traffic offloading and network throughput. In: 2015 IEEE international conference on communications (ICC)

  61. Cheng N et al (2016) Opportunistic WiFi offloading in vehicular environment: a game-theory approach. IEEE Trans Intel Transp Syst 17(7):1944–1955

    Google Scholar 

  62. Wei Y et al (2016) The offloading model for green base stations in hybrid energy networks with multiple objectives. Int J Commun Syst 29(11):1805–1816

    Google Scholar 

  63. Xu J, Chen L, Ren S (2017) Online learning for offloading and autoscaling in energy harvesting mobile edge computing. IEEE Trans Cognit Commun Netw 3(3):361–373

    Google Scholar 

  64. Alam MGR et al (2019) Autonomic computation offloading in mobile edge for IoT applications. Future Gener Comput Syst 90:149–157

    Google Scholar 

  65. Alasmari KR, Green RC, Alam M (2018) Mobile edge offloading using markov decision processes. In: International conference on edge computing. Springer

  66. Zhang C et al (2017) Cost-and energy-aware multi-flow mobile data offloading under time dependent pricing. In: 2017 13th international conference on network and service management (CNSM). IEEE

  67. Le DV, Tham C (2018) A deep reinforcement learning based offloading scheme in ad-hoc mobile clouds. In: IEEE INFOCOM 2018—IEEE conference on computer communications workshops (INFOCOM WKSHPS)

  68. Wang W et al (2017) Edge caching at base stations with device-to-device offloading. IEEE Access 5:6399–6410

    Google Scholar 

  69. Labidi W, Sarkiss M, Kamoun M (2015) Energy-optimal resource scheduling and computation offloading in small cell networks. In: 2015 22nd international conference on telecommunications (ICT)

  70. Fricker C et al (2016) Analysis of an offloading scheme for data centers in the framework of fog computing. ACM Trans Model Perform Eval Comput Syst (TOMPECS) 1(4):16

    Google Scholar 

  71. Zannat H, Hossain MS (2016) A hybrid framework using Markov decision process for mobile code offloading. In; 2016 19th international conference on computer and information technology (ICCIT)

  72. Terefe MB et al (2016) Energy-efficient multisite offloading policy using Markov decision process for mobile cloud computing. Pervasive Mob Comput 27:75–89

    Google Scholar 

  73. Liu D, Khoukhi L, Hafid A (2017) Data offloading in mobile cloud computing: a Markov decision process approach. In: 2017 IEEE international conference on communications (ICC)

  74. Hyytiä E, Spyropoulos T, Ott J (2015) Offload (only) the right jobs: robust offloading using the Markov decision processes. In; 2015 IEEE 16th international symposium on a world of wireless, mobile and multimedia networks (WoWMoM)

  75. Truong-Huu T, Tham C, Niyato D (2014) To offload or to wait: an opportunistic offloading algorithm for parallel tasks in a mobile cloud. In: 2014 IEEE 6th international conference on cloud computing technology and science

  76. Zhang C et al (2016) A reinforcement learning approach for cost- and energy-aware mobile data offloading. In; 2016 18th Asia-Pacific network operations and management symposium (APNOMS)

  77. Liu B et al (2018) Congestion-optimal WIFI offloading with user mobility management in smart communications. Wirel Commun Mob Comput. https://doi.org/10.1155/2018/9297536

    Article  Google Scholar 

  78. Kim Y et al (2016) Multi-flow rate control in delayed Wi-Fi offloading systems. In; 2016 international conference on information networking (ICOIN)

  79. Komnios I, Tsapeli F, Gorinsky S (2015) Cost-effective multi-mode offloading with peer-assisted communications. Ad Hoc Netw 25:370–382

    Google Scholar 

  80. Liu B, Zhu Q, Zhu H (2017) CAWO: congestion-aware WiFi offloading for 5G heterogeneous wireless network. In: 2017 13th international wireless communications and mobile computing conference (IWCMC)

  81. Le DV, Tham C (2017) An optimization-based approach to offloading in ad-hoc mobile clouds. In: GLOBECOM 2017—2017 IEEE global communications conference

  82. Ranadheera S, Maghsudi S, Hossain E (2017) Mobile edge computation offloading using game theory and reinforcement learning. arXiv preprint arXiv:1711.09012

  83. Mao Y, Zhang J, Letaief KB (2016) Dynamic computation offloading for mobile-edge computing with energy harvesting devices. IEEE J Sel Areas Commun 34(12):3590–3605

    Google Scholar 

  84. Hyytiä E, Spyropoulos T, Ott J (2013) Optimizing offloading strategies in mobile cloud computing. In: Cryptanalyst

  85. Wu H, Wolter K (2014) Tradeoff analysis for mobile cloud offloading based on an additive energy-performance metric. In: Proceedings of the 8th international conference on performance evaluation methodologies and tools. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)

  86. Ko H, Lee J, Pack S (2018) Spatial and temporal computation offloading decision algorithm in edge cloud-enabled heterogeneous networks. IEEE Access 6:18920–18932

    Google Scholar 

  87. Chen X et al (2015) A learning approach for traffic offloading in stochastic heterogeneous cellular networks. In: 2015 IEEE international conference on communications (ICC). IEEE

  88. He X et al (2017) Privacy-aware offloading in mobile-edge computing. In; GLOBECOM 2017—2017 IEEE global communications conference

  89. Liu J et al (2016) Delay-optimal computation task scheduling for mobile-edge computing systems. In; 2016 IEEE international symposium on information theory (ISIT)

  90. Carvalho GHS et al (2017) A Semi-Markov decision model-based brokering mechanism for mobile cloud market. In 2017 IEEE international conference on communications (ICC)

  91. Wang Z, Zhong Z, Ni M (2017) A semi-Markov decision process-based computation offloading strategy in vehicular networks. In: 2017 IEEE 28th annual international symposium on personal, indoor, and mobile radio communications (PIMRC)

  92. Zhang D, Yeo CK (2012) Optimal handing-back point in mobile data offloading. In: 2012 IEEE vehicular networking conference (VNC)

  93. Chen S, Wang Y, Pedram M (2014) Optimal offloading control for a mobile device based on a realistic battery model and semi-Markov decision process. In: Proceedings of the 2014 IEEE/ACM international conference on computer-aided design. IEEE Press

  94. Zhuo X et al (2014) An incentive framework for cellular traffic offloading. IEEE Trans Mob Comput 13(3):541–555

    Google Scholar 

  95. Liu Y, Lee MJ, Zheng Y (2016) Adaptive multi-resource allocation for cloudlet-based mobile cloud computing system. IEEE Trans Mob Comput 15(10):2398–2410

    Google Scholar 

  96. Hoang DT, Niyato D, Wang P (2012) Optimal admission control policy for mobile cloud computing hotspot with cloudlet. In: 2012 IEEE wireless communications and networking conference (WCNC)

  97. Wang Z, Zhong Z, Ni M (2018) Application-aware offloading policy using SMDP in vehicular fog computing systems. In: 2018 IEEE international conference on communications workshops (ICC Workshops)

  98. Ramakrishnan AK et al (2012) Federated mobile activity recognition using a smart service adapter for cloud offloading. Springer, Dordrecht

    Google Scholar 

  99. Wang X, Xu W, Jin Z (2017) A hidden Markov model based dynamic scheduling approach for mobile cloud telemonitoring. In: 2017 IEEE EMBS international conference on biomedical and health informatics (BHI). IEEE

  100. Eom H et al (2013) Machine learning-based runtime scheduler for mobile offloading framework. In; Proceedings of the 2013 IEEE/ACM 6th international conference on utility and cloud computing. IEEE Computer Society

  101. Lordan F, Jensen J, Badia RM (2018) Towards mobile cloud computing with single sign-on access. J Grid Comput 16(4):627–646

    Google Scholar 

  102. Kashyap R, Vidyarthi DP (2013) Security driven scheduling model for computational grid using NSGA-II. J Grid Comput 11(4):721–734

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hemn Khezri.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Masdari, M., Khezri, H. Efficient offloading schemes using Markovian models: a literature review. Computing 102, 1673–1716 (2020). https://doi.org/10.1007/s00607-020-00812-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-020-00812-x

Keywords

Mathematics Subject Classification

Navigation