Skip to main content

TMRCP: A Trend-Matching Resources Coupled Prediction Method over Data Stream

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10638))

Included in the following conference series:

  • 4537 Accesses

Abstract

Resource prediction promotes dynamic scheduling and energy saving in cloud computing. However, resource prediction becomes a challenge with the diversity and dynamicity of the cloud environment. Existing methods merely focus on single specific resource and ignore the correlation among resources, resulting in inaccurate predictions. Therefore, we propose a trend-matching resources coupled prediction method (TMRCP) based on incremental learning over data stream, which consists of three algorithms. Firstly, to cope with the diversity of the cloud environment, we propose a Resources Utilization Trend Matching algorithm (RUTM), which defines a new similarity measure for multi-dimensional sequences and takes the correlation among resources into consideration. Secondly, we propose a dynamic prediction window adjustment algorithm that selects appropriate prediction length for different resource utilization trends to overcome the disadvantage of fixed window. Thirdly, in response to the sudden changes, we put forward a mixed synthesis algorithm to improve the robustness of the method. Experiments on Google’s cluster usage trace show that the Mean Absolute Percentage Error of TMRCP is 4.7%, 20% better than the state-of-the-art. In addition, the TMRCP is still accurate in multi-step-ahead prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  1. Plummer, D.C., Bittman, T.J., Austin, T., Cearley, D.W., Smith, D.M.: Cloudcomputing: defining and describing an emerging phenomenon. Gartner (2008)

    Google Scholar 

  2. Reiss, C., Wilkes, J., Hellerstein, J.L.: Google cluster-usage traces: format+schema. Google Inc. (2011)

    Google Scholar 

  3. Tang, Z., Mo, Y., Li, K., Li, K.: Dynamic forecast scheduling algorithm for virtualmachine placement in cloud computing environment. J. Supercomput. 70(3), 1279–1296 (2014)

    Article  Google Scholar 

  4. Roy, N., Dubey, A., Gokhale, A.: Effcient autoscaling in the cloud using predictive models for workload forecasting. In: IEEE International Conference on CloudComputing, pp. 500–507 (2011)

    Google Scholar 

  5. Xiao, Z., Song, W., Chen, Q.: Dynamic resource allocation using virtual machines for cloud computing environment. IEEE Trans. Parallel Distrib. Syst. 24(6), 1107–1117 (2013)

    Article  Google Scholar 

  6. Niu, D., Liu, Z., Li, B., Zhao, S.: Demand forecast and performance predictionin peer-assisted on-demand streaming systems. In: IEEE INFOCOM, pp. 421–425 (2011)

    Google Scholar 

  7. Calheiros, R., Masoumi, E., Ranjan, R., Buyya, R.: Workload prediction using ARIMA model and its impact on cloud applications’ QoS. IEEE Trans. Cloud Comput. 3(4), 449–458 (2014)

    Article  Google Scholar 

  8. Islam, S., Keung, J., Lee, K., Liu, A.: Empirical prediction models for adaptive resource provisioning in the cloud. Future Gener. Comput. Syst. 28(1), 155–162 (2014)

    Article  Google Scholar 

  9. Shyam, G.K., Manvi, S.S.: Virtual resource prediction in cloud environment: a Bayesian approach. J. Netw. Comput. Appl. 65, 144–154 (2016)

    Article  Google Scholar 

  10. Liu, C., Shang, Y., Duan, L., Chen, S., Liu, C., Chen, J.: Optimizing workload category for adaptive workload prediction in service clouds. In: Barros, A., Grigori, D., Narendra, N.C., Dam, H.K. (eds.) ICSOC 2015. LNCS, vol. 9435, pp. 87–104. Springer, Heidelberg (2015). doi:10.1007/978-3-662-48616-0_6

    Chapter  Google Scholar 

  11. Dabbagh, M., Hamdaoui, B., Guizani, M., Rayes, A.: Efficient datacenter resource utilization through cloud resource overcommitment. In: Proceedings of IEEE INFOCOM 2015 (2015)

    Google Scholar 

  12. Subbiah, S., Wilkes, J., Gu, X.H., Nguyen, H., Shen, Z.: AGILE: elastic distributed resource scaling for infrastructure-as-a-service. In: International Conference on Autonomic Computing (2014)

    Google Scholar 

  13. Amiri, M., Mohammad-Khanli, L.: Survey on prediction models of applications forresources provisioning in cloud. J. Netw. Comput. Appl. 82, 93–113 (2017)

    Article  Google Scholar 

  14. Khan, A., Yan, X., Tao, S., Anerousis, N.: Workload characterization and prediction in the cloud: a multiple time series approach. In: 2012 IEEE Network Operations and Management Symposium (NOMS), pp. 1287–1294. IEEE (2012)

    Google Scholar 

  15. Istin, M., Visan, A., Pop, F., Cristea, V.: Decomposition based algorithm for stateprediction in large scale distributed systems. In: Ninth International Symposium on Parallel and Distributed Computing, pp. 17–24 (2010)

    Google Scholar 

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant No. 61379052), the National Key Research and Development Program (Grant No. 2016YFB1000101), the Natural Science Foundation for Distinguished Young Scholars of Hunan Province (Grant No. 14JJ1026), Specialized Research Fund for the Doctoral Program of Higher Education (Grant No. 20124307110015), the National Natural Science Foundation of China (Grant No. 61502513), the National Natural Science Foundation of China (Grant No. 61502513).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yijie Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wu, R., Wang, Y., Ma, X., Cheng, L. (2017). TMRCP: A Trend-Matching Resources Coupled Prediction Method over Data Stream. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10638. Springer, Cham. https://doi.org/10.1007/978-3-319-70139-4_51

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-70139-4_51

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70138-7

  • Online ISBN: 978-3-319-70139-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics