skip to main content
10.1145/2351676.2351695acmconferencesArticle/Chapter ViewAbstractPublication PagesaseConference Proceedingsconference-collections
Article

An automated approach to forecasting QoS attributes based on linear and non-linear time series modeling

Published:03 September 2012Publication History

ABSTRACT

Predicting future values of Quality of Service (QoS) attributes can assist in the control of software intensive systems by preventing QoS violations before they happen. Currently, many approaches prefer Autoregressive Integrated Moving Average (ARIMA) models for this task, and assume the QoS attributes' behavior can be linearly modeled. However, the analysis of real QoS datasets shows that they are characterized by a highly dynamic and mostly nonlinear behavior to the extent that existing ARIMA models cannot guarantee accurate QoS forecasting, which can introduce crucial problems such as proactively triggering unrequired adaptations and thus leading to follow-up failures and increased costs. To address this limitation, we propose an automated forecasting approach that integrates linear and nonlinear time series models and automatically, without human intervention, selects and constructs the best suitable forecasting model to fit the QoS attributes' dynamic behavior. Using real-world QoS datasets of 800 web services we evaluate the applicability, accuracy, and performance aspects of the proposed approach, and results show that the approach outperforms the popular existing ARIMA models and improves the forecasting accuracy by on average 35.4%.

References

  1. H. Akaike. A new look at the statistical model identification. IEEE transactions on automatic control, 19(6):716–723, 1974.Google ScholarGoogle ScholarCross RefCross Ref
  2. A. Amin, A. Colman, and L. Grunske. Using Automated Control Charts for the Runtime Evaluation of QoS Attributes. In Proceedings of the 13ht IEEE International High Assurance Systems Engineering Symposium, pages 299–306. IEEE Computer Society, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. A. Amin, A. Colman, and L. Grunske. An Approach to Forecasting QoS Attributes of Web Services Based on ARIMA and GARCH Models. In Proceedings of the 19th International Conference on Web Services, pages 74–81. IEEE, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. A. Amin, A. Colman, and L. Grunske. Statistical Detection of QoS Violations Based on CUSUM Control Charts. In Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering, pages 97–108. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. H. Barringer, A. Goldberg, K. Havelund, and K. Sen. Rule-based runtime verification. In B. Steffen and G. Levi, editors, Proceedings of the 5th Intern. Conference on Verification, Model Checking, and Abstract Interpretation, volume 2937 of Lecture Notes in Computer Science, pages 44–57. Springer, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  6. G. E. P. Box and D. R. Cox. An analysis of transformations. Journal of the Royal Statistical Society. Series B (Methodological), 26(2):211–252, 1964.Google ScholarGoogle ScholarCross RefCross Ref
  7. G. E. P. Box and G. M. Jenkins. Time Series Analysis: Forecasting and Control. HoldenDay, San Francisco, 1976. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. G. E. P. Box and D. A. Pierce. Distribution of residual autocorrelations in autoregressive-integrated moving average time series models. Journal of the American Statistical Association, 65(332):1509–1526, 1970.Google ScholarGoogle ScholarCross RefCross Ref
  9. R. Calinescu, L. Grunske, M. Z. Kwiatkowska, R. Mirandola, and G. Tamburrelli. Dynamic qos management and optimization in service-based systems. IEEE Trans. Software Eng., 37(3):387–409, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. B. Cavallo, M. D. Penta, and G. Canfora. An empirical comparison of methods to support QoS-aware service selection. In Proceedings of the 2nd International Workshop on Principles of Engineering Service-Oriented Systems, pages 64–70. ACM, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. S. Fu and C.-Z. Xu. Exploring event correlation for failure prediction in coalitions of clusters. In Proceedings of the ACM/IEEE conference on Supercomputing, pages 1–12. ACM Press, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. S. Fu and C.-Z. Xu. Quantifying event correlations for proactive failure management in networked computing systems. Journal of parallel and distributed computing, 70(11):1100–1109, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. D. Gibbons and S. Chakraborti. Nonparametric statistical inference. CRC, 2003.Google ScholarGoogle Scholar
  14. M. Godse, U. Bellur, and R. Sonar. Automating QoS Based Service Selection. In Proceedings of the IEEE International Conference on Web Services, pages 534–541. IEEE, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. L. Grunske. An effective sequential statistical test for probabilistic monitoring. Information and Software Technology, 53(3):190 – 199, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. L. Grunske and P. Zhang. Monitoring probabilistic properties. In H. van Vliet and V. Issarny, editors, Proceedings of the 7th joint meeting of the European Software Engineering Conference and the International Symposium on Foundations of Software Engineering, pages 183–192. ACM, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. B. Hansen. Testing for linearity. Journal of Economic Surveys, 13(5):551–576, 1999.Google ScholarGoogle ScholarCross RefCross Ref
  18. D. Kwiatkowski, P. Phillips, P. Schmidt, and Y. Shin. Testing the null hypothesis of stationarity against the alternative of a unit root. Journal of Econometrics, 54:159–178, 1992.Google ScholarGoogle ScholarCross RefCross Ref
  19. M. Li, J. Huai, and H. Guo. An Adaptive Web Services Selection Method Based on the QoS Prediction Mechanism. In Proceedings of the International Conference on Web Intelligence and Intelligent Agent Technology, pages 395–402. IEEE, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. A. Metzger. Towards accurate failure prediction for the proactive adaptation of service-oriented systems. In Proceedings of the 8th workshop on Assurances for self-adaptive systems, pages 18–23. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. P. N. Nobile, R. R. F. Lopes, C. E. Moron, and L. C. Trevelin. QoS proxy architecture for real time RPC with traffic prediction. In Proceedings of the 11th IEEE International Symposium on Distributed Simulation and Real-Time Applications, pages 261–267. IEEE Computer Society, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. G. Rosu and K. Havelund. Rewriting-based techniques for runtime verification. Autom. Softw. Eng, 12(2):151–197, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. J. Simmonds, Y. Gan, M. Chechik, S. Nejati, B. O’Farrell, E. Litani, and J. Waterhouse. Runtime monitoring of web service conversations. IEEE T. Services Computing, 2(3):223–244, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. A. Solomon and M. Litoiu. Business process performance prediction on a tracked simulation model. In Proceeding of the 3rd international workshop on Principles of engineering service-oriented systems, pages 50–56. ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. H. Tong. Threshold models in non-linear time series analysis, volume 21. Springer, 1983.Google ScholarGoogle Scholar
  26. H. Tong. Non-linear time series: a dynamical system approach, volume 6. Oxford University, 1993.Google ScholarGoogle Scholar
  27. H. Tong and K. Lim. Threshold autoregression, limit cycles and cyclical data. Journal of the Royal Statistical Society. Series B (Methodological), pages 245–292, 1980.Google ScholarGoogle Scholar
  28. L. Zeng, C. Lingenfelder, H. Lei, and H. Chang. Event-driven quality of service prediction. In Proceedings of the 6th International Conference on Service-oriented Computing, pages 147–161. Springer-Verlag, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. L. Zeng, Y. Zhang, and X. Zhao. Storage performance optimization based on arima. In Proceedings of the First International Workshop on Database Technology and Applications, pages 377–381. IEEE, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Z. Zhang and S. Fu. Failure prediction for autonomic management of networked computer systems with availability assurance. In International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), pages 1––8. IEEE, 2010.Google ScholarGoogle Scholar
  31. Z. Zheng, Y. Zhang, and M. Lyu. Distributed qos evaluation for real-world web services. In ICWS, pages 83–90. IEEE, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. S. Zhu, Z. Du, Y. Chen, X. Chai, and B. Li. QoS Enhancement for PDES Grid Based on Time Series Prediction. In Proceedings of the 6th International Conference on Grid and Cooperative Computing, pages 423–429. IEEE, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. An automated approach to forecasting QoS attributes based on linear and non-linear time series modeling

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ASE '12: Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering
      September 2012
      409 pages
      ISBN:9781450312042
      DOI:10.1145/2351676

      Copyright © 2012 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 3 September 2012

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      Overall Acceptance Rate82of337submissions,24%

      Upcoming Conference

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader