Skip to main content
SpringerLink
Log in

Monitoring web services’ quality of service: a literature review

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Monitoring Quality of Service (QoS) compliance is an important procedure in web service environment. It determines whether users’ expectations are met, and becomes the vital factor for them to decide whether to continue paying for the service or not. The monitoring is performed by checking the actual services performance against the QoS stated in Service Level Agreement (SLA). In relation to that, the need for monitoring vague QoS specifications in SLA has become more apparent nowadays. This paper reviews the published literature on web services QoS monitoring. A total of 60 selected articles were systematically analyzed. There were 23 of the articles selected through restrictive search criteria while the other 37 were selected based on unrestrictive search criteria. The review shows that little evidence exists on monitoring vague QoS specifications of web services. Providing ability for monitoring QoS that is specified vaguely in SLA could give new insights and implications to web services field. This paper concludes with some recommended future works to construct the theory and perform the empirical research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Allenotor D, Thulasiram RK (2008) A fuzzy grid-QoS framework for obtaining higher grid resources availability. In: Proceedings of the 3rd international conference on advances in grid and pervasive computing, pp 128–139

  • Ameller D, Franch X (2008) Service level agreement monitor (SALMon). Seventh international conference on the composition-based software systems, ICCBSS 2008, pp 224–227

  • Angelov S, Grefen P (2004) The business case for B2B e-contracting. In: Proceedings of the 6th international conference on electronic commerce, pp 31–40

  • Artaiam N, Senivongse T (2008) Enhancing service-side QoS monitoring for web services. In: Proceedings of the ninth ACIS international conference on the software engineering, artificial intelligence, networking, and parallel/distributed computing, pp 765–770

  • Asadollah SA, Thiam KC (2011) Web service response time monitoring: architecture and validation. Theor Math Found Comput Sci Commun Comput Inf Sci 164: 276–282

    Article  Google Scholar 

  • Baazizi MA, Sebahi S, Hacid M-S, Benbernou S, Papazoglou M (2008) Monitoring web services: a database approach. Towards a service-based internet. Lect Notes Comput Sci 5377/2008: 98–109

    Article  Google Scholar 

  • Bacciu D, Buscemi MG, Mkrtchyan L (2010) Adaptive fuzzy-valued service selection. In: Proceedings of the 2010 ACM symposium on applied computing, pp 2467–2471

  • Beeri C, Eyal A, Milo T, Pilberg A (2007) Monitoring business processes with queries. In: Proceedings of the 33rd international conference on very large data bases, pp 603–614

  • Castillo O, Melin P (2002) A new hybrid approach for plant monitoring and diagnostics combining type-2 fuzzy logic and fractal theory. In: Proceedings of the 2002 annual meeting of the North American Fuzzy Information Processing Society, NAFIPS, pp 111–116

  • Chen L, Ha W, Zhang G (2009) A new web service evaluation model with fuzzy C-means artificial immune network memory classifier. In: Proceedings of the 2009 international conference on computational intelligence and security, vol 2, pp 25–29

  • Chen J, Jia J, Duan L (2011) DOM semantic expansion-based extraction of topical information from web pages. Lect Notes Comput Sci 6988/2011: 343–350

    Article  Google Scholar 

  • Cheng W, Hongbing W (2007) Uncertainty-aware QoS description and selection model for web services. In: Proceedings of the IEEE international conference on services computing, pp 154–161

  • Chou L-D, Chen C-C, Tseng P-C (2009) Design and implementation of a policy-based monitoring system for web services. J Inf Sci Eng 25(5): 1357–1372

    Google Scholar 

  • Chung L, Sampaio do Prado Leite JC (2009) On non-functional requirements in software engineering. Lect Notes Comput Sci 5600/2009: 363–379

    Article  Google Scholar 

  • Coccoli M, Vercelli G, Vivanet G (2012) Semantic wiki: A collaborative tool for instructional content design. J E-Learn Knowl Soc 8(2): 113–122

    Google Scholar 

  • Coles A, Coles AJ, Clark A, Gilmore S (2011) Cost-sensitive concurrent planning under duration uncertainty for service-level agreements. In: Proceedings of the 21st international conference on automated planning and scheduling, pp 34–41

  • Dereli T, Baykasoglu A, Altun K, Durmusoglu A, Türksen IB (2010) Industrial applications of type-2 fuzzy sets and systems: a concise review. Comput Ind 62(2): 125–137

    Article  Google Scholar 

  • Du R, Zhao P (2011) Subjective trust evaluation model based on preferences. Commun Comput Inf Sci 215(2): 466–472

    Article  MathSciNet  Google Scholar 

  • Eze B, Kuziemsky C, Peyton L, Middleton G, Mouttham A (2010) Policy-based data integration for e-health monitoring processes in a B2B environment: experiences from Canada. J Theor Appl Electron Commer Res 5(1): 56–70

    Google Scholar 

  • Golshan F, Barforoush AA (2009) A new approach for tracing quality attributes in service oriented architecture using graph transformation systems. In: Proceedings of the 14th international computer conference, CSICC 2009, pp 10–16

  • Grouès V, Naudet Y, Kao O (2011) Combining linguistic values and semantics to represent user preferences. The 6th international workshop on semantic media adaptation and personalization, pp 27–32

  • Guo N, Gao T, Zhang B (2008) A trusted quality of web services management framework based on six dimensional QoWS model and end-to-end monitoring. Lect Notes Comput Sci 5297:437–440

    Google Scholar 

  • Halima RB, Guennoun K, Drira K, Jmaiel M (2008) Providing predictive self-healing for web services: a QoS monitoring and analysis-based approach. J Inf Assur Secur 3: 175–184

    Google Scholar 

  • Halima RB, Fki E, Drira K, Jmaiel M (2010) A large-scale monitoring and measurement campaign for Web Services-based applications. Concurr Comput Pract Exp 22(10): 1207–1222

    Article  Google Scholar 

  • Hassanzadeh A, Namdarian L, Elahi S (2011) Developing a framework for evaluating service oriented architecture governance (SOAG). Knowl Based Syst 24(5): 716–730. doi:10.1016/j.knosys.2011.02.012

    Article  Google Scholar 

  • Hettne K, Soiland-Reyes S, Klyne G, Belhajjame K, Gamble M, Bechhofer S, Roos M, Corcho O (2012) Workflow forever: semantic web semantic models and tools for preserving and digitally publishing computational experiments. In: Proceedings of the 4th semantic web applications and tools for the life sciences, pp 36–37

  • Heward G, Müller I, Jun H, Schneider J-G, Versteeg S (2010) Assessing the performance impact of service monitoring. In: Proceedings of the 21st Australian software engineering conference, IEEE Computer Society, pp 192–201

  • International Data Corporation (IDC) (2012) IDC cloud research, International Data Corporation. http://www.idc.com/prodserv/idc_cloud.jsp. Accessed 21 June 2012

  • Jiao Y, Li L, Ye N (2011) Towards a lightweight SOA framework for enterprise cloud computing. The 15th international conference on computer supported cooperative work in design, pp 386–392

  • Kalavathy GM, Seethalakshmi P (2009) Parallel performance monitoring service for dynamically composed media web services. J Comput Sci 5:487–492

    Google Scholar 

  • Keller A, Ludwig H (2003) The WSLA framework: specifying and monitoring service level agreements for web services. J Netw Syst Manag 11(1): 57–81

    Article  Google Scholar 

  • Khaxar M, Jalili S (2012) WSCMon: runtime monitoring of web service ochestration based on refinement checking. Serv Oriented Comput Appl 6(1): 1–17

    Article  Google Scholar 

  • Lee M, Kim W, Park S (2012) Searching and rankinxg method of relevant resources by user intention on the semantic web. Expert Syst Appl Int J 39(4): 4111–4121

    Article  MathSciNet  Google Scholar 

  • Leff A, Rayfield JT, Dias DM (2003) Service-level agreements and commercial grids. IEEE Internet Comput 7(4): 44–50

    Article  Google Scholar 

  • Leitner P, Wetzstein B, Rosenberg F, Michlmayr A, Dustdar S, Leymann F (2009) Runtime prediction of service level agreement violations for composite services. In: Proceedings of the 2009 international conference on service-oriented computing, pp 176–186

  • Leitner P, Michlmayr A, Rosenberg F, Dustdar S (2010) Monitoring, prediction and prevention of SLA violations in composite services. In: Proceedings of the 2010 IEEE international conference on web services, pp 369–376

  • Liang S. (2011) The design and realization of cloud computing framework model based on SOA. Adv Mater Res 171(172): 696–701

    Google Scholar 

  • Lim J, Lee KH (2010) Constructing composite web services from natural language requests. Web Semant 8(1): 1–13. doi:10.1016/j.websem.2009.09.007

    Article  Google Scholar 

  • Liu Z, Squillante MS, Wolf JL (2001) On maximizing service-level-agreement profits. In: Proceedings of the 3rd ACM conference on electronic commerce, pp 213–223

  • Liu G-Q, Zhu Z-L, Liu Y (2012) Quality analysis and monitoring strategy research for web service in the internet. Technol Educ Learn Adv Intell Soft Comput 136: 541–548

    Article  Google Scholar 

  • Lukasiewicz T, Straccia U (2008) Managing uncertainty and vagueness in description logics for the semantic web. Web Semant 6(4): 291–308

    Article  Google Scholar 

  • Mendel JM (2003) Fuzzy sets for words: a new beginning. In: Proceedings of the 12th IEEE international conference on fuzzy systems, vol 1, pp 37–42

  • Mendel JM (2007) Computing with words: Zadeh, Turing, Popper and Occam. IEEE Comput Intell Mag 2(4): 10–17

    Article  MathSciNet  Google Scholar 

  • Michlmayr A, Rosenberg F, Leitner P, Dustdar S (2009) Comprehensive QoS monitoring of web services and event-based SLA violation detection. In: Proceedings of the 4th international workshop on middleware for service oriented computing, pp 1–6

  • Michlmayr A, Rosenberg F, Leitner P, Dustdar S (2010) End-to-end support for QoS-aware service selection, binding, and mediation in VRESCo. IEEE Trans Serv Comput 3(3): 193–205

    Article  Google Scholar 

  • Microsoft News Center (2012) Cloud computing to create 14 million new jobs by 2015, Microsoft. http://www.microsoft.com/en-us/news/features/2012/mar12/03-05CloudComputingJobs.aspx. Accessed 20 June 2012

  • Mobedpour D, Chen D (2011) User-centered design of a QoS-based web service selection system. Serv Oriented Comput Appl 1–11. doi:10.1007/s11761-011-0091-x

  • Modica GD, Tomarchio O, Vita L (2009) Dynamic SLAs management in service oriented environments. J Syst Softw 82(5): 759–771

    Article  Google Scholar 

  • Muller C, Resinas M, Ruiz-Cortes A (2009) Explaining the non-compliance between templates and agreement offers in WS-Agreement. In: Proceedings of the 7th international joint conference on service-oriented computing, pp 237–252

  • Nagy W, Mokhtar HMO, El-Bastawissy A (2011) A flexible tool for web service selection in service oriented architecture. Int J Adv Comput Sci Appl 2(12): 191–201

    Google Scholar 

  • Patel SV, Pandey K (2010) Design of SOA based framework for collaborative cloud computing in wireless sensor networks. Int J Grid High Perform Comput 2(3): 60–73

    Article  Google Scholar 

  • Porter G, Katz RH (2006) Effective web service load balancing through statistical monitoring. Commun ACM Self Manag Syst 49(3): 48–54

    Article  Google Scholar 

  • Queiroz M, Moura A, Sauve J, Bartolini C, Hickey M (2009) A model for decision support in business-driven IT service portfolio management using SLA-dependent criteria and under uncertainty. In: Proceedings of the international conference on management of emergent digital ecosystems. doi:10.1145/1643823.1643874

  • Raimondi F, Skene J, Emmerich W, Wozna B (2007) A methodology for online monitoring non-functional specification of web-services. The first international workshop on property verification for software components and services (PROVECS’07), pp 50–59

  • Raimondi F, Skene J, Emmerich W (2008) Efficient online monitoring of web-service SLAs. In: Proceedings of the 16th ACM SIGSOFT international symposium on foundations of software engineering, pp 170–180

  • Reiff-Marganiec S, Yu HQ, Tilly M (2009) Service selection based on non-functional properties. Service-oriented computing—ICSOC 2007 workshops, pp 128–138

  • Rosario S, Benveniste A, Haar S, Jard C (2008) Probabilistic QoS and soft contracts for transaction-based web services orchestrations. IEEE Trans Serv Comput 1(4): 187–200

    Article  Google Scholar 

  • Rouached M, Perrin O, Godart C (2005) A contract-based approach for monitoring collaborative web services using commitments in the event calculus. Web Inf Syst Eng Lect Notes Comput Sci 3806/2005: 426–434

    Article  Google Scholar 

  • Saxena N, Goel A, Singh D (2009) A probe-based observability mechanism for monitoring of web services. Int J Recent Trends Eng 1(1): 600–602

    Google Scholar 

  • Schaefer J (2006) An approach for fine-grained web service performance monitoring. Distrib Appl Interoperable Syst Lect Notes Comput Sci 4025/2006: 169–180

    Article  Google Scholar 

  • Sepulveda R, Castillo O, Melin P, Rodriguez-Diaz A, Montiel O (2007) Experimental study of intelligent controllers under uncertainty using type-1 and type-2 fuzzy logic. Inf Sci Int J 177(10): 2023–2048. doi:10.1016/j.ins.2006.10.004

    Google Scholar 

  • Sherchan W, Loke SW, Krishnaswamy S (2006) A fuzzy model for reasoning about reputation in web services. In: Proceedings of the 2006 ACM symposium on applied computing, pp 1886–1892

  • Shin D-H, Lee K-H, Suda T (2009) Automated generation of composite web services based on functional semantics. Web Semant Sci Serv Agents World Wide Web 7(4): 332–343. doi:10.1016/j.websem.2009.05.001

    Article  Google Scholar 

  • Simmonds J, Gan Y, Chechik M, Nejati S, O’Farrell B, Litani E, Waterhouse J (2009) Runtime monitoring of web service conversations. IEEE Trans Serv Comput 2(3): 223–244

    Article  Google Scholar 

  • Stavropoulos TG, Vrakas D, Vlahavas I (2011) A survey of service composition in ambient intelligence environments. Artif Intell Rev 1–24. doi:10.1007/s10462-011-9283-1

  • Stoilos G, Stamou G, Pan JZ (2010) Fuzzy extensions of OWL: logical properties and reduction to fuzzy description logics. Int J Approx Reason 51(6): 656–679

    Article  MATH  MathSciNet  Google Scholar 

  • Tao Q, Chang H-Y, Gu C-Q, Yi Y (2012) A novel prediction approach for trustworthy QoS of web services. Expert Syst Appl Int J 39(3): 3676–3681. doi:10.1016/j.eswa.2011.09.060

    Article  Google Scholar 

  • Tseng JCR, Wu C-H (2007) An expert system approach to improving stability and reliability of web service. Expert Syst Appl Int J 33(2): 379–388. doi:10.1016/j.eswa.2006.05.024

    Article  Google Scholar 

  • Wang K, Takahashi A (2012) Semantic web based innovative design knowledge modeling for collaborative design. Expert Syst Appl Int J 39(5): 5616–5624

    Article  Google Scholar 

  • Wang Q, Shao J, Deng F, Liu Y, Li M, Han J, Mei H (2009) An online monitoring approach for web service requirements. IEEE Trans Serv Comput 2(4): 338–351

    Article  Google Scholar 

  • Wang P, Chao K-M, Lo C-C (2010) On optimal decision for QoS-aware composite service selection. Expert Syst Appl Int J 37(1): 440–449. doi:10.1016/j.eswa.2009.05.070

    Article  Google Scholar 

  • Wetzstein B, Leitner P, Rosenberg F, Brandic I, Dustdar S, Leymann F (2009) Monitoring and analyzing influential factors of business process performance. In: Proceedings of the 2009 IEEE international enterprise distributed object computing conference (EDOC 2009), pp 141–150

  • Wu G, Wei J, Huang T (2008) Flexible pattern monitoring for WS-BPEL through stateful aspect extension. In: Proceedings of the 2008 IEEE international conference on web services, pp 577–584

  • Wu H, Li Z, Zhang H, Yang C, Shen S (2010) Monitoring and evaluating the quality of web map service resources for optimizing map composition over the internet to support decision making. Comput Geosci 37(4): 485–494

    Article  Google Scholar 

  • Yan S, Shang J, Liu L (2011) Design and implementation of status monitoring system for e-learning web service. Commun Comput Inf Sci 233: 158–165

    Article  Google Scholar 

  • Yang Y, Luo D, Zhang C (2010) A multiple system performance monitoring model for web services. Agents Data Min Interact Lect Notes Comput Sci 5980/2010: 149–161

    Article  Google Scholar 

  • Yeom G, Tsai W-T, Bai X, Lee Y (2009) Design of a contract-based web services QoS management system. The 29th IEEE international conference on distributed computing systems workshops, pp 306–311

  • Yeom G, Tsai W-T, Bai X, Lee Y (2011) A design of policy-based composite web services QoS monitoring system. Int J Crit Comput Based Syst 2(1): 79–91

    Article  Google Scholar 

  • Yu L (2007) Applying software wrapping on performance monitoring of web services. INFOCOMP J Comput Sci 6(3): 1–6

    Google Scholar 

  • Zadeh LA (1975) The concept of a linguistic variable and its application to approximate reasoning—1. Inf Sci 8: 199–249

    Article  MATH  MathSciNet  Google Scholar 

  • Zadeh MH, Seyyedi MA (2010) Qos monitoring for web services by time series forecasting. 2010 3rd IEEE international conference on computer science and information technology (ICCSIT), pp 659–663

  • Zadeh MH, Seyyedi MA (2011) Applying a predictive approach for QoS monitoring in web service. Commun Comput Inf Sci 142(1): 237–241

    Article  Google Scholar 

  • Zahoor E, Perrin O, Godart C (2009) An integrated declaratve approach to web services composition and monitoring. Lect Notes Comput Sci 5802:247–260

    Google Scholar 

  • Zeng L, Lei H, Chang H (2007) Monitoring the QoS for web services. Serv Oriented Comput Lect Notes Comput Sci 4749/2007: 132–144

    Article  Google Scholar 

  • Zhou C, Chia L-T, Lee BS (2004) DAML-QoS ontology for web services. In: Proceedings of the IEEE international conference on web services, 2004, pp 472–479

Download references

Author information

Authors and Affiliations

  1. Universiti Teknologi PETRONAS, Tronoh, Perak, Malaysia

    Mohd Hilmi Hasan, Jafreezal Jaafar & Mohd Fadzil Hassan

Authors
  1. Mohd Hilmi Hasan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jafreezal Jaafar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohd Fadzil Hassan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohd Hilmi Hasan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hasan, M.H., Jaafar, J. & Hassan, M.F. Monitoring web services’ quality of service: a literature review. Artif Intell Rev 42, 835–850 (2014). https://doi.org/10.1007/s10462-012-9358-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-012-9358-7

Keywords

Search

Navigation