Abstract
The ability to gauge quality of service is critical if we are to realise the potential of the service-oriented computing paradigm. Many techniques have been proposed for calculating the quality of a service, and they do so typically by collecting quality ratings from the users of the service, then combining them in one way or another to derive the quality of the service. We argue that collecting quality ratings alone from the users is not sufficient for deriving a reliable and accurate quality measure for a service. This is because different users often have different expectations on the quality of a service and their ratings tend to be closely related to these expectations, i.e. how their expectations are met. In this paper, we propose a quality of service assessment model based on user expectations. That is, we collect expectations as well as ratings from the users of a service, then calculate the quality of the service using only the ratings that have similar expectations. Our experiments show that the method we propose here can result in more meaningful and reliable quality ratings for services.
Similar content being viewed by others
References
Casati, F., Shan, M.C.: Definition, execution, analysis, and optimization of composite e-services. Data Eng. Bull. 4(1), 29–34 (2001)
Leymann, F.: Web services: distributed applications without limits. In: Proceedings of the 10th Conference on Database Systems for Business, Technology, and the Web, pp. 2–23. Leipzig, Germany (2003)
Piccinelli, G., Stammers, E.: From e-processes to e-networks: an e-service-oriented approach. In: Proceedings of the 3rd International Conference on Internet Computing, pp. 549–553. Las Vegas, Nevada, USA (2002)
Rust, R.T., Kannan, P.K.: E-service: a new paradigm for business in the electronic environment. Commun. ACM 46(6), 36–42 (2003)
He, M., Jennings, N.R., Leung, H.: On agent-mediated electronic commerce. IEEE. Trans. Knowledge Data Eng. 15(4), 985–1003 (2003)
Jennings, N.R., Faratin, P., Norman, T.J., O'Brien, P., Odgers, B.: Autonomous agents for business process management. Int. J. Appl. Artif. Intell. 14(2), 145–189 (2000)
Papazoglou, M.P.: Agent-oriented technology in support of e-business. Commun. ACM 44(4), 71–77 (2001)
Norman, T.J., Preece, A., Chalmers, S., Jennings, N.R., Luck, M., Dang, V.D., Nguyen, T.D., Deora, V., Shao, J., Gray, W.A., Fiddian, N.J.: Agent-based formation of virtual organisations. Knowledge Based Syst. 17(2–4), 103–111 (2004)
Petersen, S.A., Gruninger, M.: An agent-based model to support the formation of virtual enterprises. In: Proceedings of the International ICSC Symposium on Mobile Agents and Multi-Agents in Virtual Organisations and E-Commerce. Woolongong, Australia (2000)
Aurrecoechea, C., Campbell, A.T., Hauw, L.: A survey of QoS architectures. Multisyst. J. 6(3), 138–151 (1998)
Chalmers, D., Sloman, M.: A survey of quality of service in mobile computing environments. IEEE Commun. Surv. Tutorials 2(2), 2–10 (1999)
Lee, Y.W., Strong, D.M., Khan, B.K., Wang, R.Y.: AIMQ: a methodology for information quality assessment. Inform. Manage. 40, 133–146 (2002)
Parasuraman, A., Zeithaml, V.A., Berry, L.L.: Reassessment of expectations as a comparison standard in measuring service quality: implications for future research. J. Market. 58, 201–230 (1994)
Trzec, K., Huljenic, D.: Intelligent agents for QoS management. In: Proceedings of the 1st International Conference on Autonomous Agents and Multiagent Systems, pp. 1405–1412. Bologna, Italy (2002)
Yu, B., Singh, M.: An evidential model of distributed reputation management. In: Proceedings of the First International Conference on Autonomous Agents and Multiagent Systems, pp. 294–301. Bologna, Italy (2002)
Zeng, L., Benatallah, B., Dumas, M., Kalagnanam, J.: Quality driven web service composition. In: Proceedings of the 12th International Conference on World Wide Web, pp. 411–421. Budapest, Hungary (2003)
Mui, L., Mohtashemi, M., Halberstadt, A.: A computational model of trust and reputation. In: Proceedings of the 35th Hawaii International Conference on System Sciences, pp. 2423–2431. Big Island, Hawaii, USA (2002)
Maes, P., Guttman, R.H., Moukas, A.G.: Agents that buy and sell. Commun. ACM 42(3), 81–91 (1999)
Schillo, M., Funk, P., Rovatsos, M.: Using trust for detecting deceitful agents in artificial societies. Appl. Artif. Intell. 14(8) 825–848 (2000)
Maximilien, E.M., Singh, M.: Conceptual model of web service reputation. ACM SIGMOD Record. 31(4), 36–41 (2002)
Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: Grouplens: an open architecture for collaborative filtering of netnews. In: Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, pp. 175–186. ACM Press, Chapel Hill, NC, USA (1994)
Mecella, M., Scannapieco, M., Virgillito, A., Baldoni, R., Catarci, T., Batini, C.: Managing data quality in cooperative information systems. In: Proceedings of the 10th International Conference on Cooperative Information Systems, pp. 486–502. Irvine, California, USA (2002)
Burgess, M., Gray, W.A., Fiddian, N.J.: Establishing a taxonomy of quality for use in information filtering. In: Proceedings of the 19th British National Conference Databases, pp. 103–113. Sheffield, UK (2002)
Wang, R.Y., Strong, D.M. Beyond accuracy: what data quality means to data consumers. J. Manage. Inform. Syst. 12(4), 5–34 (1996)
Juran, J.M.: Quality Control Handbook, Bologna, Italy (1974)
Tuchman, B.W.: The decline of quality. New York Times Mag. 2, 38–41 (1980)
Braynov, S., Sandholm, T.: Incentive compatible mechanism for trust revelation. In: Proceedings of the 1st International Conference on Autonomous Agents and Multi-Agent Systems, pp. 310–311 (2002)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Deora, V., Shao, J., Gray, W.A. et al. Expectation-based quality of service assessment. Int J Digit Libr 6, 260–269 (2006). https://doi.org/10.1007/s00799-006-0004-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00799-006-0004-3