Skip to main content
SpringerLink
Log in

Rater Credibility Assessment in Web Services Interactions

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

We investigate the problem of establishing trust in service-oriented environments. The focus is on providing an infrastructure for evaluating the credibility of raters in a reputation-based framework that would enable trust-based Web services interactions. The techniques we develop aid a service consumer in assigning an appropriate weight to the testimonies of different raters regarding a prospective service provider. The experimental analysis show that the proposed techniques successfully dilute the effects of malicious ratings, thereby facilitating accurate and fair assessment of the providers’ reputations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aberer, K., Despotovic, Z.: Managing trust in a peer-2-peer information system. In: CIKM, pp. 310–317, Atlanta, 5–10 November 2001

  2. Aberer, K., Despotovic, Z.: On reputation in game theory—application to online settings. Working Paper (2004)

  3. Al-Masri, E., Mahmoud, Q.H.: Discovering the best web service. In: 16th International Conference on World Wide Web (WWW), pp. 1257–1258, Banff, 8–12 May 2007

  4. Azzedin, F., Maheswaran, M.: Evolving and managing trust in grid cmputing systems. In: Proc. of the IEEE Canadian Conference on Electrical and Computer Engineering, pp. 1424–1429, Winnipeg, May 2002

  5. Benatallah, B., Skogsrud, H., Casati, F.: Trust-Serv: a lightweight trust negotiation service. In: VLDB Demo, Toronto, August 2004

  6. Bertino, E., Ferrari, E., Squicciarini, A.C.: Trust-X: a peer-to-peer framework for trust establishment. IEEE Trans. Knowl. Data Eng. 16(7), 827–842 (2004)

    Article  Google Scholar 

  7. Buchegger, S., Le Boudec, J.-Y.: Performance analysis of the CONFIDANT protocol. In: Proc. of the 3rd ACM Intl. Symposium on Mobile Ad Hoc Networking and Computing, pp. 226–236, Lausanne, June 9–11 2002

  8. Bouguettaya, A., Ouzzani, M., Medjahed, B., Cameron, J.: Managing government databases. Computer 34(2), 56–64 (2001), February

    Article  Google Scholar 

  9. Buchegger, S., Le Boudec, J.-Y.: A robust reputation system for p2p and mobile ad-hoc networks. In: Proceedings of the Second Workshop on the Economics of Peer-to-Peer Systems (2004)

  10. Buskens, V.: Social networks and the effect of reputation on cooperation. In: Proc. of the 6th Intl. Conf. on Social Dilemmas (1998)

  11. Casati, F., Shan, E., Dayal, U., Shan, M.-C.: Business-oriented management of web services. Commun. ACM 46(10), 55–60 (2003)

    Article  Google Scholar 

  12. Damiani, E., De Capitani di Vimercati, S., Paraboschi, S., Samarati, P., Violante, F.: A reputation-based approach for choosing reliable resources in peer-to-peer networks. In: ACM Conference on Computer and Communications Security, pp. 207–216, Washingtion, DC, 18–22 November 2002

  13. Dellarocas, C.: Immunizing online reputation reporting systems against unfair ratings and discriminatory behavior. In: 2nd ACM Conference on Electronic Commerce, Minneapolis, 17–20 October 2000

  14. Dellarocas, C.: The digitalization of word-of-mouth: promise and challeges of online feedback mechanisms. Manage. Sci. 49, 1407–1424 (2003)

    Article  Google Scholar 

  15. Dewan, P., Dasgupta, P.: Pride: peer-to-peer reputation infrastructure for decentralized environments. In: WWW (Alternate Track Papers & Posters), pp. 480–481, New York, 17–20 May 2004

  16. Emekci, F., Sahin, O.D., Agrawal, D., El-Abbadi, A.: A peer-to-peer framework for web service discovery with ranking. In: Intl. Conf. on Web Services (ICWS), San Diego, 6–9 June 2004

  17. Falker, J., Kuchar, J.: Analytical and empirical analysis of restricting airspace. In: 4th. USA/Europe Air Traffic Management R&D Seminar, Santa Fe, December 2001

  18. Finin, T.W., Joshi, A.: Agents, trust, and information access on the semantic web. ACM SIGMOD Record 31(4), 30–35 (2002)

    Article  Google Scholar 

  19. Giuliano, G.: ARGOS: dynamic composition of web services for goods movement analysis and planning. Technical report, Univ. of Southern California (2003)

  20. Houser, D., Wooders, J.: Reputation in auctions: theory, and evidence from eBay. J. Econ. Manage. Strategy 15, 353–369 (2005)

    Article  Google Scholar 

  21. Huberman, B.A., Wu, F.: The Dynamics of Reputations. TR, Hewlett-Packard Laboratories and Stanford University, January (2003)

  22. Huynh, T.D., Jennings, N.R., Shadbolt, N.R.: Certified reputation: how an agent can trust a stranger. In: AAMAS ’06: Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems, pp. 1217–1224. ACM, New York (2006)

    Chapter  Google Scholar 

  23. IBM.: Aglet software development kit. http://www.trl.ibm.com/aglets (2000)

  24. Jurca, R., Faltings, B.: An incentive compatible reputation mechanism. In: Proc. of the 2003 IEEE Intl. Conf. on E-Commerce, pp. 285–292, Newport Beach, June 2003

  25. Kamvar, S.D., Schlosser, M.T., Garcia-Molina, H.: The eigentrust algorithm for reputation management in p2p networks. In: Proceedings of the Twelfth International World Wide Web Conference (WWW), Budapest, 20–24 May 2003

  26. Karr, A.F., Sanil, A.P., Banks, D.L.: Data quality: a statistical perspective. Stat. Methodol. 3(2), 137–173 (2006), April

    Article  MathSciNet  Google Scholar 

  27. Kesler, C.: Experimental games for the design of reputation management systems. IBM Syst. J. 42(3), (2003)

  28. Lam, S.K., Riedl, J.: Shilling recommender systems for fun and profit. In: Proc. of the 13th International World Wide Web Conference (WWW), p. 393–402, New York, 17–22 May 2004

  29. Li, Z., Wang, S.: The foundation of e-commerce: social reputation system–a comparison between american and china. In: ICEC ’05: Proceedings of the 7th International Conference on Electronic Commerce, pp. 230–232. ACM, New York (2005)

    Chapter  Google Scholar 

  30. Liu, Y., Yang, Y.R.: Reputation propagation and agreement in mobile ad-hoc networks. In: Proc. of the IEEE Wireless Communication and Networks Conference (WCNC) 2003, New Orleans, March 2003

  31. MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: Proceedings of 5-th Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297. University of California Press, Berkeley (1967)

    Google Scholar 

  32. Majithia, S., Ali, A.S., Rana, O.F., Walker, D.W.: Reputation-based semantic service discovery. In: Proc. of the 13th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises (WETICE), pp. 297–302, Modena, 14–16 June 2004

  33. Malaga, R.: Web-based reputation management systems: problems and suggested solutions. Electronic Commerce Res. 1(1), 403–417 (2001)

    Article  MATH  Google Scholar 

  34. Malik, Z., Bouguettaya, A.: RATEWeb: reputation assessment for trust establishment among web services. VLDB J. (2008, in press)

  35. Maximilien, E.M., Singh, M.P.: Reputation and endorsement for web services. SIGecom Exchanges, 3(1), 24–31 (2002), December

    Article  Google Scholar 

  36. Maximilien, E.M., Singh, M.P.: A framework and ontology for dynamic web services selection. IEEE Internet Comput. 8(5), 84–93 (2004), September–October

    Article  Google Scholar 

  37. Maximilien, E.M., Singh, M.P.: Toward autonomic web services trust and selection. In: ICSOC 2004: Proceedings of 2nd International Conference on Service Oriented Computing, New York, November 2004

  38. Maximilien, E.M., Singh, M.P.: Agent-based trust model involving multiple qualities. In: AAMAS 2005: Proceedings of 4th International Autonomous Agents and Multi Agent Systems, Utrecht, July 2005

  39. Maximillien, E.M., Singh, M.P.: Conceptual model of web service reputation. SIGMOD Record, 31(4), 36–41 (2002), December

    Article  Google Scholar 

  40. Medjahed, B., Bouguettaya, A.: Customized delivery of e-government web services. IEEE Intel. Syst. 20(6) (2005), November/December

  41. Medjahed, B., Bouguettaya, A., Elmagarmid, A.: Composing web services on the semantic web. VLDB J. 12(4) (2003), November

  42. Medjahed, B., Rezgui, A., Bouguettaya, A., Ouzzani, M.: Infrastructure for E-Government web services. IEEE Internet Comput. 7(1) (2003), January/February

  43. Microsoft and Vodafone: Mobile web services technical roadmap. Technical report, Microsoft Corporation and Vodafone Group Services Ltd. (2003)

  44. Page, L., Brin, S., Motwani, R., Winograd, T.: The PageRank citation ranking: bringing order to the web. Technical report, Stanford Digital Library Technologies Project (1998)

  45. Papazoglou, M.P.: Web services and business transactions. World Wide Web: Internet and Web Inf. Syst. 6(1), 49–91 (2003), March

    Article  Google Scholar 

  46. Papazoglou, M.P., Georgakopoulos, D.: Serive-oriented computing. Commun. ACM 46(10), 25–65 (2003)

    Article  Google Scholar 

  47. Ran, S.: A model for web services discovery with qos. SIGecom Exch. 4(1), 1–10 (2003)

    Article  Google Scholar 

  48. Resnick, P., Zeckhauser, R.: Trust among strangers in internet transactions: empirical analysis of eBay’s reputation system. Advances in Applied Microeconomics, vol. 11. Elsevier, Amsterdam (2002)

    Google Scholar 

  49. Resnick, P., Zeckhauser, R., Friedman, E., Kuwabara, K.: Reputation systems. Commun. ACM 43(12) (2000), December

  50. Rocha, B.G., Almeida, V., Guedes, D.: Increasing qos in selfish overlay networks. IEEE Internet Comput. 10(3), 24–31 (2006), May–June

    Article  Google Scholar 

  51. Sabater, J., Sierra, C.: Reputation and social network analysis in multi-agent systems. In: Proc. of the first Intl. Joint Conf. on Autonomous Agents and Multiagent Systems, pp. 475–482, Bologna, 14–18 July 2003

  52. Simunic, D.A.: Theory is Too Important to be Left to the Theorists. Canadian Academic Accounting Association, Mississauga (2008)

    Google Scholar 

  53. Sonnek, J.D., Weissman, J.B.: A quantitative comparison of reputation systems in the grid. In: The 6th IEEE/ACM International Workshop on Grid Computing, pp. 242–249, Seattle, November 2005

  54. Sundaresan, N.: Online trust and reputation systems. In: EC ’07: Proceedings of the 8th ACM Conference on Electronic Commerce, pp. 366–367. ACM, New York (2007)

    Chapter  Google Scholar 

  55. Taiani, F., Hiltunen, M., Schlichting, R.: The impact of web service integration on grid performance. In: HPDC-14: Proceedings of the 14th IEEE International Symposium on High Performance Distributed Computing, vol. 14, pp. 24–27. IEEE, Piscataway (2005)

    Google Scholar 

  56. Tian, M., Gramm, A., Ritter, H., Schiller, J.: Efficient selection and monitoring of qos-aware web services with the ws-qos framework. In: International Conference on Web Intelligence, pp. 152–158. IEEE Computer Society, Washington, DC (2004)

    Chapter  Google Scholar 

  57. Udupi, Y.B., Singh, M.P.: Information sharing among autonomous agents in referral networks systems. In: 6th International Workshop on Agents and Peer-to-Peer Computing, Honolulu, May 2007

  58. Vu, L.-H., Hauswirth, M., Aberer, K.: QoS-based service selection and ranking with trust and reputation management. In: 13th International Conference on Cooperative Information Systems (CoopIS 2005), Agia Napa, 31 October–4 November 2005

  59. Walsh, K., Sirer, E.G.: Fighting peer-to-peer spam and decoys with object reputation. In: P2PECON ’05: Proceedings of the 2005 ACM SIGCOMM Workshop on Economics of Peer-to-Peer Systems, pp. 138–143. ACM, New York (2005)

    Chapter  Google Scholar 

  60. Wang, Y., Vassileva, J.: Trust and reputation model in peer-to-peer networks. In: Proc. of the Third International Conference on Peer-to-Peer Computing, pp. 150–158, Linköping, September 2003

  61. Weng, J., Miao, C., Goh, A.: Protecting online rating systems from unfair ratings. Trust Priv. Secur. Digit. Bus. 3592, 50–59 (2005), August

    Google Scholar 

  62. Whitby, A., Jsang, A., Indulska, J.: Filtering out unfair ratings in bayesian reputation systems. Icfain J. Manage. Res. 4(2), 48–64 (2005), February

    Google Scholar 

  63. Wickramage, N., Weerawarana, S.: A benchmark for web service frameworks. In: SCC ’05: Proceedings of the 2005 IEEE International Conference on Services Computing, pp. 233–242. IEEE Computer Society, Washington, DC (2005)

    Chapter  Google Scholar 

  64. W3C WS-Policy: Web services policy framework. http://www.ibm.com/developerworks/library/ws-polfram (2007)

  65. Xiong, L., Liu, L.: PeerTrust: supporting reputation-based trust for peer-to-peer electronic communities. IEEE Trans. Knowl. Data Eng. (TKDE) 16(7), 843–857 (2004), July

    Article  Google Scholar 

  66. Yang, X., Bouguettaya, A., Medjahed, B., Long, H., He, W.: Organizing and accessing web services on air. IEEE Trans. Syst. Man Cybern. Part A Syst. Humans, 33(6) (2003), November

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Virginia Tech, Blacksburg, VA, 24061, USA

    Zaki Malik

  2. CSIRO ICT Center, Canberra, Australia

    Athman Bouguettaya

Authors
  1. Zaki Malik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Athman Bouguettaya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zaki Malik.

Additional information

This work is supported by the National Science Foundation grant number 0627469.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Malik, Z., Bouguettaya, A. Rater Credibility Assessment in Web Services Interactions. World Wide Web 12, 3–25 (2009). https://doi.org/10.1007/s11280-008-0056-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-008-0056-y

Keywords

Search

Navigation