Skip to main content
SpringerLink
Log in

Evaluation of Structured Collaborative Tagging for Web Service Matchmaking

  • Chapter
  • First Online:
Book cover Semantic Web Services

Abstract

Turning Web services into Semantic Web Services (SWS) can be prohibitively expensive for large repositories. In such cases collecting community descriptions in forms of structured tags can be a more affordable approach to describe Web services. However, little is understood about how tagging impacts performance of retrieval. There are neither real structured tagging systems for Web services, nor real corpora of structured tags. To start addressing these issues, in our approach, we motivated taggers to tag services in a partially controlled environment. Specifically, taggers were given application requirements and asked to find and tag services that match the requirements. Tags collected in this way were used for Web service matchmaking and evaluated within the framework of the Cross-Evaluation Track of the Third Semantic Service Selection 2009 contest. As part of the lessons learned, we explain relations between description schema (SWS, tags, flat document) and matchmaking heuristics, and performance of retrieval in different search scenarios. We also analyze reliability of tagging system performance as related to taggers/searchers autonomy. Finally, we identify threats to results credibility stemming from partial control of the tags collection process.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See also online registries, e.g., http://www.SeekDa.com, http://www.ProgrammableWeb.com

  2. 2.

    http://mars.ing.unimo.it/wscolab/new.php

  3. 3.

    It does not need to have interface compatible to the requested one. This corresponds to the binary relevance setting number seven in the contest [19].

  4. 4.

    This motivated us to exclude adaptive approaches, which learn from relation between such feature and relevance judgments, from this analysis.

  5. 5.

    However, this phenomenon might be characteristic for data-centric services, for which behavior is often identified with the data it consumes and returns.

References

  1. J. Bar-Ilan, S. Shoham, A. Idan, Y. Miller, A. Shachak, Structured versus unstructured tagging: a case study. Online Inf. Rev. 32(5), 635–647 (2008)

    Google Scholar 

  2. E. Bouillet, M. Feblowitz, H. Feng, Z. Liu, A. Ranganathan, A. Riabov, A folksonomy-based model of web services for discovery and automatic composition, in IEE SCC, Honolulu, 2008, pp. 389–396

    Google Scholar 

  3. R. Cuel, O. Morozova, M. Rohde, E. Simperl, K. Siorpaes, O. Tokarchuk, T. Wiedenhöfer, F. Yetim, M. Zamarian, Motivation mechanisms for participation in human-driven semantic content creation. Int. J. Knowl. Eng. Data Min. 1(4) 331–349 (2011)

    Google Scholar 

  4. A. Fernández, C. Hayes, N. Loutas, V. Peristeras, A. Polleres, K.A. Tarabanis, Closing the service discovery gap by collaborative tagging and clustering techniques, in SMRR, Karlsruhe, 2008

    Google Scholar 

  5. M. Gawinecki, G. Cabri, M. Paprzycki, M. Ganzha, Structured collaborative tagging: is it practical for web service discovery? in WEBIST, Valencia, 2010

    Google Scholar 

  6. S.A. Golder, B.A. Huberman, Usage patterns of collaborative tagging systems. J. Inf. Sci. 32(2), 198–208 (2006)

    Google Scholar 

  7. A. Heß, N. Kushmerick, Learning to attach semantic metadata to web services, in ISWC, Sanibel, 2003, pp. 258–273

    Google Scholar 

  8. K. Järvelin, J. Kekäläinen, Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst. 20(4), 422–446 (2002)

    Google Scholar 

  9. G. Koutrika, E. Frans, Z. Gyongyi, P. Heymann, H. Garcia-Molina, Combating spam in tagging systems: an evaluation. ACM Trans. Web (TWEB) 2(4), 1–34 (2007)

    Google Scholar 

  10. U. Küster, Jena Geography Dataset (2009), http://fusion.cs.uni-jena.de/professur/jgd, last accessed May 2012

  11. U. Küster, B. König-Ries, Relevance judgments for web services retrieval – a methodology and test collection for SWS discovery evaluation, in ECOWS, Eindhoven, 2009

    Google Scholar 

  12. C. Marlow, M. Naaman, D. Boyd, M. Davis, HT06, tagging paper, taxonomy, Flickr, academic article, to read, in HYPERTEXT, Odense, Denmark, 2006, pp. 31–40

    Google Scholar 

  13. H. Meyer, M. Weske, Light-weight semantic service annotations through tagging, in ICSOC. LNCS, vol. 4294, Chicago, 2006, pp. 465–470

    Google Scholar 

  14. H. Mili, F. Mili, A. Mili, Reusing software: issues and research directions. IEEE Trans. Softw. Eng. 21(6), 528–562 (1995)

    Google Scholar 

  15. A. Mili, R. Mili, R.T. Mittermeir, A survey of software reuse libraries. Ann. Softw. Eng. 5, 349–414 (1998)

    Google Scholar 

  16. M. Montaner, B. López, J. De La Rosa, A taxonomy of recommender agents on the internet. Artif. Intell. Rev. 19(4), 285–330 (2003)

    Google Scholar 

  17. I. Peters, K. Weller, Tag gardening for folksonomy enrichment and maintenance. Webology 5(3), 1–18 (2008)

    Google Scholar 

  18. V. Robu, H. Halpin, H. Shepherd, Emergence of consensus and shared vocabularies in collaborative tagging systems. ACM Trans. Web 3(4), 1–34 (2009)

    Google Scholar 

  19. Semantic Service Selection Contest (2009), http://www-ags.dfki.uni-sb.de/~klusch/s3/index.html, last accessed May 2012

  20. M. Sabou, C. Wroe, C.A. Goble, G. Mishne, Learning domain ontologies for web service descriptions: an experiment in bioinformatics, in WWW, Chiba, Japan, 2005, pp. 190–198

    Google Scholar 

  21. S. Sen, S.K. Lam, Al.M. Rashid, D. Cosley, D. Frankowski, J. Osterhouse, F.M. Harper, J. Riedl, Tagging, communities, vocabulary, evolution, in CSCW, Banff, 2006, pp. 181–190

    Google Scholar 

  22. C. Shirky, Ontology is overrated: categories, links, and tags (2005), http://www.shirky.com/writings/ontology_overrated.html, last accessed May 2012

  23. I. Silva-Lepe, R. Subramanian, I. Rouvellou, T. Mikalsen, J. Diament, A. Iyengar, SOAlive service catalog: a simplified approach to describing, discovering and composing situational enterprise services, in ICSOC, Sydney, 2008

    Google Scholar 

  24. K. Siorpaes, M. Hepp, Games with a purpose for the semantic web. IEEE Intell. Syst. 23, 50–60 (2008)

    Google Scholar 

  25. K. Siorpaes, E. Simperl, Human intelligence in the process of semantic content creation. World Wide Web 13(1–2), 33–59 (2010)

    Google Scholar 

  26. I. Sommerville, Software Engineering. International Computer Science Series, 8th edn. (Addison–Wesley, Harlow, 2007)

    Google Scholar 

  27. T.A. Vanderlei, F.A. Durão, A.C. Martins, V.C. Garcia, E.S. Almeida, S.R. de L. Meira, A cooperative classification mechanism for search and retrieval software components, in ACM SAC, Seoul, 2007, pp. 866–871

    Google Scholar 

  28. L. von Ahn, L. Dabbish, Designing games with a purpose. Commun. ACM 51, 58–67 (2008)

    Google Scholar 

  29. J. Zobel, A. Moffat, Inverted files for text search engines. ACM Comput. Surv. 38(2), 6 (2006)

    Google Scholar 

Download references

Acknowledgements

We would like to thank to: Ulrich Küster (for the organization of the Cross-Evaluation track and discussion), Patrick Kapahnke and Matthias Klusch (for their general support and organization of the S3 contest), and to Elton Domnori and anonymous reviewers for valuable comments. Finally, we would like to thank voluntary taggers and searchers for their time.

Author information

Authors and Affiliations

  1. Department of Information Engineering, University of Modena and Reggio Emilia, Modena, Italy

    Maciej Gawinecki & Giacomo Cabri

  2. Warsaw School of Management, Warsaw, Poland

    Marcin Paprzycki

  3. Systems Research Institute, Polish Academy of Sciences, Warsaw, Poland

    Marcin Paprzycki & Maria Ganzha

  4. Institute of Informatics, University of Gdańsk, Gdańsk, Poland

    Maria Ganzha

Authors
  1. Maciej Gawinecki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Giacomo Cabri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marcin Paprzycki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maria Ganzha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maciej Gawinecki .

Editor information

Editors and Affiliations

  1. University of Miami, 1252 Memorial Drive, Ashe Building 325C, Coral Gables, 33124-4628, Florida, USA

    Brian Blake

  2. , Knowledge Media Institute - KMI, The Open University, Walton Hall, Milton Keynes, MK76AA, United Kingdom

    Liliana Cabral

  3. Fak. Mathematik und Informatik, Inst. Informatik, Universität Jena, Ernst-Abbe-Str. 2, Jena, 07743, Thüringen, Germany

    Birgitta König-Ries

  4. University of Jena, Jena, 07743, Germany

    Ulrich Küster

  5. SRI International, Ravenswood Ave. 333, MENLO PARK, 94025-3493, California, USA

    David Martin

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Gawinecki, M., Cabri, G., Paprzycki, M., Ganzha, M. (2012). Evaluation of Structured Collaborative Tagging for Web Service Matchmaking. In: Blake, B., Cabral, L., König-Ries, B., Küster, U., Martin, D. (eds) Semantic Web Services. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28735-0_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28735-0_11

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28734-3

  • Online ISBN: 978-3-642-28735-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation