Skip to main content
SpringerLink
Log in

Finding and evaluating the community structure in semantic peer-to-peer overlay networks

  • Research Papers
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

Abstract

Recently much attention has been paid to semantic overlay networks for information retrieval in large scale peer-to-peer networks, and much research work on semantic overlay protocols and searching algorithms has been done and the results indicate that semantic overlay is efficient for content searching in peer-to-peer networks. However, very limited work has been done to analyze and evaluate the characteristics of semantic overlay networks. In this paper we identify a natural property of semantic overlay networks, the community structure. We propose a mathematical model to evaluate the property of community structure of semantic P2P overlay networks. A heuristic algorithm is designed to optimize the community structure. Using the evaluation model we compare the SemreX semantic overlay with the Gnutella network. Results demonstrate that a SemreX overlay network has the distinctive community structure feature, while a Gnutella-like network does not. We also simulate a simple flooding protocol in both overlays to show that the overlay with community structure is more efficient for content searching.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Shen H T, Shu Y, Yu B. Efficient semantic-based content search in P2P network. IEEE Trans Knowl Data Eng, 2004, 16: 813–826

    Article  Google Scholar 

  2. Stoica I, Morris R, Karger D, et al. Chord: a scalable peer-to-peer lookup service for internet application. In: Proceedings of ACM SIGCOMM’01, San Diego, California, USA, 2001

  3. Ratnasamy S, Francis P, Handley M, et al. A scalable content-addressable network. In: Proceedings of ACM SIGCOMM’ 01, San Diego, California, USA, 2001

  4. Li J, Loo B T, Hellerstein J M, et al. On the feasibility of peer-to-peer web indexing and search. In: Proceedings of IPTPS, Berkeley, CA, USA, 2003

  5. Reynolds P, Vahdat A. Efficient peer-to-peer keyword searching. In: Proceedings of Middleware, Rio de Janeiro, Brazil, 2003

  6. Gnawali O D. A keyword-set search system for peer-to-peer networks. Master’s thesis, Massachusetts Institute of Technology, 2002

  7. Bender M, Michel S, Triantafillou P, et al. P2P content search: give the web back to the people. In: Proceedings of the 5th International Workshop on Peer-to-Peer Systems (IPTPS’06), Santa Barbara, CA, USA, 2006

  8. Gkantsidis C, Mihail M, Saberi A. Random walks in peer-to-peer networks. In: Proceedings of IEEE INFOCOM’04, Hong Kong, China, 2004

  9. Sripanidkulchai K, Maggs B, Zhang H. Efficient content location using interest-based locality in peer-to-peer systems. In: Proceedings of IEEE INFOCOM, San Francisco, California, USA, 2003

  10. Nejdl W, Wolf B, Qu C, et al. Edutella: a peer-to-peer networking infrastructure based on rdf. In: Proceedings of the 11th World Wide Web Conference (WWW’02), Hawaii, USA, 2002

  11. Nejdl W, Wolpers M, Siberski W, et al. Super-peer-based routing and clustering strategies for rdf-based peer-to-peer networks. In: Proceedings of the 12th World Wide Web Conference (WWW’03), Budapest, Hungary, 2003

  12. Haase P, Broekstra J, Ehrig M, et al. Bibster: a semantic-based bibliographic peer-to-peer system. In: Proceedings of the 2004 International Semantic Web Conference (ISWC’04), Hiroshima, Japan, 2004

  13. Li M, Lee W C, Sivasubramaniam A, et al. SSW: A small-world-based overlay for peer-to-peer search. IEEE Trans Paral Distr Syst, 2008, 19: 735–749

    Article  Google Scholar 

  14. Newman M. Modularity and community structure in networks. Proc Nat Acad Sci (PNAS), 2006, 103: 8577–8582

    Article  Google Scholar 

  15. Flake G W, Lawrence S R, Giles C L, et al. Self-organization and identification of web communities. IEEE Comput, 2002, 35: 66–71

    Google Scholar 

  16. Newman M E J. Coauthorship networks and patterns of scientific collaboration. Proc Nat Acad Sci, 2004, 101: 5200–5205

    Article  Google Scholar 

  17. Jin H, Chen H, Ning X M. SemreX: a semantic peer-to-peer system for literature documents retrieval. In: Proceedings of the 1st Asian Semantic Web Conference (ASWC’06), Beijing, China, 2006

  18. Jin H, Chen H. SemreX: efficient search in semantic overlay for literature retrieval. Future Gener Comput Syst, 2008, 24: 475–488

    Article  MathSciNet  Google Scholar 

  19. Ning X M, Jin H, Chen H. Efficient search for peer-to-peer information retrieval using semantic small world. In: Proceedings of the 15th International World Wide Web Conference (WWW’06), Edinburgh Scotland, 2006

  20. ACM Topics. http://www.acm.org/class/1998

  21. Yu Y, Jin H. Building a semantic P2P scientific references sharing system with jxta. In: Proceedings of the Eighth Asia Pacific Web Conference (APWEB’06), Harbin, China, 2006

  22. Yuhua L, Bandar Z A, McLean D. An approach for measuring semantic similarity between words using multiple information sources. IEEE Trans Knowl Data Eng, 2003, 15: 871–882

    Article  Google Scholar 

  23. Iamnitchi A, Ripeanu M, Foster I. Small-world file-sharing communities. In: Proceedings of IEEE INFOCOM’04, Hong Kong, 2004

  24. Clauset A, Newman M E J, Moore C. Finding community structure in very large networks. Phys Rev E, 2004, 70: 0066111

    Article  Google Scholar 

  25. Radicch F, Castellano C, Cecconi F, et al. Defining and identifying communities in networks. Proc Nat Acad Sci (PNAS), 2004, 101: 2658–2663

    Article  Google Scholar 

  26. Zhou D, Manavoglu E, Li J, et al. Probabilistic models for discovering e-communities. In: Proceedings of the 15th international World Wide Web confernece (WWW’06), Edinburgh Scotland, 2006

  27. Barrat A, Barthelemy M, Pastor-Satorras R, et al. The architecture of complex weighted networks. Proc Nat Acad Sci, 2004, 101: 3747–3752

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Services Computing Technology and System Laboratory, Cluster and Grid Computing Laboratory, School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China

    HanHua Chen & Hai Jin

Authors
  1. HanHua Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hai Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hai Jin.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, H., Jin, H. Finding and evaluating the community structure in semantic peer-to-peer overlay networks. Sci. China Inf. Sci. 54, 1340–1351 (2011). https://doi.org/10.1007/s11432-011-4296-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11432-011-4296-6

Keywords

Search

Navigation