Skip to main content
SpringerLink
Log in

A trust-based P2P resource search method integrating with Q-learning for future Internet

  • Published:
Peer-to-Peer Networking and Applications Aims and scope Submit manuscript

Abstract

Since Peer-to-Peer technology plays a vital role in the future Internet, such as the P2P video service Voddler, music service Spotify and Symform are designed for cloud storage aroused users’ high interest. The P2P system has been attracting more and more attention on resource location and service discovery. To find the desired resources and achieve file sharing more effectively and smoothly, we propose a novel P2P search method integrating trust mechanism with Q-learning method (SMITQ) for future Internet in this paper. Q-learning, which is one of the most important reinforcement learning models with the self-adaption and feedback learning mechanism, facilitates P2P searching efficiency and would be widely used in routing-aware for future Internet. By introducing node trust mechanism, we construct neighbor nodes evaluation matrix to calculate the integrated information entropy of trust values and Q-values. The neighbor node with maximum integrated information entropy is selected as next hop to forward query message, which can avoid searching process with low efficiency due to the lack of information in Q table at initial search stage. The SMITQ method can speed up Q-learning process and provide an efficient method to select the neighbor node with the query resource. Simulation results indicate that the proposed method can obtain the highest success rate with the fewest duplicated messages as well as the shortest response time comparing with the Q-learning method and random walk method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Yunjie L (2010) Development of network convergence and future internet. J Chongqing Univ Posts Telecommun Nat Sci Ed 22(6):693–697

    Google Scholar 

  2. Tang H, Zhang Y, Zhao G (2013) Survey on services-oriented networking in future internet. J Chongqing Univ Posts Telecommun Nat Sci Ed 25(1):44–51

    Google Scholar 

  3. Fouda MM, Fadlullah ZM, Guizani M et al (2012) A novel P2P VoD streaming technique integrating localization and congestion awareness strategies. Mob Netw Appl 17(5):594–603

    Article  Google Scholar 

  4. Yue Z, Wang J (2012) Calculation method of P2P reputation based on recommendation. International Conference on Intelligent Control and Information Processing, pp. 245–247

  5. Mandal U, Habib MF, Zhang S et al (2014) Adopting hybrid CDN–P2P in IP-over-WDM networks: an energy-efficiency perspective. J Opt Commun Netw 6(3):303–314

    Article  Google Scholar 

  6. Aurelius A, Lagerstedt C, Kihl M (2011) Streaming media over the Internet: flow based analysis in live access networks. Broadband Multimedia Systems and Broadcasting (BMSB), 2011 I.E. International Symposium on. IEEE, June 2011, pp. 1–6

  7. Li J-Q, Xie S-X et al. (2010) An effective trust-based search approach in peer-to-peer network. International Conference on Machine Vision and Human-machine Interface, April 2010, pp. 206–209

  8. Liu Y, Li Y et al. (2010) The resource locating strategy based on sub-domain hybrid P2P network model. International. Symposium on Parallel & Distributed Processing, Workshops and Phd Forum, April, 2010, pp. 1–8

  9. Wang Y, Huang X, Lu Q (2011) Small-world-like semi-structured P2P network. International Conference on Computer Research and Development, March 2011, pp. 246–251

  10. Lee G, Peng SL, Chen YC et al (2012) An efficient search mechanism for supporting partial filename queries in structured peer-to-peer overlay. Peer-to-Peer Network Appl 5(4):340–349

    Article  Google Scholar 

  11. Lei Y, Hao Y et al. (2010) An adaptive search method based on the interest in gnutella-like network. International Conference on Computer Application and System Modeling, Oct. 2010, pp. 302–306

  12. Zhang Y, Guo S et al. (2011) An efficient unstructured P2P network search algorithm based on multi-information. International Conference on Instrumentation, Measurement, Computer, Communication and Control, Oct. 2011, pp. 241–244

  13. Rasanjalee Himali DM, Prasad SK (2011) A P2P probabilistic search algorithm based on successful paths in unstructured networks. International Symposium on Parallel and Distributed Processing Workshops and Phd Forum, May 2011, pp. 1610–1617

  14. Margariti SV, Dimakopoulos VV (2011) A novel probabilistic flooding strategy for unstructured peer-to-peer networks. Panhellenic Conference on Informatics, Sept. 2011, pp. 149–153

  15. Han H, He J, Zuo C (2010) A hybrid P2P overlay network for high efficient search, International Conference on Information and Financial Engineering, Sept, 2010, pp. 241–245

  16. Zeng J, Zheng G (2012) Interest based on small world of P2P. International Conference on Cognitive Informatics & Cognitive Computing, Aug. 2012, pp. 391–398

  17. Thampi SM, Chandra Sekaran K (2008) An effective distributed search technique for unstructured peer-to-peer networks. International Journal of Computer Science and Network Security, January 2008, pp. 128–135

  18. Liu H, Chen G, Wu S (2013) Improved resource search strategy using Q-learning based on node reputation for P2P network. J Chongqing Univ Posts Telecommun Nat Sci Ed 25(6):801–806

    Google Scholar 

  19. Farahnakian F, Ebrahimi M et al. (2011) Q-learning based Congestion-aware Routing Algorithm for On-Chip Network. International Conference on Networked Embedded Systems, December 2011, pp. 1–7

  20. Li X, Wu J (2006) Improve searching by reinforcement learning in unstructured P2Ps. International Conference on Distributed Computing Systems Workshops, July 2006, pp. 1–6

  21. Jiang X, Ye L (2010) Attack-resistant techniques in P2P reputation systems. 2nd International Conference on Networking and Digital Society, May 2010, pp. 390–393

  22. Mashayekhi H et al. (2008) TBSearch: trust based search for unstructured peer-to-peer networks. Fourth International Conference on Semantics, Knowledge and Grid, Dec. 2008, pp. 227–234

  23. Dai X, Zhu C, Guo Y (2012) P2P dynamic trust management system based on trust network. International Conference on Cyber Security, Cyber Warfare and Digital Forensic, June 2012, pp. 165–170

  24. Zhu Y, Hu R (2010) Adaptive routing for P2P networks using reinforcement learning. International Conference on Computer Science and Information Technology, July 2010, pp. 37–41

  25. Jamali MAJ, Sani Y (2011) Adaptive peer to peer resource discovery in grid computing based on reinforcement learning. ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, July 2011, pp. 191–196

  26. Thampi SM, Chandra Sekaran K (2007) Autonomous data replication using q-learning for unstructured P2P networks. Sixth IEEE International Symposium on Network Computing and Applications, July 2007, pp. 311–317

  27. Du M, Wang X (2012) P2P trust model of dynamic optimization for group competition based on entropy method. Comput Eng Appl 48(17):123–128

    Google Scholar 

  28. Wang Z, Yu Y (2011) Information entropy method for project portfolio selection. Eighth International Conference on Fuzzy Systems and Knowledge Discovery, July 2011, pp. 2618–2622

  29. Zhao B et al. (2011) Research on application of customer satisfaction index model -view_based on PLS and information entropy-weight method. International Conference on E-Business and E–Government, May 2011, pp. 1–4

  30. Wang Q, Zhan Z (2011) Reinforcement learning model, algorithms and its application. International Conference on Mechatronic Science, Electric Engineering and Computer, August, 2011, pp. 1143–1146

  31. Liu JP (2012) The research of resource searching algorithm in mobile P2P network. International Conference on Computational and Information Sciences, Aug. 2012, pp. 811–814

  32. Donohoo BK, Ohlsen C, Pasricha S (2011) AURA: an application and user interaction aware middleware framework for energy optimization in mobile devices. 2011 I.E. 29th International Conference on Computer Design (ICCD). October 2011, pp. 168–174

  33. Hawa M et al (2013) On enhancing reputation management using Peer-to-Peer interaction history. Peer-to-Peer Netw Appl 6(1):101–113

    Article  Google Scholar 

  34. Portmann M, Sookavatana P (2001) The cost of peer discovery and searching in the gnutella peer-to-peer file sharing protocol. International conference on Networks Proceedings, October 2001, pp. 263–268

Download references

Acknowledgments

This research was funded by the national nature science foundation of China (NSFC 61275077, 61371096), by the 973 national program on key basic research project of China (2012CB315803), and by the basic and frontier research program of Chongqing (CSTC 2013jcyjA40052).

Author information

Authors and Affiliations

  1. Key Laboratory of Industrial Internet of Things & Network Control, Chongqing University of Posts and Telecommunications, Chongwei Road #2, Nan’an District, Chongqing, 400065, China

    Yong Chen

  2. School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China

    Huan-lin Liu, Gao-xiang Chen & Qian-bin Chen

Authors
  1. Huan-lin Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gao-xiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Qian-bin Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yong Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, Hl., Chen, Gx., Chen, Y. et al. A trust-based P2P resource search method integrating with Q-learning for future Internet. Peer-to-Peer Netw. Appl. 8, 532–542 (2015). https://doi.org/10.1007/s12083-014-0279-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12083-014-0279-x

Keywords

Search

Navigation