skip to main content
10.1145/2188286.2188317acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
research-article

Benchmarking decentralized monitoring mechanisms in peer-to-peer systems

Published:22 April 2012Publication History

ABSTRACT

Decentralized monitoring mechanisms enable obtaining a global view on different attributes and the state of Peer-to-Peer systems. Therefore, such mechanisms are essential for managing and optimizing Peer-to-Peer systems. Nonetheless, when deciding on an appropriate mechanism, system designers are faced with a major challenge. Comparing different existing monitoring mechanisms is complex because evaluation methodologies differ widely. To overcome this challenge and to achieve a fair evaluation and comparison, we present a set of dedicated benchmarks for monitoring mechanisms. These benchmarks evaluate relevant functional and non-functional requirements of monitoring mechanisms using appropriate workloads and metrics. We demonstrate the feasibility and expressiveness of our benchmarks by evaluating and comparing three different monitoring mechanisms and highlighting their performance and overhead.

References

  1. K. Albrecht, R. Arnold, M. Gahwiler, and R. Wattenhofer. Aggregating Information in Peer-to-Peer Systems for Improved Join and Leave. In Proc. of the 4th Internat. Conf. on Peer-to-Peer Computing, pages 227--234, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. M. S. Artigas, P. García, and A. F. G. Skarmeta. DECA: A Hierarchical Framework for DECentralized Aggregation in DHTs. In Large Scale Management of Distributed Systems, volume 4269, pages 246--257. Springer, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. Bawa, H. Garcia-Molina, A. Gionis, and R. Motwani. Estimating Aggregates on a Peer-to-Peer Network. Tech. Rep. 2003-24, Stanford InfoLab, 2003.Google ScholarGoogle Scholar
  4. J. Cappos and J. H. Hartman. San Fermín: Aggregating Large Data Sets Using a Binomial Swap Forest. In Proc. of the 5th USENIX Symposium on Networked Systems Design and Implementation, pages 147--160, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. P. T. Eugster, R. Guerraoui, A.-M. Kermarrec, and L. Massoulié. Epidemic Information Dissemination in Distributed Systems. IEEE Computer, 37(5):60--67, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. K. Graffi. Monitoring and Management of Peer-to-Peer Systems. PhD thesis, Technische Universtiät Darmstadt, 2010.Google ScholarGoogle Scholar
  7. K. Graffi, D. Stingl, J. Rueckert, A. Kovacevic, and R. Steinmetz. Monitoring and Management of Structured Peer-to-Peer Systems. In Proc. of the 9th Internat. Conf. on Peer-to-Peer Computing, pages 311--320, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  8. C. Gross, M. Lehn, C. Münker, A. Buchmann, and R. Steinmetz. Towards a Comparative Performance Evaluation of Overlays for Networked Virtual Environments. In Proc. of the 11th Internat. Conf. on Peer-to-Peer Computing, pages 34--43, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  9. A. Haeberlen, A. Mislove, A. Post, and P. Druschel. Fallacies in Evaluating Decentralized Systems. In Proc. of the 5th Internat. Workshop on Peer-to-Peer Systems, 2006.Google ScholarGoogle Scholar
  10. M. Jelasity, R. Guerraoui, A.-M. Kermarrec, and M. van Steen. The Peer Sampling Service: Experimental Evaluation of Unstructured Gossip-Based Implementations. In Proc. of the 5th ACM/IFIP/USENIX Internat. Conf. on Middleware, pages 79--98, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. Jelasity, A. Montresor, and O. Babaoglu. Gossip-Based Aggregation in Large Dynamic Networks. ACM Transactions on Computer Systems, 23(3):219--252, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. D. Kempe, A. Dobra, and J. Gehrke. Gossip-based computation of aggregate information. In Proc. of the 44th Annual IEEE Symposium on Foundations of Computer Science, pages 482--491, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. A. Kovacevic, K. Graffi, S. Kaune, C. Leng, and R. Steinmetz. Towards Benchmarking of Structured Peer-to-Peer Overlays for Network Virtual Environments. In Proc. of the 14th Internat. Conf. on Parallel and Distributed Systems, pages 799--804, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. M. Lehn, T. Triebel, C. Gross, D. Stingl, K. Saller, W. Effelsberg, A. Kovacevic, and R. Steinmetz. Designing Benchmarks for P2P Systems. In From Active Data Management to Event-Based Systems and More, volume 6462, pages 209--229. Springer, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. J. Li, J. Stribling, R. Morris, M. F. Kaashoek, and T. M. Gil. A Performance vs. Cost Framework for Evaluating DHT Design Tradeoffs Under Churn. In Proc. of the 24th Annual Joint Conf. of the IEEE Computer and Communications Societies, pages 225--236, 2005.Google ScholarGoogle Scholar
  16. S. Madden, M. J. Franklin, J. M. Hellerstein, and W. Hong. Tag: A Tiny AGgregation Service for Ad-hoc Sensor Networks. In ACM SIGOPS Operating Systems Review, volume 36, pages 131--146, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. R. Makhloufi, G. Bonnet, G. Doyen, and D. Gaiti. Decentralized Aggregation Protocols in Peer-to-Peer Networks : A Survey. In Modelling Autonomic Communications Environments, volume 5844, pages 111--116. Springer, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. M. L. Massie, B. N. Chun, and D. E. Culler. The Ganglia Distributed Monitoring System: Design, Implementation, and Experience. Parallel Computing, 30(7):817--840, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  19. S. Rhea, T. Roscoe, and J. Kubiatowicz. Structured Peer-to-Peer Overlays Need Application-Driven Benchmarks. In Peer-to-Peer Systems II, pages 56--67. Springer, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  20. K. Saller, D. Stingl, and A. Schürr. D4M, a Self-Adapting Decentralized Derived Data Collection and Monitoring Framework. In Workshops der wissenschaftlichen Konferenz Kommunikation in Verteilten Systemen, pages 245--256, 2011.Google ScholarGoogle Scholar
  21. D. Stingl, C. Gross, J. Rückert, L. Nobach, A. Kovacevic, and R. Steinmetz. PeerfactSim.KOM: A Simulation Framework for Peer-to-Peer Systems. In Proc. of the Internat. Conf. on High Performance Computing and Simulation, pages 577--584, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  22. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan. Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications. In Proc. of the Conf. on Applications, Technologies, Architectures, and Protocols for Computer Communications, pages 149--160, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. R. Van Renesse, K. P. Birman, and W. Vogels. Astrolabe: A Robust and Scalable Technology for Distributed System Monitoring, Management, and Data Mining. ACM Transactions on Computer Systems, 21(2):164--206, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. P. Yalagandula and M. Dahlin. A Scalable Distributed Information Management System. ACM SIGCOMM Computer Communication Review, 34(4):379--390, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Benchmarking decentralized monitoring mechanisms in peer-to-peer systems

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          ICPE '12: Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering
          April 2012
          362 pages
          ISBN:9781450312028
          DOI:10.1145/2188286

          Copyright © 2012 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 22 April 2012

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate252of851submissions,30%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader