Abstract
This paper presents a high level description of Domus, an architecture for cluster-oriented Distributed Hash Tables.
As a data management layer, Domus supports the concurrent execution of multiple and heterogeneous DHTs, that may be simultaneously accessed by different distributed/parallel client applications. At system level, a load balancement mechanism allows for the (re)distribution of each DHT over cluster nodes, based on the monitoring of their resources, including CPUs, memory, storage and network. Two basic units of balancement are supported: vnodes, a coarse-grain unit, and partitions, a fine-grain unit. The design also takes advantage of the strict separation of object lookup and storage, at each cluster node, and for each DHT. Lookup follows a distributed strategy that benefits from the joint analysis of multiple partition-specific routing information, to shorten routing paths. Storage is accomplished through different kinds of data repositories, according to the specificity and requirements of each DHT.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Litwin, W., Neimat, M.A., Schneider, D.: LH*: Linear Hashing for Distributed Files. In: Procs. of ACM SIGMOD - Int. Conf. on Management of Data (1993)
Devine, R.: Design and implementation of DDH: a distributed dynamic hashing algorithm. In: Proceedings of the 4th Int. Conference on Foundations of Data Organization and Algorithms (1993)
Hilford, V., Bastani, F., Cukic, B.: EH* – Extendible Hashing in a Distributed Environment. In: Proceedings of the COMPSAC 1997 - 21st International Computer Software and Applications Conference (1997)
Gribble, S., Brewer, E., Hellerstein, J., Culler, D.: Scalable, Distributed Data Structures for Internet Service Construction. In: Proceedings of the Fourth Symposium on Operating Systems Design and Implementation (2000)
Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A Scalable Content–Addressable Network. In: Proceedings of the ACM SIGCOMM 2001 (2001)
Stoica, I., Morris, R., Karger, D., Kaashoek, M., Balkrishnan, H.: Chord: A Scalable P2P Lookup Service for Internet Applications. In: Proceedings of ACM SIGCOMM 2001 (2001)
Rufino, J., Pina, A., Alves, A., Exposto, J.: Toward a dynamically balanced cluster oriented DHT. In: Proceedings of the International Conference on Parallel and Distributed Computing and Networks (PDCN 2004) (2004)
Rufino, J., Alves, A., Pina, A., Exposto, J.: A cluster oriented model for dynamically balanced DHTs. In: Proceedings of IPDPS 2004 (2004)
Rufino, J., Pina, A., Alves, A., Exposto, J.: Agregated routing for a cluster oriented DHT. Technical report, Dep. of Informatics and Communications, Polytechnic Institute of Bragança, Portugal (2004)
Bermond, J.C., Liu, Z., Syska, M.: Mean Eccentricities of de Bruijn Networks. Technical report, Université de Nice-Sophia Antipolis (1993)
Alves, A., Pina, A., Rufino, J., Exposto, J.: RoCL: A Resource oriented Communication Library. In: Kosch, H., Böszörményi, L., Hellwagner, H. (eds.) Euro-Par 2003. LNCS, vol. 2790, Springer, Heidelberg (2003)
Sacerdoti, F.D., Katz, M.J., Massie, M.L., Culler, D.E.: Wide Area Cluster Monitoring with Ganglia. In: Proceedings of the IEEE Cluster 2003 Conference (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rufino, J., Pina, A., Alves, A., Exposto, J. (2006). Domus – An Architecture for Cluster-Oriented Distributed Hash Tables. In: Wyrzykowski, R., Dongarra, J., Meyer, N., Waśniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2005. Lecture Notes in Computer Science, vol 3911. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11752578_36
Download citation
DOI: https://doi.org/10.1007/11752578_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34141-3
Online ISBN: 978-3-540-34142-0
eBook Packages: Computer ScienceComputer Science (R0)