Abstract
Gaston is a peer-to-peer large-scale file system designed to provide a fault-tolerant and highly available file service for a virtually unlimited number of users. Data management in Gaston disseminates and stores replicas of files on multiple machines to achieve the requested level of data availability and uses a dynamic tree-topology structure to connect replication schema members. We present generic algorithms for replication schema creation and maintenance according to file user requirements and autonomous constraints that are set on individual nodes. We also show specific data object structure as well as mechanisms for secure and efficient update propagation among replicas with data consistency control. Finally, we introduce a scalable and efficient technique improving fault-tolerance of the tree-topology structure connecting replicas.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson, R. J.: The Eternity Service. In: Pribyl, J. (Ed.): Proc. of Pragocrypt ’96. Praha 1996, pp. 242–252.
Bolosky, W. et al.: Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs. In: ACM SIGMETRICS Performance Evaluation Review 28 (2000) 1, pp. 34–43.
Dabek, F. et al.: Wide-area cooperative storage with CFS. In: ACM SIGOPS Operating Systems Review 35 (2001) 5, pp. 202–215.
Druschel, P.; Rowstron, A.: Past: Persistent and anonymous storage in a peer-to-peer networking environment. In: Proc. of 8th IEEE Workshop on Hot Topics in Operating Systems HotOS 2001. 2001, pp. 65–70.
Dynda, V.; Rydlo, P.: P2P Large-scale File System Architecture. In: Baca, J. (Ed.): Proc. of the Fifth International Scientific Conference — Electronic Computers and Informatics ECI ’02. Kosice 2002, pp. 262–267.
Farsite website: http://www.research.microsoft.com/sn/Farsite/publications.htm, as of 2001-09-20.
Francis, P.: Yoid: Your own internet distribution. Technical report, ACIRI. http://www.aciri.org/yoid, as of 2000-12-16.
Gnutella website: http://gnutella.wego.com, as of 2002-08-12.
Chen, Y.; Katz, R. H.; Kubiatowicz, J. D.: Dynamic Replica Placement for Scalable Content Delivery In: Druschel, P, Kaashoek, F., Rowstron, A. (Eds.): Proc. of the First International Workshop on Peer-to-Peer Systems IPTPS 2002. 2002, pp. 306–318.
Internet archive website: http://www.archive.org, as of 2001-09-16.
KaZaA website: http://www.kazaa.com, as of 2003-03-03.
Kubiatowicz, J. et al.: OceanStore: An architecture for global-scale persistent storage. In: ACM SIGPLAN Notices 35 (2000) 11, pp. 190–201.
Mehra, P.; Chatterjee, S.: Efficient Data Dissemination in OceanStore. http://www-video.eecs.berkeley.edu/~pmehra/classes/cs262/paper.pdf, as of 2000-12-16.
Morpheus website: http://www.morpheus.com, as of 2002-08-06.
Parker, D. et al.: Detection of Mutual Inconsistency in Distributed Systems. In: IEEE Transactions on Software Engineering 9 (1983) 3, pp. 240–247.
Plaxton, G. et al.: Accessing nearby copies of replicated objects in a distributed environment. In: Leiserson, Charles E.; Culler, David E. (Eds.): Proc. of the Ninth Annual ACM Symposium on Parallel Algorithms and Architectures. ACM Press, New York 1997, pp. 311–320.
Rabinovich, M.; Aggarwal, A.: RaDaR: A scalable architecture for a global Web hosting service. In: Mendelzon, A. (Ed.): Proc. of the 8th Int’l World Wide Web Conf. 1999, pp. 1545–1561.
Ratnasamy, S. et al.: A scalable content-addressable network. In: Proc. of the ACM SIGCOMM Symposium on Communication, Architecture, and Protocols. ACM Press, New York 2001, pp. 161–172.
Rhea, S. et al.: Maintenance-free global storage in OceanStore. In: IEEE Internet Computing 5 (2001) 5, pp. 40–49.
Rowstron, A. et al.: Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In: Guerraoui, R. (Ed.): Proc. of the 18th IFIP/ACM International Conference on Distributed Systems Platforms (Middleware 2001). Springer, Berlin Heidelberg 2001, pp. 329–350.
Schneier, B.: Applied Cryptography. Wiley, New York 1996.
Stoica, I. et al.: Chord: A scalable peer-to-peer lookup service for Internet applications. In: Proc. of ACM SIGCOMM Symposium on Communication, Architecture, and Protocols. ACM Press, New York 2001, pp. 149–160.
Vogels, W.: File system usage in Windows NT 4.0. In: ACM Operating Systems Review 35 (1999) 5, pp. 93–109.
Weatherspoon, H. et al.: Silverback: A global-scale archival system. Technical Report UCB/CSD-01-1139. http://oceanstore.cs.berkeley.edu/publications/papers/pdf/silverback_sosp_tr.pdf, as of 2001-09-24.
Wells, C.: The OceanStore Archive: Goals, Structures, and Self-Repair. http://oceanstore.cs.berkeley.edu/publications/papers/pdf/cwells_masters.pdf, as of 2000-12-10.
Wolfson, O.; Jajodia, S.; Huang, Y.: An adaptive replication algorithm. In: ACM Trans. On Database Systems 22 (1997) 2.
Zhao, B. Y.; Kubiatowicz, J.; Joseph, A. D.: Tapestry: An infrastructure for fault-tolerant wide-area location and routing. Technical Report UCB/CSD-01-1141. http://www.cs.berkeley.edu/~ravenben/ tapestry.pdf, as of 2001-06-12.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Dynda, V., Rydlo, P. Fault-tolerant data management in the gaston peer-to-peer file system. Wirtschaftsinf 45, 273–283 (2003). https://doi.org/10.1007/BF03254945
Issue Date:
DOI: https://doi.org/10.1007/BF03254945