Abstract
Hadoop is a popular distributed framework for massive data processing. HDFS is the underlying file system of Hadoop. More and more companies use Hadoop as data processing platform. Once Hadoop crashes, the data stored in HDFS can not be accessed directly. We present HDUMP, a light-weight bypassing file system, which aims to recover the data stored in HDFS when Hadoop crashes.
The work is supported by the Ministry of Science and Technology of China, National Key Research and Development Program (No. 2016YFE0100300, No. 2016YFB1000700), National Key Basic Research Program of China (No. 2015CB358800), NSFC (61672163, U1509213), Shanghai Innovation Action Project (No.16DZ1100200).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Comer, D.: The ubiquitous B-tree. ACM Comput. Surv. 11, 121–137 (1979)
Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51, 107–113 (2008)
Deshpande, P., Bora, D.: The recovery system for Hadoop cluster. In: The 20th International Conference on Distributed Multimedia Systems: Research Papers on Distributed Multimedia Systems, Distance Education Technologies and Visual Languages and Computing, Pittsburgh, PA, USA, 27–29 August 2014, pp. 416–420 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Li, Z. et al. (2018). HDUMP: A Data Recovery Tool for Hadoop. In: Pei, J., Manolopoulos, Y., Sadiq, S., Li, J. (eds) Database Systems for Advanced Applications. DASFAA 2018. Lecture Notes in Computer Science(), vol 10828. Springer, Cham. https://doi.org/10.1007/978-3-319-91458-9_56
Download citation
DOI: https://doi.org/10.1007/978-3-319-91458-9_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-91457-2
Online ISBN: 978-3-319-91458-9
eBook Packages: Computer ScienceComputer Science (R0)