Skip to main content

Massive Electronic Records Processing for Digital Archives in Cloud

  • Conference paper
Pervasive Computing and the Networked World (ICPCA/SWS 2012)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 7719))

  • 3920 Accesses

Abstract

With the development of cloud technologies, more and more electronic records will be stored and processed in the cloud. In order to manage massive electronic records, a kind of storage system named CloudDA is proposed in cloud environment in our paper. In the CloudDA, the HUABASE database and the THCFS file system are designed. HUABASE is used to store all kinds of structured data such as the metadata and index information. And the THCFS is used to store massive archives files. Finally, we design a kind of massive electronic records processing prototype system for digital archives in the cloud.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ghemawat, S., Gobioff, H., Leung, S.-T.: The Google File System. In: Proc. of the 19th ACM Symposium on Operating Systems Principles (SOSP 2003), pp. 29–43 (2003)

    Google Scholar 

  2. Borthakur, D.: HDFS Architecture (April 2009), http://hadoop.apache.org/common/docs/r0.20.0/hdfs_design.html

  3. Beaver, D., Kumar, S., Li, H.C., Sobel, J., Vajgel, P.: Finding a needle in Haystack: Facebook’s photo storage. In: OSDI 2010 (2010)

    Google Scholar 

  4. (July 20, 2012), http://hypertable.org/

  5. Chang, F., Dean, J., Ghemawat, S., et al.: Bigtable: A Distributed Storage System for Structured Data. In: Proceedings of OSDI 2006: Seventh Symposium on Operating System Design and Implementation, pp. 205–218 (2006)

    Google Scholar 

  6. Sun, J., Jin, Q.: Scalable RDF store based on HBase and MapReduce. In: Advanced Computer Theory and Engineering (ICACTE), pp. 633–636 (2010)

    Google Scholar 

  7. Lakshman, A., Malik, P.: Cassandra - A Decentralized Structured Storage System. ACM SIGOPS Operating Systems Review Archive 44(2), 35–40 (2010)

    Article  Google Scholar 

  8. Baker, J., Bond, C., Corbett, J.C., Furman, J.J.: Megastore: Providing Scalable, Highly Available Storage for Interactive Services. In: 5th Biennial Conference on Innovative Data Systems Research (CIDR), pp. 223–234 (2011)

    Google Scholar 

  9. DeCandia, G., Hastorun, D., Jampani, M., et al.: Dynamo: amazon’s highly available key-value store. In: ACM SIGOPS Symposium on Operating Systems Principles, New York, pp. 205–220 (2007)

    Google Scholar 

  10. Abouzeid, A., et al.: HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workloads. In: Proceedings of the VLDB 2009, pp. 922–933 (2009)

    Google Scholar 

  11. Reference Model for an Open Archival Information System (OAIS). Recommendation for Space Data System Standards 1, 1–148 (2002)

    Google Scholar 

  12. http://prov.vic.gov.au/wp-content/uploads/2012/01/VERS_Advice12.pdf

  13. https://www.vmware.com/

  14. http://openstack.org/

  15. http://www.eucalyptus.com

  16. http://www.huabase.cn/product.jsp

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Guigang, Z. et al. (2013). Massive Electronic Records Processing for Digital Archives in Cloud. In: Zu, Q., Hu, B., Elçi, A. (eds) Pervasive Computing and the Networked World. ICPCA/SWS 2012. Lecture Notes in Computer Science, vol 7719. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37015-1_71

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37015-1_71

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37014-4

  • Online ISBN: 978-3-642-37015-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics