Abstract
In the era of Big Data, actual demands of collecting large volumes of complex digital information have brought new challenges to digital library software. This scenario calls for the construction of Very Large Digital Library (VLDL). New approaches and technologies are needed to deal with the various issues in designing and developing VLDL. In this paper, we design a plug-in system—PuntStore as a general solution to very large digital library. PuntStore supports different kinds of storage engines and index engines to deal with the problem of storing and retrieving data efficiently. We also design a new index engine pLSM in PuntStore to meet the specific needs in digital libraries. The successful adoption of PuntStore in the project of the Digital Library on History of Science and Technology in China (DLHSTC) shows that PuntStore can function effectively in supporting VLDL systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bentley, J.L.: Decomposable searching problems. Inf. Process. Lett. 8(5) (1979)
Candela, L., Athanasopoulos, G., Castelli, D., Raheb, K.E., Innocenti, P., Ioannidis, Y., Katifori, A., Nika, A., Vullo, G., Ross, S.: The Digital Library Reference Model. Deliverable D3.2b, DL.org (April 2011)
Farber, F., Cha, S.K., Primsch, J., Bornhovd, C., Sigg, S., Lehner, W.: SAP HANA Database - Data Management for Modern Business Applications. SIGMOD Record (2011)
Manghi, P., Pagano, P., Ioannidis, Y.: Second Workshop on Very Large Digital Libraries:in conjunction with the European Conference on Digital Libraries. SIGMOD Rec. 38, 46–48 (2010)
O’Neil, P., Cheng, E., Gawlick, D., O’Neil, E.: The log-structured merge-tree (LSM-tree). Acta Informatica 33(4), 351–385 (1996)
Phiri, L., Williams, K., Robinson, M., Hammar, S., Suleman, H.: Bonolo: A General Digital Library System for File-Based Collections. In: Chen, H.-H., Chowdhury, G. (eds.) ICADL 2012. LNCS, vol. 7634, pp. 49–58. Springer, Heidelberg (2012)
Thompson, J., Bainbridge, D., Suleman, H.: Towards Very Large Scale Digital LibraryBuilding in Greenstone Using Parallel Processing. In: ICADL 2011, pp. 332–341 (2011)
Wang, J., Zhang, Y., Gao, Y., Xing, C.: pLSM: A Highly Efficient LSM-Tree Index Supporting Real-Time Big Data Analysis. In: COMPSAC 2013, pp. 240–245 (2013)
Union E. Europeana (EB/OL) (2012), http://www.europeana.eu/portal/
Wikipedia. Database index (EB/OL) (2013), http://en.wikipedia.org/wiki/Database_index
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, J., Zhang, Y., Gao, Y., Xing, C. (2013). A New Plug-in System Supporting Very Large Digital Library. In: Urs, S.R., Na, JC., Buchanan, G. (eds) Digital Libraries: Social Media and Community Networks. ICADL 2013. Lecture Notes in Computer Science, vol 8279. Springer, Cham. https://doi.org/10.1007/978-3-319-03599-4_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-03599-4_6
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03598-7
Online ISBN: 978-3-319-03599-4
eBook Packages: Computer ScienceComputer Science (R0)