Abstract
The amount of image data has been rising exponentially over the last decades due to numerous trends like social networks, smart-phones, automotive, biology, medicine and robotics. Traditionally, file systems are used as storage. Although they are easy to use and can handle large data volumes, they are suboptimal for efficient sequential image processing due to the limitation of data organisation on single images. Database systems and especially column-stores support more stuctured storage and access methods on the raw data level for entiere series.
In this paper we propose definitions of various layouts for an efficient storage of raw image data and metadata in a column store. These schemes are designed to improve the runtime behaviour of image processing operations. We present a tool called column-store Image Processing Toolbox (cIPT) allowing to easily combine the data layouts and operations for different image processing scenarios.
The experimental evaluation of a classification task on a real world image dataset indicates a performance increase of up to 15x on a column store compared to a traditional row-store (PostgreSQL) while the space consumption is reduced 7x. With these results cIPT provides the basis for a future mature database feature.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Similar layouts exist for the rgb and grey relation.
References
Abadi et al.: Column-oriented database systems. VLDB, August 2009
Datta, R., et al.: Ideas, influences, and trends of the new age. ACM Comput. Surv. 40(2), 5:1–5:60 (2008)
Deligiannidis, L., Arabnia, H.: Emerging Trends in Image Processing, Computer Vision and Pattern Recognition. Emerging Trends in Computer Science and Applied Computing. Elsevier Science (2014)
Deselaers, T.: Features of image retrieval, December 2003
HP. Cape2cape. http://www8.hp.com/uk/en/campaigns/cape2cape/overview.html
Ivanova, M., et al.: Monetdb/sql meets skyserver: the challenges of a scientific database. In: Proceedings of the SSBDM (2007)
Johansson, B.: A survey on: Contents based search in image databases. Survey, Department of Electrical Engineering, Linköping University 08 (2000)
Lamb, A., et al.: The vertica analytic database: C-store 7 years later. Proc. VLDB Endow. 5(12), 1790–1801 (2012)
Niblack et al.: querying images by content, using color, texture, and shape (1993)
Sidirourgos, L., et al.: Column-store support for rdf data management: Not all swans are white. Proc. VLDB Endow. 1(2), 1553–1563 (2008)
Stonebraker, M., et al.: C-store: A column-oriented dbms. In: Proceedings of the VLDB (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Vinçon, T., Petrov, I., Thies, C. (2016). cIPT: Shift of Image Processing Technologies to Column-Oriented Databases. In: Ivanović, M., et al. New Trends in Databases and Information Systems. ADBIS 2016. Communications in Computer and Information Science, vol 637. Springer, Cham. https://doi.org/10.1007/978-3-319-44066-8_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-44066-8_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-44065-1
Online ISBN: 978-3-319-44066-8
eBook Packages: Computer ScienceComputer Science (R0)