Abstract
Media mining, the extraction of meaningful knowledge from multimedia content, poses significant computational challenges in today’s platforms, particularly in real-time scenarios. In this paper, we show how Graphic Processing Units (GPUs) can be leveraged for compute-intensive media mining applications. Furthermore, we propose a parallel implementation of color visual descriptors (color correlograms and color histograms) commonly used in multimedia content analysis on a CUDA (Compute Unified Device Architecture) enabled GPU (the Nvidia GeForce GTX280 GPU). Through the use of shared memory as software managed cache and efficient data partitioning, we reach computation throughputs of over 1.2 Giga Pixels/sec for HSV color histograms and over 100 Mega Pixels/sec for HSV color correlograms. We show that we can achieve better than real time performance and major speedups compared to high-end multicore CPUs and comparable performance on known implementations on the Cell B.E. We also study different trade-offs on the size and complexity of the features and their effect on performance.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Sebe, N., Tian, Q.: Personalized multimedia retrieval: the new trend? In: MIR 2007: Proceedings of the international workshop on Workshop on multimedia information retrieval, pp. 299–306. ACM, New York (2007)
Lew, M.S., Sebe, N., Djeraba, C., Jain, R.: Content-based multimedia information retrieval: State of the art and challenges. ACM Trans. Multimedia Comput. Commun. Appl. 2, 1–19 (2006)
Zhang, Q., Chen, Y., Li, J., Zhang, Y., Xu, Y.: Parallelization and performance analysis of video feature extractions on multi-core based systems. In: ICPP 2007: Proceedings of the 2007 International Conference on Parallel Processing, Washington, DC, USA. IEEE Computer Society, Los Alamitos (2007)
Li, E., Li, W., Tong, X., Li, J., Chen, Y., Wang, T., Wang, P., Hu, W., Du, Y., Zhang, Y., Chen, Y.K.: Accelerating video-mining applications using many small, general-purpose cores. IEEE Micro 28, 8–21 (2008)
Glasberg, R., Tas, C., Sikora, T.: Recognizing commercials in real-time using three visual descriptors and a decision-tree. In: 2006 IEEE International Conference on Multimedia and Expo., pp. 1481–1484 (2006)
Asanovic, K., Bodik, R., Catanzaro, B.C., Gebis, J.J., Husbands, P., Keutzer, K., Patterson, D.A., Plishker, W.L., Shalf, J., Williams, S.W., Yelick, K.A.: The landscape of parallel computing research: A view from berkeley. Technical Report UCB/EECS-2006-183, EECS Department, University of California, Berkeley (2006)
Mccool, M.D.: Scalable programming models for massively multicore processors. Proceedings of the IEEE 96, 816–831 (2008)
Owens, J.D., Houston, M., Luebke, D., Green, S., Stone, J.E., Phillips, J.C.: Gpu computing. Proceedings of the IEEE 96, 879–899 (2008)
Corporation, N.: NVIDIA CUDA Programming Guide, version 2.0 (2008)
Liu, L.-K., Liu, Q., Natsev, A., Ross, K.A., Smith, J.R., Varbanescu, A.L.: Digital media indexing on the cell processor. In: 2007 IEEE International Conference on Multimedia and Expo., pp. 1866–1869 (2007)
Chen, Y., Li, E., Li, J., Zhang, Y.: Accelerating video feature extractions in cbvir on multi-core systems. Intel Technology Journal 11 (2007)
Mizukami, Y., Tadamura, K.: Optical flow computation on compute unified device architecture. In: 14th International Conference on Image Analysis and Processing, 2007. ICIAP 2007, pp. 179–184 (2007)
Ding, S., He, J., Yan, H., Suel, T.: Using graphics processors for high performance ir query processing. In: WWW 2009: Proceedings of the 18th international conference on World wide web, pp. 421–430. ACM, New York (2009)
Wu, R., Zhang, B., Hsu, M.: Clustering billions of data points using gpus. In: UCHPC-MAW 2009: Proceedings of the combined workshops on UnConventional high performance computing workshop plus memory access workshop, pp. 1–6. ACM, New York (2009)
Hauptmann, A.G., Christel, M.G., Yan, R.: Video retrieval based on semantic concepts. Proceedings of the IEEE 96, 602–622 (2008)
Catanzaro, B., Sundaram, N., Keutzer, K.: Fast support vector machine training and classification on graphics processors. In: ICML 2008: Proceedings of the 25th international conference on Machine learning, pp. 104–111. ACM, New York (2008)
Strong, G., Gong, M.: Browsing a large collection of community photos based on similarity on gpu. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Remagnino, P., Porikli, F., Peters, J., Klosowski, J., Arns, L., Chun, Y.K., Rhyne, T.-M., Monroe, L. (eds.) ISVC 2008, Part II. LNCS, vol. 5359, pp. 390–399. Springer, Heidelberg (2008)
Chong, J., Yi, Y., Faria, A., Satish, N., Keutzer, K.: Data-parallel large vocabulary continuous speech recognition on graphics processors. In: Proceedings of the 1st Annual Workshop on Emerging Applications and Many Core Architecture (EAMA), pp. 23–35 (2008)
Blythe, D.: Rise of the graphics processor. Proceedings of the IEEE 96, 761–778 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Diao, M., Kim, J. (2009). Multimedia Mining on Manycore Architectures: The Case for GPUs. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2009. Lecture Notes in Computer Science, vol 5876. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10520-3_59
Download citation
DOI: https://doi.org/10.1007/978-3-642-10520-3_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10519-7
Online ISBN: 978-3-642-10520-3
eBook Packages: Computer ScienceComputer Science (R0)