Abstract
Content-based video retrieval in general and in sport videos in particular has attracted an increasing interest in the past few years, due to the growing interest in sports analytics. Especially sketch-based queries, enabling spatial search in video collections, are increasingly being demanded by coaches and analysts in team sports as an essential tool for game analysis. Although there has been great progress in the last years in the field of sketch-based retrieval in sports, most approaches focus on functional aspects and only consider just a very limited number of games. The problem is to scale these systems to allow for interactive video retrieval on a large game collection, beyond single games. In this paper, we show how SportSense, our sketch-based video retrieval system, can be deployed and scaled-out in the Cloud, allowing managers and analysts to interactively search for scenes of their choice within a large collection of games. In our evaluations, we show how the system can scale to a collection of the size of an entire season with response times that enable real-time analysis.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Al Kabary, I., Schuldt, H.: Towards sketch-based motion queries in sports videos. In: 2013 IEEE International Symposium on Multimedia (ISM), December 2013
Kabary, I.A., Schuldt, H.: Using hand gestures for specifying motion queries in sketch-based video retrieval. In: de Rijke, M., et al. (eds.) ECIR 2014. LNCS, vol. 8416, pp. 733–736. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-06028-6_84
Probst, L., et al.: SportSense: user interface for sketch-based spatio-temporal team sports video scene retrieval. In: Proceedings of the IUI 2018 Workshop on User Interfaces for Spatial and Temporal Data Analysis, Tokyo, Japan, March 2018
Seidenschwarz, P., Jonsson, A., Rauschenbach, F., Rumo, M., Probst, L., Schuldt, H.: Combining qualitative and quantitative analysis in football with sportsense. In: Proceedings of the ACM Workshop on Multimedia Content Analysis in Sports, France, October 2019
Al Kabary, I., Schuldt, H.: SportSense: using motion queries to find scenes in sports videos. In: Proceedings of the CIKM 2013, San Francisco, CA, USA. ACM, October 2013
Al Kabary, I., Schuldt, H.: Enhancing sketch-based sport video retrieval by suggesting relevant motion paths. In: Proceedings of the 37th International ACM SIGIR Conference, Gold Coast, QLD, Australia. ACM (2014)
Ballan, L., Bertini, M., Bimbo, A.D., Nunziati, W.: Soccer players identification based on visual local features. In: Proceedings of the 6th ACM CIVR Conference, July 2007
Fleischman, M., Roy, D.: Unsupervised content-based indexing of sports video. In: Proceedings of the 9th ACM International Workshop on Multimedia Information Retrieval, Augsburg, Germany, pp. 87–94. ACM, September 2007
Su, C., Liao, H., Tyan, H., Lin, C., Chen, D., Fan, K.: Motion flow-based video retrieval. IEEE Trans. Multimedia 9, 1193–1201 (2007)
Chang, S.F., Chen, W., Meng, H., Sundaram, H., Zhong, D.: A fully automated content-based video search engine supporting spatiotemporal queries. IEEE Trans. Circ. Syst. Video Technol. 8, 602–615 (1998)
Shitrit, H.B., Berclaz, J., Fleuret, F., Fua, P.: Tracking multiple people under global appearance constraints. In: International Conference on Computer Vision (ICCV), Barcelona, Spain. IEEE, November 2011
Wilhelm, P., et al.: An integrated monitoring and analysis system for performance data of indoor sport activities. In: 10th Australasian Conference on Mathematics and Computers in Sport, Darwin, Australia, July 2010
Interplay Sports. www.interplay-sports.com. Accessed Mar 2020
OptaSportsPro. www.optasportspro.com. Accessed Mar 2020
Panasonic Ultra Wide Angle Camera. www.newatlas.com/panasonic-ultra-wide-camera-system/28826/. Accessed Mar 2020
Stats Perform. www.statsperform.com. Accessed Mar 2020
TracAB. https://chyronhego.com/products/sports-tracking/tracab-optical-tracking. Accessed Mar 2020
Adidas Runtastic. www.runtastic.com. Accessed Mar 2020
ZXY. www.zxy.no. Accessed Mar 2020
Probst, L., Brix, F., Schuldt, H., Rumo, M.: Real-time football analysis with streamteam. In: Proceedings of the 11th ACM International Conference on Distributed and Event-based Systems, Barcelona, Spain. ACM, June 2017
Sha, L., Lucey, P., Yue, Y., Carr, P., Rohlf, C., Matthews, I.A.: Chalkboarding: a new spatiotemporal query paradigm for sports play retrieval. In: 21st International Conference on Intelligent User Interfaces, Sonoma, CA, USA, March 2016
Beckmann, N., Kriegel, H.P., Schneider, R., Seeger, B.: The R*-tree: an efficient and robust access method for points and rectangles. In: Proceedings of the ACM SIGMOD Conference on Management of Data, Atlantic City, NJ, USA, May 1990
Fang, Y., Friedman, M., Nair, G., Rys, M., Schmid, A.E.: Spatial indexing in microsoft SQL server 2008. In: Proceedings of the ACM SIGMOD Conference on Management of Data, Vancouver, BC, Canada, pp. 1207–1216. ACM, June 2008
Comer, D.: Ubiquitous B-tree. ACM Comput. Surv. 11, 121–137 (1979)
Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51, 107–113 (2008)
Manchester City Football Club. www.mcfc.co.uk. Accessed Mar 2020
Amazon EC2. https://aws.amazon.com/ec2/instance-types/. Accessed Mar 2020
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Al Kabary, I., Schuldt, H. (2020). Scalable Sketch-Based Sport Video Retrieval in the Cloud. In: Zhang, Q., Wang, Y., Zhang, LJ. (eds) Cloud Computing – CLOUD 2020. CLOUD 2020. Lecture Notes in Computer Science(), vol 12403. Springer, Cham. https://doi.org/10.1007/978-3-030-59635-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-59635-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59634-7
Online ISBN: 978-3-030-59635-4
eBook Packages: Computer ScienceComputer Science (R0)