ABSTRACT
Searching for scenes in team sport videos is a task that recurs very often in game analysis and other related activities performed by coaches. In most cases, queries are formulated on the basis of specific motion characteristics the user remembers from the video. Providing sketching interfaces for graphically specifying query input is thus a very natural user interaction for a retrieval application. However, the quality of the query (the sketch) heavily depends on the memory of the user and her ability to accurately formulate the intended search query by transforming this 3D memory of the known item(s) into a 2D sketch query. In this paper, we present an auto-suggest search feature that harnesses spatiotemporal data of team sport videos to suggest potential directions containing relevant data during the formulation of a sketch-based motion query. Users can intuitively select the direction of the desired motion query on-the-fly using the displayed visual clues, thus relaxing the need for relying heavily on memory to formulate the query. At the same time, this significantly enhances the accuracy of the results and the speed at which they appear. A first evaluation has shown the effectiveness and efficiency of our approach.
- OptaPro. www.optasportspro.com. Accessed: 2014--5--5.Google Scholar
- L. Ballan, M. Bertini, A. Del Bimbo, and W. Nunziati. Soccer Players Identification based on Visual Local Features. In Proc. 6th ACM Int'l Conf. on Image and Video Retrieval, Amsterdam, The Netherlands, 2007. Google ScholarDigital Library
- M. Fleischman, H. Evans, and D. Roy. Unsupervised content-based indexing for sports video retrieval. In 9th ACM Workshop on Multimedia IR (MIR), 2007. Google ScholarDigital Library
- H. Ben Shitrit, J. Berclaz, F. Fleuret, , and P. Fua. Tracking Multiple People under Global Appearance Constraints. Int'l Conf. on Computer Vision, 2011. Google ScholarDigital Library
- P. Wilhelm, P. Thomas, E. Monier, R. Timmermann, M. Dellnitz, F. Werner, and U. Ruckert. An Integrated Monitoring and Analysis System for Performance Data of Indoor Sport Activities. In Proc. 10th Australasian Conf. on Mathematics and Computers in Sport, Australia, 2010.Google Scholar
- Stats. www.stats.com. Accessed: 2014--5--5.Google Scholar
- Amisco Pro. www.amisco.eu. Accessed: 2014--5--5.Google Scholar
- MasterCoach. www.mastercoach.de. Accessed: 2014--5--5.Google Scholar
- Prozone. www.prozonesports.com. Accessed: 2014--5--5.Google Scholar
- Adidas miCoach. http://micoach.adidas.com. Accessed: 2014--5--5.Google Scholar
- ZXY. www.zxy.no. Accessed: 2014--5--5.Google Scholar
- R. Hu, S. James, T. Wang, and J. Collomosse. Markov random fields for sketch based video retrieval. In Proceedings of the 3rd ACM Conference on International Conference on Multimedia Retrieval, ICMR '13, pages 279--286, New York, NY, USA, 2013. Google ScholarDigital Library
- C. Morikawa and G. de Silva. User interaction techniques for multimedia retrieval. In Proceedings of the 2012 Joint International Conference on Human-Centered Computer Environments, HCCE '12, pages 68{75, New York, NY,USA, 2012. Google ScholarDigital Library
- G. de Silva and K. Aizawa. Interacting with location-based multimedia using sketches. In Proceedings of the ACM International Conference on Image and Video Retrieval, CIVR '10, pages 189{196, New York, NY, USA, 2010. Google ScholarDigital Library
- G. de Silva, T. Yamasaki, and K. Aizawa. Sketch-based spatial queries for the retrieval of human locomotion patterns in smart environments. In Advances in Multimedia, 2009. Google ScholarDigital Library
- I. Al Kabary and H. Schuldt. Towards sketch-based motion queries in sports videos. In Proceedings of the 15th IEEE International Symposium on Multimedia, ISM '13, 2013. Google ScholarDigital Library
- I. Al Kabary and H. Schuldt. Sportsense: using motion queries to find scenes in sports videos. In Proceedings of the 22nd ACM International Conference on Conference on Information and Knowledge Management, CIKM '13, pages 2489--2492, 2013. Google ScholarDigital Library
- I. Al Kabary and H. Schuldt. Using hand gestures for specifying motion queries in video retrieval. In Proceedings of the 36th European Conference on Information Retrieval,CIKM '13, 2014.Google Scholar
- Manchester City F.C. www.mcfc.com. Accessed: 2014--5--5.Google Scholar
Index Terms
- Enhancing sketch-based sport video retrieval by suggesting relevant motion paths
Recommendations
SportSense: using motion queries to find scenes in sports videos
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge ManagementWe present SportSense, a system for interactive sports video retrieval using sketch-based motion queries. SportSense is based on sports videos of games, enriched with an overlay of metadata that incorporates spatio-temporal information about various ...
Towards Sketch-Based Motion Queries in Sports Videos
ISM '13: Proceedings of the 2013 IEEE International Symposium on MultimediaThe advent of pen-based user interfaces has facilitated several natural ways for human-computer interaction. One example is sketch-based retrieval, i.e., the search for (multimedia) objects on the basis of sketches as query input. So far, work has ...
Using Hand Gestures for Specifying Motion Queries in Sketch-Based Video Retrieval
ECIR 2014: Proceedings of the 36th European Conference on IR Research on Advances in Information Retrieval - Volume 8416In team sports, the analysis of a teams tactical behavior is becoming increasingly important. While this is still mostly based on the manual selection of video sequences from games, coaches and analysts increasingly demand more automated solutions to ...
Comments