Using Hand Gestures for Specifying Motion Queries in Sketch-Based Video Retrieval

Abstract

In team sports, the analysis of a teams tactical behavior is becoming increasingly important. While this is still mostly based on the manual selection of video sequences from games, coaches and analysts increasingly demand more automated solutions to search for relevant sequences of videos, and to support this search by means of easy-to-use interfaces. In this paper, we present a novel intuitive interface for specifying sketched-based motion queries in sport videos using hand gestures. We have built the interface on top of SportSense, a system for interactive sports video retrieval. SportSense exploits spatiotemporal information incorporating various events within sport games, which is used as metadata to the actual sports videos. The interface has been designed to enable users to fully control the system and facilitate acquiring of the query object needed to perform both spatial and spatiotemporal motion queries using intuitive hand gestures.