Object Instance Search in Videos via Spatio-Temporal Trajectory Discovery | IEEE Journals & Magazine | IEEE Xplore

Object Instance Search in Videos via Spatio-Temporal Trajectory Discovery


Abstract:

Given a specific object as query, object instance search aims to not only retrieve the images or frames that contain the query, but also locate all its occurrences. In th...Show More

Abstract:

Given a specific object as query, object instance search aims to not only retrieve the images or frames that contain the query, but also locate all its occurrences. In this work, we explore the use of spatio-temporal cues to improve the quality of object instance search from videos. To this end, we formulate this problem as the spatio-temporal trajectory search problem, where a trajectory is a sequence of bounding boxes that locate the object instance in each frame. The goal is to find the top- K trajectories that are likely to contain the target object. Despite the large number of trajectory candidates, we build on a recent spatio- temporal search algorithm for event detection to efficiently find the optimal spatio- temporal trajectories in large video volumes , with complexity linear to the video volume size. We solve the key bottleneck in applying this approach to object instance search by leveraging a randomized approach to enable fast scoring of any bounding boxes in the video volume. In addition , we present a new dataset for video object instance search. Experimental results on a 73-hour video dataset demonstrate that our approach improves the performance of video object instance search and localization over the state-of-the-art search and tracking methods.
Published in: IEEE Transactions on Multimedia ( Volume: 18, Issue: 1, January 2016)
Page(s): 116 - 127
Date of Publication: 13 November 2015

ISSN Information:

Funding Agency:


References

References is not available for this document.