Abstract
User generated videos are much easier to be produced today due to the progress in camera technology on mobile devices. The ubiquitous built-in sensors in digital devices greatly enrich these videos with sensor descriptions, especially geo-spatial properties. A repository of such sensor-rich videos can be a great source of information for prospective tourists when they plan to visit a city and would like to get a preview of its main areas.
In this study we propose an interactive geo-video search system. When a user specifies a start point and a destination (e.g., on a map), the system dynamically retrieves a video summarization along the path between the two points. Moreover, the query can be interactively updated during the video playback, by changing either the tour path or the target destination. The main features of our technique are, first, that it is fully automatic and leverages sensor meta-data information which is acquired in conjunction with videos. Second, the system dynamically adapts to query updates in real-time, and no prior knowledge is required by users. Third, a concise but comprehensive summarization from multiple user generated videos is proposed for any queried route. Finally, the system incrementally adapts to the latest contributions to the video repository.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cornuejols, G., Fisher, M.L., Nemhauser, G.L.: Location of bank accounts to optimize float: an analytic study of exact and approximate algorithms. Management Science (1977)
Douglas, G.: R-Tree, Templated C++ Implementation (2010), http://superliminal.com/sources/RTreeTemplate.zip
Graham, C.H., Bartlett, N.R., Brown, J.L., Hsia, Y., Mueller, C.C., Riggs, L.A.: Vision and Visual Perception. John Wiley & Sons, Inc. (1965)
Jing, F., Zhang, L., Ma, W.Y.: Virtualtour: an online travel assistant based on high quality images. In: 14th ACM MM (2006)
Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predictwhere humans look. In: 11th IEEE ICCV (2009)
Li, Y., Merialdo, B.: Multi-video summarization based on Video-MMR. In: WIAMIS (2010)
Li, Y., Merialdo, B.: Video Summarization Based on Balanced AV-MMR. In: Schoeffmann, K., Merialdo, B., Hauptmann, A.G., Ngo, C.-W., Andreopoulos, Y., Breiteneder, C. (eds.) MMM 2012. LNCS, vol. 7131, pp. 370–382. Springer, Heidelberg (2012)
Lu, X., Wang, C., Yang, J.M., Pang, Y., Zhang, L.: Photo2trip: generating travel routes from geo-tagged photos for trip planning. In: 18th ACM MM (2010)
Pongnumkul, S., Wang, J., Cohen, M.: Creating map-based storyboards for browsing tour videos. In: 21st ACM UIST (2008)
Shao, J., Jiang, D., Wang, M., Chen, H., Yao, L.: Multi-video summarization using complex graph clustering and mining. In: ComSIS (2010)
Shen, Z., Arslan Ay, S., Kim, S.H., Zimmermann, R.: Automatic tag generation and ranking for sensor-rich outdoor videos. In: ACM Multimedia (2011)
Snavely, N., Garg, R., Seitz, S.M., Szeliski, R.: Finding paths through the world’s photos. In: ACM TOG (2008)
Snavely, N., Seitz, S.M., Szeliski, R.: Photo tourism: exploring photo collections in 3D. In: ACM TOG (2006)
Toyama, K., Logan, R., Roseway, A.: Geographic location tags on digital images. In: 11th ACM MM (2003)
Wang, F., Merialdo, B.: Multi-document video summarization. In: IEEE ICME (2009)
Wolschon, M.: Traveling salesman API, http://wiki.openstreetmap.org/wiki/Traveling_salesman
Zhang, Y., Zimmermann, R.: DVS: A dynamic multi-video summarization system of sensor-rich videos in geo-space. In: 20th ACM MM (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Y., Ma, H., Zimmermann, R. (2013). Dynamic Multi-video Summarization of Sensor-Rich Videos in Geo-Space. In: Li, S., et al. Advances in Multimedia Modeling. MMM 2013. Lecture Notes in Computer Science, vol 7732. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35725-1_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-35725-1_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35724-4
Online ISBN: 978-3-642-35725-1
eBook Packages: Computer ScienceComputer Science (R0)