Mengru Ma
ABSTRACT
The geo-referenced video consists of space-temporal information such as time, spatial location, camera shooting direction, camera viewing angle, viewable distance, etc. This type of video is widely applicable with sensors loaded on video capture devices. The application of geo-referenced video queries is increasingly popular recently (e.g., travel recommendation, intelligent transportation, road anomaly detection). And each of them needs to realize the query process of geo-referenced video at a specific time or spatial location. However, existing mobile video indexing methods still have room for improvement. There still exist problems with efficiency and accuracy. In this paper, we proposed a novel indexing method named MVideoIndex. MVideoIndex can process point or range queries quickly by utilizing Minimum Bounding Tilted Rectangle (MBTR) in leaf nodes based on the linear change of movement direction in geo-referenced videos. For representing the viewable regions of geo-referenced videos along the trajectory better, we constructed the index with a memory buffer limit to avoid the situation, where the query target falls into a large index and is inconvenient to query. We experimentally analyzed the performance of MVideoIndex and the state-of-art video index method GeoVideoIndex to verify our theory. The performance shows that MVideoIndex is capable of reducing the index construction time and query time, presenting a better performance than other methods. We further compared the impact of the memory buffer threshold size on query efficiency and found that the optimal memory buffer threshold size is about 8-kilometer Byte. We also conducted experiments to explore the effect of MVideoIndex and GeoVideoIndex on different datasets and found a more suitable application scenario for MVideoIndex.
- J. Mansouri, B. Seddik, S. Gazzah and T. Chateau, "Coarse localization using space-time and semantic-context representations of geo-referenced video sequences," 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA), 2015, pp. 355-359, doi: 10.1109/IPTA.2015.7367165.Google Scholar
- Quiang Liu, JaeJun Yoo, Byung-Tae Jang, KyoungHo Choi and Jenq-Neng Hwang, "Effective dissemination of scalable video and GIS information in an Intelligent Transportation System," IEEE International Conference on Networking, Sensing and Control, 2004, 2004, pp. 321-326 Vol.1, doi: 10.1109/ICNSC.2004.1297456.Google Scholar
- K. Toyama, R. Logan, A. Roseway, Geographic location tags on digital images, in: Proceedings of the Eleventh ACM International Conference on Multimedia, ACM, 2003, pp. 156–166Google ScholarDigital Library
- D. Lee, J. Oh, W. K. Loh, and H. Yu, “GeoVideoIndex: Indexing for georeferenced videos,” Information Sciences, vol. 374, pp. 210–223, 2016Google ScholarDigital Library
- G. Zhao, M. Zhang, T. Li, S. Chen and N. Rishe, "City Recorder: Virtual City Tour Using Geo-referenced Videos," 2015 IEEE International Conference on Information Reuse and Integration, 2015, pp. 281-286, doi: 10.1109/IRI.2015.53.Google ScholarDigital Library
- J. Tian, W. Ding, C. Wu, and K. W. Nam, “A Generalized Approach for Anomaly Detection from the Internet of Moving Things,” IEEE Access, vol. 7, pp. 144 972–144 982, 2019.Google Scholar
- K. Shearer, S. Venkatesh, D. Kieronska, Spatial indexing for video databases, J. Visual Commun. Image Represent. 7 (4) (1996) 325–335.Google ScholarCross Ref
- Lu, C. Shahabi, and S. H. Kim, “An efficient index structure for large-scale geo-tagged video databases,” GIS: Proceedings of the ACM International Symposium on Advances in Geographic Information Systems, vol. 04-07-November-2014, pp. 465–468, 2014.Google Scholar
- Y. Kim, J. Kim, and H. Yu, “GeoTree: Using spatial information for georeferenced video search,” Knowledge-Based Systems, vol. 61, pp. 1–12, 2014.Google ScholarDigital Library
- Ding, W., Yang, K., & Nam, K. W. (2019). Measuring similarity between geo-tagged videos using largest common view. Electronics Letters, 55(8), 450-452.Google Scholar
- Ding W, Tian J, Lee Y, VVS: Fast Similarity Measuring of FoV-Tagged Videos[J]. IEEE Access, 2020, 8: 190734-190745.Google ScholarCross Ref
- S.A. Ay, R. Zimmermann, S.H. Kim, Viewable scene modeling for geospatial video search, in: Proceedings of the 16th ACM international conference on Multimedia, ACM, 2008, pp. 309–318.Google ScholarDigital Library
- A. Guttman, R-trees: a dynamic index structure for spatial searching, Vol. 14, ACM, 1984.Google ScholarDigital Library
- Cho, D. S., Lim, D. S., & Hong, B. H. (2005). The policy of minimizing spatio-temporal overlaps on the TB-tree for trajectories index. Journal of Korea Spatial Information System Society, 7(1), 13-24.Google Scholar
- Ramadhan, H., & Kwon, J. (2020, December). Learning minimum bounding rectangles for efficient trajectory similarity search. In 2020 IEEE International Conference on Big Data (Big Data) (pp. 5810-5812). IEEE.Google ScholarCross Ref
- Ma, S. Arslan Ay, R. Zimmermann, and S. H. Kim, “Large-scale geo-tagged video indexing and queries,” GeoInformatica, vol. 18, no. 4, pp.671–697, 2014.Google ScholarDigital Library
- Y. Lu, C. Shahabi, and S. H. Kim, “Efficient indexing and retrieval of large-scale geo-tagged video databases,” GeoInformatica, vol. 20, no. 4, pp. 829–857, 2016.Google ScholarDigital Library
- Liu, Y., Fang, J., & Han, C. (2009, August). A new R-tree node splitting algorithm using MBR partition policy. In 2009 17th International Conference on Geoinformatics (pp. 1-6). IEEE.Google Scholar
- Y. Lu, C. Shahabi, S.H. Kim, An efficient index structure for large-scale geo-tagged video databases, in: Proceedings of the 22Nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, SIGSPATIAL ’14, 2014, pp. 465–468.Google Scholar
- F. Yu, “Berkeley deepdrive data,” https://bdd-data.berkeley.edu, May 2020.Google Scholar
- Jing Yuan, Yu Zheng, Xing Xie, and Guangzhong Sun. Driving with knowledge from the physical world. In The 17th ACM SIGKDD international conference on Knowledge Discovery and Data mining, KDD’11, New York, NY, USA, 2011. ACM.Google ScholarDigital Library
Index Terms
- MVideoIndex: Querying and Indexing of Geo-referenced Videos
Recommendations
Road extraction method of vehicle trajectory data based on geo-referenced videos
HP3C '22: Proceedings of the 6th International Conference on High Performance Compilation, Computing and CommunicationsWith the increasing use of driving recorder equipment, people need new methods for the analysis of vehicle trajectories. The extraction of road information from vehicle trajectory data is one of the focuses in the field of geographic information. In ...
GeoTree: using spatial information for georeferenced video search
With the rapid popularization of video recording devices, more multimedia content is available to the public. However, current video search engines rely on textual data such as video titles, annotations, and text around the video. Video recording ...
GeoVideoIndex
Videos captured with spatiotemporal information such as time, location, and camera direction are called georeferenced videos. As recent video recording devices such as smartphones, action camcorders, and dashcams have built-in GPS sensors, they capture ...
Comments