Abstract
This paper presents a symbolic formalism for modeling and retrieving video data via the moving objects contained in the video images. The model integrates the representations of individual moving objects in a scene with the time-varying relationships between them by incorporating both the notions of object tracks and temporal sequences of PIRs (projection interval relationships). The model is supported by a set of operations which form the basis of a moving object algebra. This algebra allows one to retrieve scenes and information from scenes by specifying both spatial and temporal properties of the objects involved. It also provides operations to create new scenes from existing ones. A prototype implementation is described which allows queries to be specified either via an animation sketch or using the moving object algebra.
Similar content being viewed by others
References
T. Abraham and J.F. Roddick, “Survey of spatio-temporal databases,” Technical Report CS-96-011, Advanced Computing Research Centre, School of Computer and Information Science, The University of South Australia, December 1996.
ACM, “Special feature on visual information management,” Communications of the ACM, Vol. 40, No. 12, 1997.
K.K. Al-Taha, R.T. Snodgrass, and M.D. Soo, “Bibliography on spatiotemporal databases,” ACM SIGMOD Record, Vol. 22, No. 1, pp. 59–67, 1993.
J.F. Allen, “Maintaining knowledge about temporal intervals,” Communications of the ACM, Vol. 26, No. 11, pp. 832–843, 1983.
E. Bertino, M. Damiani, and P. Randi, “Multimedia data handling in a knowledge representation system,” in Future Database' 92: Proceedings of the Second Far-East Workshop on Future Database Systems, Kyoto, Japan, April 1992. Advanced Database Research and Development Series Vol. 3, pp. 133–141, World Scientific.
A.D. Bimbo, E. Vicario, and D. Zingoni, “Symbolic description and visual querying of image sequences using spatio-temporal logic,” IEEE Transaction on Knowledge and Data Engineering, Vol. 7, No. 4, pp. 609–621, 1995.
J.S. Boreczky and L.A. Rowe, “Comparison of video shot boundary detection techniques,” in SPIE Proceedings, Vol. 2670, Storage and Retrieval for Image and Video Databases IV, pp. 170–179, San Diego/La Jolla, California, Feb. 1996. The International Society for Optical Engineering.
S.K. Chang, Q.Y. Shi, and C.W. Yan, “Iconic indexing by 2D strings,” IEEE Transactions on Pattern Recognition and Machine Intelligent, PAMI-Vol. 9, No. 3, pp. 413–428, 1987.
N. Dimitrova and F. Golshani, “Motion recovery for video content classification,” ACM Transactions on Information Systems, Vol. 13, No. 4, pp. 408–439, 1995.
M.J. Egenhofer, “Point-set topological spatial relations,” Int. J. Geographical Information Systems, Vol. 5, No. 2, pp. 161–174, 1991.
M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, “Query by image and video content: The QBIC system,” IEEE Computer, pp. 23–32, 1995.
C. Freksa, “Temporal reasoning based on semi-intervals,” Artificial Intelligence, Vol. 54, Nos. 1/2, pp. 199-227, 1992.
O. Guenther and A. Buchmann, “Research issues in spatial databases,” ACM SIGMOD Record, Vol. 19, No. 4, pp. 61–68, 1990.
R. Hjelsvold, “Video information contents and architecture,” in Lecture Notes in Computer Science, Vol. 779: Advances in Database Technology—EDBT'94. Fourth International Conference on Extending Database Technology, pp. 259–272. Springer-Verlag: Cambridge, UK, 1994.
K. Kaneko, S. Kuroki, and A. Makinouchi, “Design of 3D CG data model of “move” animation database system,” in Future Database' 92: Proceedings of the Second Far-EastWorkshop on Future Database Systems, Kyoto, Japan, April 1992. Advanced Database Research and Development Series, Vol. 3, pp. 364–372,World Scientific.
N. Kline, “An update of the temporal database bibliography,” Technical Report TEMPIS No. 58, Department of Computer Science, The University of Arizona, 1993.
S-Y. Lee and H-M. Kao, “Video indexing—an approach based on moving object and track,” in SPIE Proc., Vol. 1908: Storage and Retrieval for Image and Video Databases, pp. 25–36. The International Society for Optical Engineering, 1993.
K. Li, N. Badji, and R. Laurini, “Modeling moving objects in spatiotemporal databases,” Technical Report, Department of Information and Communication Engineering, KAIST, 1992.
H. Mo, S. Satoh, and M. Sakauchi, “A study of image recognition using similarity retrieval,” in Visual'96: First International Conference on Visual Information Systems, Feb. 1996, pp. 136–151.
M. Nabil, “Modelling and retrieving multimedia data using spatial and temporal information,” Ph.D. Thesis, School of Computer Science and Engineering, The University of New South Wales, 1997.
M. Nabil, A.H.H. Ngu, and J. Shepherd, “Modelling spatiotemporal relationships in multimedia database,” in IEEE Workshop in Spatial and Temporal Interaction: Representation and Reasoning, Singapore, Nov. 1994, pp. 171–189.
M. Nabil, A.H.H. Ngu, and J. Shepherd, “A unified representation of spatial and temporal information in multimedia database,” in Proceedings of The Third International Conference on Automation, Robotics and Computer Vision, Singapore, Nov. 1994, pp. 374–378.
M. Nabil, A.H.H. Ngu, and J. Shepherd, “Picture similarity retrieval using 2d projection interval representation,” IEEE Transactions on Knowledge and Data Engineering, Vol. 8, No. 4, pp. 533–539, 1996.
M. Nabil, J. Shepherd, and A.H.H. Ngu, “An image retrieval system for distributed environments,” in Eighth International Workshop on Research Issues in Data Engineering (RIDE98)—Continuous-Media Databases and Applications, Orlando, Florida, Feb. 1998, pp. 67–74.
A. Nagasaka and Y. Tanaka, “Automatic video indexing and full-video search for object appearances,” in Visual Database Systems II, Elsevier Science Publishers, 1992, pp. 113–127.
E. Oomoto and K. Tanaka, “OVID: Design and implementation of a video-object database system,” IEEE Transactions on Knowledge and Data Engineering, Vol. 5, No. 4, pp. 629–643, 1994.
H. Samet, “The Design and Analysis of Spatial Data Structures,” Addison-Wesley Publishing Co., 1990.
S. Devadiga, D.A. Kosiba, U. Gargi, S. Oswld, and R. Kasturi, “A semiaoutomatic video database system,” in SPIE Proc., Vol. 2420: Storage and Retrieval for Image and Video Databases III,W. Niblack and R.C. Jain (Eds), pp. 262–267, Feb. 1995. The International Society for Optical Engineering.
K. Shearer, S.K. Vankatesh, and D. Kieronska, “The visitors guide: A simple video reuse application,” Department of Computer Science, Curtin University of Technology, Australia, 1996.
A.P. Sistla, O. Wolfson, S. Chamberlain, and S. Dao, “Modeling and querying moving objects,” in Proceedings of the Thirteenth International Conference on DataEngineering (ICDE'97), Birmingham, U.K., April 1997, pp. 422–432.
C.T.Yu and W. Meng, Principlesof Database Query Processing for Advanced Applications, Morgan Kaufmann Series in Data Management Systems, Morgan Kaufmann Publishers, 1998.
H.-J. Zhang, S.W. Smoliar, and J.H. Wu, “Development of a video database system,” in Lecture Notes in Computer Science, Vol. 916, Digital Libraries: Current Issues, Digital Libraries Workshop, pp. 253–264, Springer-Verlag, 1994.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Nabil, M., Ngu, A.H. & Shepherd, J. Modeling and Retrieval of Moving Objects. Multimedia Tools and Applications 13, 35–71 (2001). https://doi.org/10.1023/A:1009677223697
Issue Date:
DOI: https://doi.org/10.1023/A:1009677223697