Skip to main content
SpringerLink
Log in

Analysis and Description of the Semantic Content of Cell Biological Videos

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

We present a system for extracting and organizing semantic content metadata from biological microscopy videos featuring living cells. The system uses image processing and understanding procedures to identify objects and events automatically within the digitized videos, thus leading to the generation of content information (semantic metadata) of high information value by automated analysis of their visual content. When such metadata are properly organized in a searchable database conformed with our proposed model, a content-based video query and retrieval system may be developed to locate particular objects, events or behaviours. Furthermore these metadata can be applied to find hidden semantic relationships such as correlations between behavioural alterations and changes in environmental conditions of cells. The suitability and functionality of the proposed metadata organizational model is demonstrated by the automated analysis of five different types of biological experiments, recording epithelial wound healing, bacterial multiplication, the rotations of tethered bacteria, and the swimming of motile bacteria and of human sperm. We have named our prototype analytical system VAMPORT (video automated metadata production by object recognition and tracking). We conclude that the use of an audiovisual content description standard such as MPEG7 will contribute valuably towards the interoperability of the system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. D.H. Ballard and C.M. Brown, Computer Vision, Prentice Hall, 1982, pp. 143–146.

  2. T. Boudier and D.M. Shotton, "Video on the Internet: An introduction to the digital encoding, compression and transmission of moving image data," J. Struct. Biol., Vol. 125, pp. 133–155,1999

    Google Scholar 

  3. J.M. Carazo and E.H.K. Stelzer, "The bioImage database project: Organizing multi-dimensional biological images in an object-relational database," J. Struct. Biol., Vol. 155, pp. 97–102,1999

    Google Scholar 

  4. N. Day, MPEG-7 Applications Document. ISO/IEC JTC1/SC29/WG11 N4676,2002 Available at http://mpeg.telecomitalialab.com/working documents.htm#MPEG-7.

  5. N. Day and J.M. Martýnez, Introduction to MPEG-7 (v4.0), 2002 available at: http://mpeg. telecomitalialab.com/working documents.htm#MPEG-7.

  6. A. Del Bimbo, V. Castelli, S.-F. Chang, and C.-S. Li (Eds.), Content Based Access of Images and Video Libraries, Special Issue of Computer Vision and Image Understanding, Vol. 75, pp. 1–213, 1999 (doi: 10._1006/cviu.1999.0775).

  7. GlaxoWellcome Experimental Research Group, The Global Image Database, formerly available at: http://www.gwer.ch/qv/gid/gid.htm, but discontinued following merger with SmithKleinBeecham.

  8. N. Guil, J.M. Gonzalez, and E.L. Zapata, "Bidimensional shape detection using an invariant approach," J. Pattern Recognition, Vol. 32, pp. 1025–1038,1999

    Google Scholar 

  9. A. Hampapur, A. Gupta, B. Horowitz, S. Chiao Fe, C. Fuller, J. Bach, M. Gorkani, and R. Jain, "The Virage video engine," in Proceedings of the SPIE, the International Society for Optical Engineering, Vol. 3022, 1997, pp. 188–198.

    Google Scholar 

  10. Virage Inc. http://www.virage.com

  11. G. Hobson, Hobson Tracker User Manual, Hobson Tracking Systems Ltd., 697 Abbey Lane, Sheffield S11 9ND, UK,1996

  12. J.W. Lewis, "The effects of colchicine and brefeldin A on the rate of experimental in vitro epithelial wound healing," Undergraduate research project dissertation, University of Oxford,1994

  13. J.W. Lewis and D.M. Shotton, "Effects of colchicine and brefeldin A on the rate of experimental in vitro epithelial wound healing," in Proc. 4th Annual Meeting European Tissue Repair Soc., Oxford.,1994 p. 230.

  14. J.W. Lewis and D.M. Shotton, "Time-lapse video microscopy of wound healing in epithelial cell monolayers: Effects of drugs that induce microtubule depolymerization and Golgi disruption," Proc. Roy. Microscop. Soc., Vol. 30, pp. 134–135,1995

    Google Scholar 

  15. J. Machtynger and D.M. Shotton, "VANQUIS, a system for the interactive semantic content analysis and spatio-temporal query by content of videos," J. Microscopy, Vol. 205, pp. 43–52,2002

    Google Scholar 

  16. M. Manson, J. Armitage, J. Hoch, and R. Macnab, "Bacterial locomotion and signal transduction," J. Bacte-riology, Vol. 180, pp. 1009–1022,1998

    Google Scholar 

  17. J. M. Martinez (Ed.), Overviewof the MPEG-7 Standard. ISO/IEC JTC 1/SC29/WG11/ N5525, 2003 available at: http://www.chiariglione.org/mpeg/standards/mpeg-7/mpeg-7.htm

  18. J.M. Martinez, R. Koenen, and F. Pereira, MPEG-7: The Generic Multimedia Content Description standard, 2002, available at: http://www.chiariglione.org/mpeg/events&tutorials/IEEEMM mp7overview withcopyright.pdf

  19. F. Nack and A.T. Lindsay, "Everything you wanted to know about MPEG-7: Part 1," IEEE Multimedia, Vol. 6, pp. 65–77,1999

    Google Scholar 

  20. National Centre for Geographic Information, Ministerio de Fomento, Spain, Cartographic Publishing and Service Catalogue, 2000, available at: http://www.cnig.ign.es.

  21. S. Panchanathan and B. Liu (Eds.), Indexing, Storage, Browsing, and Retrieval of Images and Video. Special Issue of Journal of Visual Communication and Image Representation, Vol. 7, pp. 305–423, 1996 (doi:10.1006/jvci.1996.0026).

  22. N. Paskin, "Towards unique identifiers," Proceedings IEEE, Vol. 87, pp. 1208–1227,1999

    Google Scholar 

  23. N. Paskin, The DOI Handbook,2000 Available at: http://www.doi.org/handbook 2000/index.html.

  24. A. Rodriguez, D.M. Shotton, N. Guil, and O. Trelles, "Automatic tracking of moving bacterial cells in scientific videos," in Proc. RIAO 2000, 6th Conference on Content-Based Multimedia Information Access, College de France, Paris, April 2000, available at: http://www.ac.uma.es/inv-des/inves/reports/2000.html

  25. A. Rodriguez, D.M. Shotton, O. Trelles, and N. Guil, "Automatic feature extraction in wound healing videos," in Proc. RIAO 2000, 6th Conference on Content-Based Multimedia Information Access, College de France, Paris, April 2000, available at: http://www.ac.uma.es/inv-des/inves/reports/2000.html

  26. G. Rust, Metadata: The right approach. D-Lib Magazine, July 1998, available at: http://www.dlib.org/dlib/july98/rust/07rust.html.

  27. G. Rust and M. Bide, "The INDECS metadata framework: Principles, model and data dictionary," Wp1a-006-2.0, June2000

  28. P. Salembier, "Audiovisual content description and retrieval: Tools and MPEG-7 standardization activities," Tutorial: IEEE Int. Conf. on Image Processing, ICIP-2000, Vancouver, Canada, 10 Sept.2000

  29. P. Salembier, J. Llach, and L. Garrido, "Visual segment tree creation for MPEG-7 Description Schemes," Pattern Recognition, Vol. 35, pp. 563–579,2002

    Google Scholar 

  30. A. Sanfeliu, J.J. Villanueva, M. Vanrell, R. Alquézar, J.-O. Eklundh, Y. Aloimonos, A.K. Jain, J. Kittler, T. Huang, J. Serra, J. Crowley, and Y. Shirai (Eds.), in Proc. ICPR2000, 15th International Conference on Pattern Recognition, Barcelona (Sept. 4-7, 2000), Vol. 1, pp. 1-1134: Computer vision and image analysis; Vol. 2, pp. 1-1076: Pattern recognition and neural networks; Vol. 3, pp. 1-1165: Image, speech and signal processing; and Vol. 4, pp. 1-888: Applications, Robotic Systems and Architectures.

  31. D.M. Shotton and A. Attaran, "Variant antigenic peptide promotes cytotoxic T lymphocyte adhesion to target cells without cytotoxicity," Proc. Natl. Acad. Sci. USA, Vol. 95, pp. 15571–15576,1998

    Google Scholar 

  32. D.M. Shotton, A. Rodriguez, N. Guil, and O. Trelles, "Analysis and content-based querying of biological microscopy videos," in Proc. ICPR2000, 15th International Conference on Pattern Recognition, Barcelona, September 4-7 2000, available at: http://www.ac.uma.es/inv-des/inves/reports/2000.html

  33. D. M. Shotton, A. Rodriguez, N. Guil, and O. Trelles, "A metadata classification schema for semantic content analysis of videos," J. Microscopy, Vol. 205, pp. 33–42,2002

    Google Scholar 

  34. J.L. Sussman, D. Lin, J. Jiang, N.O. Manning, J. Prilusky, O. Ritter, and E.E. Abola, "Protein Data Bank (PDB): Database of three-dimensional structural information of biological macromolecules," Acta Crystallogr. D., Vol. 54, pp. 1078–1084,1998

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Architecture Department, University of Malaga, ETSI Informática, Campus de Teatinos, 29017 Malaga, Spain.

    A. Rodríguez, N. Guil & O. Trelles

  2. Image Bioinformatics Laboratory, Department of Zoology, University of Oxford, South Parks Road, Oxford OX1 3PS, UK.

    D.M. Shotton

Authors
  1. A. Rodríguez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. N. Guil
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. D.M. Shotton
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. O. Trelles
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rodríguez, A., Guil, N., Shotton, D. et al. Analysis and Description of the Semantic Content of Cell Biological Videos. Multimedia Tools and Applications 25, 37–58 (2005). https://doi.org/10.1023/B:MTAP.0000046381.73660.64

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:MTAP.0000046381.73660.64

Search

Navigation