Skip to main content
SpringerLink
Log in

Multimedia Data Modeling Through a Semantic View Mechanism

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

The semantics of multimedia data, which features context-dependency and media-independency, is of vital importance to multimedia applications but inadequately supported by the state-of-the-art database technology. In this paper, we address this problem by proposing MediaView as an extended object-oriented view mechanism to bridge the “semantic gap” between conventional databases and semantics-intensive multimedia applications. This mechanism captures the dynamic semantics of multimedia using a modelling construct named media view, which formulates a customized context where heterogeneous media objects with similar/related semantics are characterized by additional properties and user-defined semantic relationships. Due to the complex ingredients and dynamic application requirements of multimedia databases, it is however difficult for users to define by themselves individual media views in a top–down fashion. To this end, a unique approach of constructing media views logically is devised. In addition, a set of user level operators is defined and implemented to accommodate the specialization and generalization relationships among the views. The usefulness and elegancy of MediaView are demonstrated by its application in a multi-modal information retrieval system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abiteboul, S., Bonner, A.: Objects and Views. In Proc. of ACM SIGMOD Conf. on the Management of Data, 238–247 (1991)

  2. Adiba, M.: STORM: Structural and Temporal Object-Oriented Multimedia Database Systems. IEEE Int. Workshop on Multimedia DBMS, NY, USA, August, (1995)

  3. Apers, P., Blanken, H., Houtsma, M. (eds.): Multimedia Databases in Perspective. Springer, London (1997)

  4. Benitez, A.B., Smith, J.R., Chang, S.F.: MediaNet: A Multimedia Information Network for Knowledge Representation”. Proceeding of the SPIE 2000 Conference on Internet Multimedia Management Systems, 4210, (2000)

  5. Bertino, E., Catania, B., Ferrari, E.: Query processing. In: Apers, P.M.G., Blanken, H.M., Houtsma, M.A.W. (eds.) Multimedia Databases in Perspective. vol 181–217Springer, Berlin/Heidelberg (1997)

    Google Scholar 

  6. Eisenberg, A., Melton, J.: SQL Multimedia and Application Packages (SQL/MM). ACM SIGMOD Record 30(4), Dec. 2001

  7. Faloutsos, C.: Indexing of multimedia data. In: Burkhard, W.A., Keller, R.M. (eds.) Multimedia Databases in Perspective. vol 219–245Springer, Berlin/Heidelberg (1997)

    Google Scholar 

  8. French, J.C., Watson, J.V.S., Jin, X., Martin, W.N.: Integrating Multiple Multi-channel CBIR Systems. International Work Shop on Multimedia Information System (MIS’03), Ischia, Italy, May 2003

  9. Hauptmann, A., et al.: Video Classification and Retrieval with the Informedia Digital Video Library System. Text Retrieval Conference (TREC02), Gaithersburg, MD, 2002

  10. Heiler, S., Zdonik, S. B.: Object views: Extending the vision. Proc. of Int’l Conf. on Data Eng. (ICDE’90), pp. 86–93, Feb, 1990, IEEE

  11. ISO/IEC, MPEG-7 Overview: http://www.chiariglione.org/mpeg/standards/mpeg-7/mpeg-7.htm (2006)

  12. Kim, W.: Object-Oriented Database Systems: Promises, Reality, and Future. Proc. of 19th Very Large Database, 676–687 (1993)

  13. Kim, W., Garza, J.F., Ballou, N., Woelk, D.: Architecture of the ORION Next-Generation Database System. IEEE Trans. Knowl. Data Eng. 2, (1), 109–124 (1990)

    Article  Google Scholar 

  14. Klas, W., Bool, S., Lohr, M.: Integrated database services for multimedia presentation. Multimedia Information Storage and Management. Kluwer Academic, USA (1996)

    Google Scholar 

  15. Li, Q., Özsu, M.T.: Editorial: Introduction to web media information systems (special issue on web media information systems). World Wide Web. 5, (3), 179–180 (2002)

    Article  Google Scholar 

  16. Li, Q., Yang, J., Zhuang, Y. MediaView: A Semantic View Mechanism for Multimedia Modeling. Proceedings of the Pacific Rim Conference on Multimedia (PCM’02), pp. 729–736, IEEE, 2002.

  17. Lu, Y., Hu, C.H., Zhu, X.Q., Zhang, H.J., Yang, Q. A Unified Framework for Semantics and Feature Based Relevance Feedback in Image Retrieval Systems. In: Proceedings of the 8th ACM Multimedia conference, 2000

  18. Miller, G.A.: WordNet: A lexical database for English. Comm. ACM. 38, (11), 39–41 (1995) Nov

    Article  Google Scholar 

  19. NCITS H2, SQL:1999, available from: http://www.service-architecture.com/database/articles/sql1999.html

  20. Oomoto, E., Tanaka, K.: OVID: Design and implementation of a video-object database system. In IEEE Trans. Knowl. Data Eng. 5, 629–641 (1993)

    Article  Google Scholar 

  21. Rundensteiner, E. A.: MutiView: A Methodology for Supporting Multiple Views in Object-Oriented Databases. Proc. of the 18th Conf. on Very Large Database, Canada (1992)

  22. Santini, S., Jain, R.: Interface for emergent semantics in multimedia database. Proceedings of the IS&T/SPIE Conference on Storage and Retrieval for Image and Video Database 167–175 (1999)

  23. Scholl, M.H., Lassch, C., Tresch, M.: Updateable Views in Object-Oriented Databases. Proceedings of the 2nd DOOD Conference, Germany, Dec. 1991

  24. Smith, J.: MPEG-7 multimedia content description standard. In: Feng, D., Siu, W.C., Zhang, H.J. (editors), Multimedia Information Retrieval and Management, Chap. 6, Springer, (2003).

  25. Smith, J.R., Chang, S.F.: Visually searching the Web for content. IEEE Multimedia. Magazine. 4, (3), 12–20 (1997)

    Article  Google Scholar 

  26. Song, Y., Wang, W., Zhang, A.: Automatic annotation and retrieval of images. World. Wide. Web. 6, (2), 209–231 (2003)

    Article  Google Scholar 

  27. Tanaka, K., Yoshikawa, M., Ishihara, K.: Schema Virtualization in Object-Oriented Databases. Proceedings of the Int’l Conf. on Data Engineering (ICDE’88), 23–30, Feb, IEEE (1988)

  28. Tansley, R.: The Multimedia Thesaurus: An Aid for Multimedia Information Retrieval and Navigation. Master Thesis, Computer Science. University of Southampton, UK (1998)

  29. W3C, Extensible Markup Language (XML) 1.0 (Fourth Edition): http://www.w3.org/TR/REC-xml/ (2006)

  30. Wu, F., Zhang, H., Zhuang, Y-T.: Learning Semantic Correlations for Cross-Media Retrieval. ICIP:1465–1468, 2006

  31. Yang, J., Li, Q., Liu, W., Zhuang, Y.: Searching for flash movies on the Web: A content and context based framework. World Wide Web 8, (4), 495–517 (2005)

    Article  Google Scholar 

  32. Yang, J., Li, Q., Zhuang, Y.T.: Octopus: Aggressive Search of Multi-Modality Data Using Multifaceted Knowledge Base. Proceedings of the 11th International Conference on World Wide Web (WWW’02):54–64 (2002)

  33. Zakos, J., Verma, B.: A novel context-based technique for Web information retrieval. World Wide Web 9, (4), 485–503 (2006)

    Article  Google Scholar 

  34. Zhang, H., Chen, Z., Li, M., Su, Z.: Relevance feedback and learning in content-based image search. World Wide Web 6, (2), 131–155 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Mathematics, Physics and Information Engineering, Zhejiang Normal University, Jinhua, China

    Qing Li, Jianmin Zhao & Xinzhong Zhu

Authors
  1. Qing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianmin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xinzhong Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qing Li.

Additional information

Main part of the work by this Qing Li was done when he was on leave from City University of Hong Kong, HKSAR, China.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, Q., Zhao, J. & Zhu, X. Multimedia Data Modeling Through a Semantic View Mechanism. World Wide Web 11, 287–311 (2008). https://doi.org/10.1007/s11280-008-0045-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-008-0045-1

Keywords

Search

Navigation