Abstract
Rapid advances in multimedia technology necessitate the development of a generic multimedia information system with a powerful retrieval engine for prototyping multimedia applications. We develop a content-based retrieval engine (CORE) that makes use of novel indexing techniques for multimedia object retrieval. We formalize the concepts related to multimedia information systems such as multimedia objects and content-based retrieval. We bring out the requirements and challenges of a multimedia information system. The architecture of CORE is described in detail along with the associated retrieval mechanisms and indexing techniques. Various modules developed for efficient retrieval are presented with some APIs. The efficacy of CORE is demonstrated in the development of two multimedia systems, a computer-aided facial image inference and retrieval (CAFIIR) system and a system for trademark archival and retrieval (STAR), which have been developed at the Institute of Systems Science (ISS). We expect that CORE will be useful for effective prototyping of other such multimedia applications.
Similar content being viewed by others
References
Bach J, Paul S, Jain R (1993) A visual information management system for the interactive retrieval of faces. IEEE Trans Knowledge Data Eng 5:619–628
Bandemer H, Nather W (1992) Fuzzy data analysis Kluwer Academic, Dordrecht
Berra PB, Chen CYR, Ghafoor A, Lin CC, Little TDC, Shin D (1990) Architecture for distributed multimedia database systems. Comput Commun 13:217–231
Binaghi E, Ventura AD, Rampini A, Schettini R (1993) Fuzzy reasoning approach to similarity eEvaluation in image analysis (1993) Int J Intelligent Syst 8: 749–769
Chang S, Fu KS (1980) Query by pictorial example. IEEE Trans Software Eng 6:519–524
Chang S, Fu KS (1981) Picture query languages for pictorial database systems. IEEE Computer 14:23–33
Chang SK, Hsu A (1992) Image information systems: where do we go from here? IEEE Trans Knowledge Data Eng 4:431–442
Chang SK, Yan C, Dimitroff DC, Arndt T (1988) An intelligent image database system. IEEE Trans Software Eng 14: 681–688
Desai AN (1994) Model and architecture for multimedia information systems. Real World Computing Technical Report RWC Novel Function Institute of Systems Science Laboratory, Singapore, pp 10–24
Fayyad UM, Smyth P (1993) Image database exploration: progress and challenges. Proceedings of the AAAI Workshop on Knowledge Discovery in Databases, pp 100–108
Gao YJ, Lim JJ, Desai AN (1994) Fuzzy multilinkage thesaurus builder, Technical Report, Institute of Systems Science, National University of Singapore, Singapore
Grosky WI (1994) Multimedia information systems. IEEE Multimedia 12–24
Grosky WI, Mehrotra R (1990) Index-based object recognition in pictorial data management. Comput Vis Graph Image Processing 52:416–436
Hornk K, Stinchocombe M, White H (1989) Multi-layer feedforward networks are universal approximators. Neural Networks 2:359–366
Jain Ramesh, NSF (1992) Workshop on visual information management systems, Workshop Report, Computer Science and Engineering Division, The University of Michigan, Ann Arbor, Mich
Kim K (1993) On object-oriented database technology. UniSQL, Technical Report 9390, Austin, Tex
Kohonen T (1984) Self-organization and associative memory. Springer, Berlin Heidelberg New York
Li D, Liu D (1990) A fuzzy PROLOG database system. Research Studies Press Taunton, Somerset, England
Lim JJ (1992) Free text databases. Technical Report Institute of Systems Science, National University of Singapore, Singapore
McKeown D (1993) MAPS: the organization of a spatial database using imagery, terrain and map data. Technical Report CMU-CS-83-136, Carnegie-Mellon University, Pittsburgh
Mehtre BM, Kankanhalli MS, Desai AN, Man GC (1995) Color matching for image retrieval, Patt Recogn Lett (to appear)
Pentland A, Picard RW, Sclaroff S, Photobook: tools for content based manipulation of image databases. SPIE Conference on Storage and Retrieval of Image and Video Databases II, 2195, FEB 1994, pp 1–13
Petrakis EGM, Orphanoudakis SC (1993) Methodology for the representation, indexing and retrieval of images by content. Image Vis Comput 11:504–520
Smoliar SW, Zhang HJ (1994) Content-based video indexing and retrieval. IEEE Multimedia, 1:2, 62–72
Stonebraker M, Frew J, Dozier J (1993) The SEQUOIA 2000 project. Third International Symposium, SDD Springer Singapore, p 389
Swain MJ, Ballard DH (1991) Color indexing. Int J Comput Vis 7:11–32
Tversky A, Features of similarity. Psychol Rev 84:327–352
Wu JK (1990) LEP — a neural network model learning based on experiences and perspectives. International Conference on Neural Networks, Paris p 389
Wu JK (1994) Neural networks and simulation. Marcel Dekker, New York
Wu JK (1994) Indexing complex feature using LEP neural network. Real World Computing Symposium, Tokyo, pp40–43
Wu JK, Desai AN (1993) Fuzzy retrieval of image databases. Proceedings of the First Asian Fuzzy Systems Symposium, Singapore, pp41–49
Wu JK, Desai AN (1994) Fuzzy content-based image databases, submitted to Information Processing and Management, Singapore
Wu JK, Gao F, Yang P (1992) Model-based 3D object recognition. Proceedings of the Second International Conference on Automation, Robotics and Computer Vision, Singapore, pp 221–226
Wu JK, Ang YH, Lam CP, Loh HH, Desai AN (1994) Inference and retrieval of facial images. ACM Multimedia J 2:1–14
Wu JK, Mehtre BM, Gao YJ, Lam PC, Desai AN (1994) STAR — a multimedia database system for trademark registration. Applications of Databases, Lecture Notes in Computer Science, Vol 819. In: Witold Litwin and Tore Risch (eds) Proceedings of the 1st International Conference, ADB-94, Vadstena, Sweden. Srpringer Berlin Heidleberg New York, pp 109–122
Yoshitaka A, Kishida S, Hirakawa M, Ichikawa T (1994) Knowledge-assisted content-based retrieval for multimedia databases. Proceedings of the International Conference on Multimedia Computing and Systems, Boston, Mass. pp 131–139
Zink A, Jaffe CC (1993) Medical imaging databases. Invest Radiol 28:366–372
Zimmermann HJ (1985) Fuzzy set theory — and its applications Kluwer-Nijhoff
Author information
Authors and Affiliations
Corresponding author
Additional information
Mainly supported by National Science & Technology Board of Singapore
Partly working in Real World Computing Partnership, Novel Function Institute of Systems Science Laboratory since April 1994.
Rights and permissions
About this article
Cite this article
Wu, J.K., Narasimhalu, A.D., Mehtre, B.M. et al. CORE: a content-based retrieval engine for multimedia information systems. Multimedia Systems 3, 25–41 (1995). https://doi.org/10.1007/BF01236577
Issue Date:
DOI: https://doi.org/10.1007/BF01236577