Skip to main content
Springer Nature Link
Log in

Rules-By-Example – A Novel Approach to Semantic Indexing and Querying of Images

  • Conference paper
The Semantic Web – ISWC 2004 (ISWC 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3298))

Included in the following conference series:

Abstract

Images represent a key source of information in many domains and the ability to exploit them through their discovery, analysis and integration by services and agents on the Semantic Web is a challenging and significant problem. To date the semantic indexing of images has concentrated on applying machine-learning techniques to a set of manually-annotated images in order to automatically label images with keywords. In this paper we propose a new hybrid, user-assisted approach, Rules-By-Example (RBE), which is based on a combination of RuleML and Query-By-Example. Our RBE user interface enables domain-experts to graphically define domain-specific rules that can infer high-level semantic descriptions of images from combinations of low-level visual features (e.g., color, texture, shape, size of regions) which have been specified through examples. Using these rules, the system is able to analyze the visual features of any given image from this domain and generate semantically meaningful labels, using terms defined in the domain-specific ontology. We believe that this approach, in combination with traditional solutions, will enable faster, more flexible, cost-effective and accurate semantic indexing of images and hence maximize their potential for discovery, re-use, integration and processing by Semantic Web services, tools and agents.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Deng, Y., Manjunath, B.S.: Content-based search of video using color, texture and motion. In: International Conference on Image Processing (ICIP 1997), Washington, DC, USA, October 26-29 (1997)

    Google Scholar 

  2. Marchand-Maillet, S.: Content-Based Video Retrieval: An Overview. University of Geneva, Geneva, Switzerland (2000); Technical Report No. 00.06, CUI

    Google Scholar 

  3. Zhang, H., Wang, A., Altunbasak, Y.: Content-based video retrieval and compression: a unified solution. In: IEEE International Conference on Image Processing, Santa Barbara, CA (October 1997)

    Google Scholar 

  4. Naphade, M.R., et al.: A Factor Graph Framework for Semantic Indexing and Retrieval in Video. In: IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL 2000), Hilton Head, South Carolina, June 16 (2000)

    Google Scholar 

  5. Chang, S.F., Chen, W., Sundaram, H.: Semantic Visual Templates: linking visual features to semantics. In: IEEE International Conference on Image Processing (ICIP 1998), Chicago, Illinois (1998)

    Google Scholar 

  6. Adams, B., et al.: Semantic Indexing of Multimedia Content Using Visual, Audio and Text Cues. EURASIP Journal on Applied Signal Processing (2003)

    Google Scholar 

  7. Zhao, R., Grosky, W.I.: Negotiating The Semantic Gap: From Feature Maps to Semantic Landscapes. Pattern Recognition 35(3), 51–58 (2002)

    Article  Google Scholar 

  8. Marques, O., Barman, N.: Semi-automatic Semantic Annotation of Images Using Machine Learning Techniques. In: International Semantic Web Conference, Florida (October 2003)

    Google Scholar 

  9. Hatala, M., Richards, G.: Value-added Metatagging: Ontology and Rule based Methods for Smarter Metadata. In: Schröder, M., Wagner, G. (eds.) RuleML 2003. LNCS, vol. 2876, pp. 65–80. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  10. ISO/IEC 15938-5 FDIS Information Technology, Multimedia Content Description Interface - Part 5: Multimedia Description Schemes. MPEG7, Sydney (July 2001)

    Google Scholar 

  11. Open Microscopy Environment, OME, http://www.openmicroscopy.org/

  12. FUSION Project, http://metadata.net/sunago/fusion.htm

  13. W3C, XML Schema Specifications (Part 0: Primer, Part 1: Structures, and Part 2: Datatypes), W3C Recommendation (May 2001), http://www.w3.org/XML/Schema#dev

  14. W3C, OWL Web Ontology Language Overview, W3C Recommendation, Edited by Deborah L. McGuinness and Frank van Harmelen (February 10, 2004), http://www.w3.org/TR/owlfeatures/

  15. Lagoze, C., Hunter, J.: The ABC Ontology and Model (v3.0). Journal of Digital Information 2(2) (2001)

    Google Scholar 

  16. Hunter, J.: Adding Multimedia to the Semantic Web - Building an MPEG-7 Ontology. In: International Semantic Web Working Symposium (SWWS), Stanford, July 30 - August 1 (2001)

    Google Scholar 

  17. MPEG-7 Ontology, http://metadata.net/harmony/MPEG7/mpeg7.owl

  18. Swedlow, J.R., et al.: Informatics and Quantitative Analysis in Biological Imaging. SCIENCE 300, 100–102 (2003)

    Article  Google Scholar 

  19. Open Microscopy Environment, OMECoreSemanticTypes.ome (September 4, 2003), http://openmicroscopy.org/XMLschemas/STD/RC2/OMECoreTypes.ome

  20. Noy, N., McGuinness, D.: Ontology development 101: A Guide to Creating Your First Ontology. Stanford University (2001); Technical Report SMI-2001-0880

    Google Scholar 

  21. Nixon, M., Aguado, A.: Feature Extraction and Image Processing, Newnes (2002)

    Google Scholar 

  22. Internet Analysis Tools Registry, http://www.cma.mgh.harvard.edu/iatr/display.php?search_type=all

  23. MathWorks, MATLAB, http://www.mathworks.com/products/imageprocessing/

  24. W3C, SOAP Version 1.2 Part 0: Primer, W3C Recommendation, Edited by Nilo Mitra (June 24, 2003), http://www.w3.org/TR/2003/REC-soap12-part0-20030624/

  25. Christensen, E., et al.: Web Services Description Language (WSDL) 1.1, W3C Note (March 15, 2001), http://www.w3.org/TR/wsdl

  26. The DAML Services Coalition, OWL-S: Semantic Markup for Web Services (May 2003), http://www.daml.org/services/owl-s/1.0/

  27. Staab, S., et al.: Trends & controversies - Where are the rules? Intelligent Systems, IEEE 18(5), 76 (2003)

    Article  Google Scholar 

  28. Hunter, J., Lagoze, C.: Combining RDF and XML Schemas to Enhance Interoperability Between Metadata Application Profiles. In: WWW10, HongKong (May 2001)

    Google Scholar 

  29. Boley, H., Tabet, S., Wagner, G.: Design Rationale of RuleML: A Markup Language for Semantic Web Rules. In: Semantic Web Working Symposium, SWWS (2001)

    Google Scholar 

  30. The Rule Markup Initiative, RuleML, http://www.dfki.uni-kl.de/ruleml

  31. eXtensible Rule Markup Language, XRML, http://xrml.kaist.ac.kr/

  32. Description Logic Markup Language, DLML, http://co4.inrialpes.fr/xml/dlml/

  33. Horrocks, I., et al.: SWRL: A Semantic Web Rule Language Combining OWL and RuleML (November 19, 2003), proposal

    Google Scholar 

  34. Grosof, B.N., et al.: Description Logic Programs: Combining Logic Programs with Description Logic. In: 12th Intl. Conf. on the World Wide Web (WWW-2003), Budapest, Hungary, May 20-23 (2003)

    Google Scholar 

  35. W3C, Mathematical Markup Language (MathML), W3C Proposed Edited Recommendation, Patrick Ion Edited by David Carlisle, Robert Miner and Nico Poppelier (August 4, 2003), http://www.w3.org/TR/2003/PER-MathML2-2003080

  36. Friedman-Hill, E.: Jess, The Expert Shell for the Java Platform, http://herzberg.ca.sandia.gov/jess/

  37. Dietrich, J.: The Mandarax Project, http://www.mandarax.org/

Download references

Author information

Authors and Affiliations

  1. DSTC Pty Ltd, The University of Queensland, St Lucia, Queensland, Australia

    Suzanne Little & Jane Hunter

  2. ITEE Dept, The University of Queensland, St Lucia, Queensland, Australia

    Suzanne Little

Authors
  1. Suzanne Little
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jane Hunter
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, University of Toronto,  

    Sheila A. McIlraith

  2. Institute of Computer Science, FO.R.T.H., Vassilika Vouton, P.O. Box 1385, GR 71110, Heraklion, Greece

    Dimitris Plexousakis

  3. AI Department, Vrije Universiteit Amsterdam, Netherlands

    Frank van Harmelen

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Little, S., Hunter, J. (2004). Rules-By-Example – A Novel Approach to Semantic Indexing and Querying of Images. In: McIlraith, S.A., Plexousakis, D., van Harmelen, F. (eds) The Semantic Web – ISWC 2004. ISWC 2004. Lecture Notes in Computer Science, vol 3298. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30475-3_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30475-3_37

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23798-3

  • Online ISBN: 978-3-540-30475-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation