Skip to main content
SpringerLink
Log in

Experiments in Using Visual and Textual Clues for Image Hunting on the Web

  • Conference paper
  • First Online:
Advances in Visual Information Systems (VISUAL 2000)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1929))

Included in the following conference series:

  • 511 Accesses

Abstract

In this paper we describe our experiences with Diogenes, a web-based search agent for finding person images. Diogenes1 implements different ways of combining visual and textual information for identifying person images. The sources of visual information are a face detection and a face recognition module. The textual information is obtained by analyzing the HTML structure and full text of web pages. Four different ways of combining these pieces of information are evaluated experimentally: (1) Face detection followed by text/HTML analysis, (2) face detection followed by face recognition, a linear combination of (1) and (2) and finally, a Dempster-Shafer combination of (1) and (2). We also compare the performance of Diogenes to those of research prototype and commercial image search engines. We report the results of a set of experimental retrievals for 20 persons examining over 30,000 URLs. In these retrievals Diogenes had the best average precision among the search engines evaluated including WebSEEk, AltaVista, Lycos and Ditto.

Research supported in part by NSF grants ISR-9508953 and IIS-9902792

After philosopher Diogenes of Sinope, d.c. 320 B.C. who is said to have gone about Athens with a lantern in day time looking for an honest man.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Y. AlpAslandogan, Charles Thier, Clement T.Yu, Jun Zou, and Naphtali Rishe. Using Semantic Contents and WordNet(TM) in Image Retrieval. In Proceedings of ACM SIGIR Conference, Philadelphia, PA, 1997.

    Google Scholar 

  2. Y. Alp Aslandogan and Clement Yu. Multiple Evidence Combination in Image retrieval: Diogenes Searches for People on the Web. In Proceedings of ACM SIGIR 2000, Athens, Greece, July 2000.

    Google Scholar 

  3. Theo Gevers and Arnold W. M. Smeulders. PicToSeek: A Content-Based Image Search System for the World Wide Web. In Proceedings of SPIE Visual 97, 1997.

    Google Scholar 

  4. Joemon M. Jose, Jonathan Furner, and David J. Harper. Spatial Querying for Image Retrieval: A User Oriented Evaluation. In ACM SIGIR, pages 2320–240,1998.

    Google Scholar 

  5. Michael S. Lew, Kim Lempinen, and Nies Huijsmans. Webcrawling Using Sketches. In Proceedings of SPIE Visual 97, pages 77–84, 1997.

    Google Scholar 

  6. Sougata Mukherjea, Kyoji Hirata, and Yoshinori Hara. AMORE: A World Wide Web Image Retrieval Engine. World Wide Web, 2(3):115–132, 1999.

    Article  Google Scholar 

  7. Olaf Munkelt, Oliver Kaufmann, and Wolfgang Eckstein. Content-based Image Retrieval in theWorld WideWeb: AWeb Agent for Fetching Portraits. In Proceedings of SPIE Vol. 3022, pages 408–416, 1997.

    Article  Google Scholar 

  8. Henry A. Rowley, Shumeet Baluja, and Takeo Kanade. Neural Network-Based Face Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(1):23–38, Jan 1998.

    Article  Google Scholar 

  9. Salton, G. Automatic Text Processing. Addison Wesley Mass., 1989.

    Google Scholar 

  10. Glenn Shafer. A Mathematical Theory of Evidence. Princeton University Press, 1976.

    Google Scholar 

  11. J. R. Smith and S. F. Chang. Visually Searching the Web for Content. IEEE Multimedia, 4(3):12–20, July-September 1997.

    Article  Google Scholar 

  12. Michael J. Swain, Charles Frankel, and Vassilis Athitsos. WebSeer: An Image Search Engine for the World Wide Web. Technical Report TR-96-14, University of Chicago, Department of Computer Science, July 1996.

    Google Scholar 

  13. Leonid Taycher, Marco LaCascia, and Stan Sclaroff. Image Digestion and Relevance Feedback in the ImageRover WWW Search Engine. In Proceedings of SPIE Visual 97, 1997.

    Google Scholar 

  14. M. Turk and A. Pentland. Eigenfaces for Recognition. Cognitive Neuroscience, 3(1):71–86, 1991.

    Article  Google Scholar 

  15. Clement T. Yu and Weiyi Meng. Principles of Database Query Processing for Advanced Applications. Data Management Systems. Morgan Kaufmann, 1998.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of EECS, University of Illinois at Chicago, IL 60607, Chicago, USA

    Yuksel Alp Aslandogan & Clement T. Yu

Authors
  1. Yuksel Alp Aslandogan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Clement T. Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Claude Bernard University of Lyon, LISI - 502, INSA de Lyon, 69621, Villeurbanne Cedex, France

    Robert Laurini

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Alp Aslandogan, Y., Yu, C.T. (2000). Experiments in Using Visual and Textual Clues for Image Hunting on the Web. In: Laurini, R. (eds) Advances in Visual Information Systems. VISUAL 2000. Lecture Notes in Computer Science, vol 1929. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-40053-2_10

Download citation

  • DOI: https://doi.org/10.1007/3-540-40053-2_10

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-41177-2

  • Online ISBN: 978-3-540-40053-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation