Skip to main content
SpringerLink
Log in
Book cover

International Workshop on Adaptive Multimedia Retrieval

AMR 2005: Adaptive Multimedia Retrieval: User, Context, and Feedback pp 1–18Cite as

Putting the User in the Loop: Visual Resource Discovery

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3877))

Abstract

Visual resource discovery modes are discussed with a view to apply them in a wide variety of digital multimedia collections. The paradigms include summarising complex multimedia objects such as TV news, information visualisation techniques for document clusters, visual search by example, relevance feedback and methods to create browsable structures within the collection. These exploration modes share three common features: they are automatically generated, depend on visual senses and interact with the user of the multimedia collections.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aggarwal, C., Yu, P.: The IGrid index: reversing the dimensionality curse for similarity indexing in high dimensional space. In: KDD (2000)

    Google Scholar 

  2. Ankerst, M., Keim, D., Kriegel, H.: Circle segments: A technique for visually exploring large multidimensional data sets. In: VIS (1996)

    Google Scholar 

  3. Aslam, J., Montague, M.: Models for metasearch. In: SIGIR (2001)

    Google Scholar 

  4. Assa, J., Cohen-Or, D., Milo, T.: Displaying data in multidimensional relevance space with 2d visualization maps. In: VIS (1997)

    Google Scholar 

  5. Au, P., Carey, M., Sewraz, S., Guo, Y., Rüger, S.: New paradigms in information visualisation. In: SIGIR (2000)

    Google Scholar 

  6. Bainbridge, D., Browne, P., Cairns, P., Rüger, S., Xu, L.-Q.: Managing the growth of multimedia digital content (in preparation, 2005)

    Google Scholar 

  7. Bartell, B., Cottrell, G., Belew, R.: Automatic combination of multiple ranked retrieval systems. In: SIGIR (1994)

    Google Scholar 

  8. Beis, J., Lowe, D.: Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. In: CVPR (1997)

    Google Scholar 

  9. Blei, D., Jordan, M.: Modeling annotated data. In: SIGIR (2003)

    Google Scholar 

  10. Börner, K.: Visible threads: A smart VR interface to digital libraries. In: IST/SPIE (2000)

    Google Scholar 

  11. Campbell, I.: The ostensive model of developing information-needs. PhD thesis, Uni of Glasgow (2000)

    Google Scholar 

  12. Card, S.: Visualizing retrieved information: A survey. IEEE Computer Graphics and Applications 16(2), 63–67 (1996)

    Article  Google Scholar 

  13. Carey, M., Heesch, D., Rüger, S.: Info navigator: a visualization interface for document searching and browsing. In: DMS (2003)

    Google Scholar 

  14. Cha, G.-H.: Bitmap indexing method for complex similarity queries with relevance feedback. In: ACM MMDB workshop (2003)

    Google Scholar 

  15. Chalmers, M., Chitson, P.: Bead: Explorations in information visualisation. In: SIGIR (1992)

    Google Scholar 

  16. Chawda, B., Craft, B., Cairns, P., Rüger, S., Heesch, D.: Do attractive things work better? An exploration of search tool visualisations (in preparation, 2005)

    Google Scholar 

  17. Christel, M., Warmack, A.: The effect of text in storyboards for video navigation. In: ICASSP (May 2001)

    Google Scholar 

  18. Christel, M., Warmack, A., Hauptmann, A., Crosby, S.: Adjustable filmstrips and skims as abstractions for a digital video library. In: ADL (1999)

    Google Scholar 

  19. Cockburn, A., Looser, J., Savage, J.: Around the world in seconds with speed-dependent automatic zooming. In: UIST Conf. supplement (2003)

    Google Scholar 

  20. Cockburn, A., Savage, J.: Comparing speed-dependent automatic zooming with traditional scroll, pan and zoom methods. In: BCS HCI (2003)

    Google Scholar 

  21. Cox, I., Miller, M., Minka, T., Papathomas, T., Yianilos, P.: The Bayesian image retrieval system, PicHunter. IEEE Trans. on Image Processing 9(1), 20–38 (2000)

    Article  Google Scholar 

  22. Cox, K.: Information retrieval by browsing. In: Int’l Conf. on New Information Technology (1992)

    Google Scholar 

  23. Cox, K.: Searching through browsing. PhD thesis, Uni. of Canberra (1995)

    Google Scholar 

  24. Crane, G. (ed.): Perseus Digital Library Project. Tufts Uni., May 30 (2005), http://www.perseus.tufts.edu

  25. Croft, B., Parenty, T.: Comparison of a network structure and a database system used for document retrieval. Information Systems 10, 377–390 (1985)

    Article  Google Scholar 

  26. Cunningham, H.: GATE, a general architecture for text engineering. Computers and the Humanities 36, 223–254 (2002)

    Article  Google Scholar 

  27. Cunningham, H., Maynard, D., Bontcheva, K., Tablan, V.: GATE: A framework and graphical development environment for robust nlp tools and applications. In: ACL (2002)

    Google Scholar 

  28. de Vries, A., Mamoulis, N., Nes, N., Kersten, M.: Efficient k-nn search on vertically decomposed data. In: SIGMOD (2002)

    Google Scholar 

  29. Dearholt, D., Schvaneveldt, R.: Properties of Pathfinder networks. In: Schvaneveldt, R. (ed.) Pathfinder associative networks: Studies in knowledge organization, Norwood (1990)

    Google Scholar 

  30. Duygulu, P., Barnard, K., de Freitas, J.F.G., Forsyth, D.: Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 97–112. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  31. Feng, S., Manmatha, R., Lavrenko, V.: Multiple Bernoulli relevance models for image and video annotation. In: CVPR (2004)

    Google Scholar 

  32. Fowler, R., Wilson, B., Fowler, W.: Information navigator: An information system using associative networks for display and retrieval. Technical Report NAG9-551, 92-1, Dept of Computer Science, University of Texas (1992)

    Google Scholar 

  33. Heesch, D.: The NNk technique for image searching and browsing. PhD thesis, Imperial College London (2005)

    Google Scholar 

  34. Heesch, D., Howarth, P., Magalhães, J., May, A., Pickering, M., Yavlinsky, A., Rüger, S.: Video retrieval using search and browsing. In: TRECVID (2004)

    Google Scholar 

  35. Heesch, D., Pickering, M., Rüger, S., Yavlinsky, A.: Video retrieval using search and browsing with key frames. In: TRECVID (2003)

    Google Scholar 

  36. Heesch, D., Rüger, S.: Performance boosting with three mouse clicks — relevance feedback for CBIR. In: ECIR (2003)

    Google Scholar 

  37. Heesch, D., Rüger, S.M.: NNk networks for content-based image retrieval. In: McDonald, S., Tait, J.I. (eds.) ECIR 2004. LNCS, vol. 2997, pp. 253–266. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  38. Heesch, D., Rüger, S.: Three interfaces for content-based access to image collections. In: Enser, P.G.B., Kompatsiaris, Y., O’Connor, N.E., Smeaton, A.F., Smeulders, A.W.M. (eds.) CIVR 2004. LNCS, vol. 3115, pp. 491–499. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  39. Heesch, D., Rüger, S.: Query-based keyword extraction and document clustering for information retrieval and knowledge consolidation (in preparation, 2005)

    Google Scholar 

  40. Heesch, D., Yavlinsky, A., Rüger, S.: Performance comparison between different similarity models for CBIR with relevance feedback. In: CIVR (2003)

    Google Scholar 

  41. Hemmje, M., Kunkel, C., Willet, A.: Lyberworld — a visualization user interface supporting fulltext retrieval. In: SIGIR (1994)

    Google Scholar 

  42. Hoffman, P., Grinstein, G., Pinkney, D.: Dimensional anchors: A graphic primitive for multidimensional multivariate information visualizations. In: NPIV 1999 (2000)

    Google Scholar 

  43. Howarth, P., Rüger, S.: Trading precision for speed: localised similarity functions. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 415–424. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  44. Ishikawa, Y., Subramanya, R., Faloutsos, C.: MindReader: Querying databases through multiple examples. In: VLDB (1998)

    Google Scholar 

  45. Izquierdo, E., Djordjevic, D.: Using relevance feedback to bridge the semantic gap. In: Detyniecki, M., Jose, J.M., Nürnberger, A., van Rijsbergen, C.J.‘. (eds.) AMR 2005. LNCS, vol. 3877, pp. 19–34. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  46. Jeon, J., Lavrenkoand, V., Manmatha, R.: Automatic image annotation and retrieval using cross-media relevance models. In: SIGIR (2003)

    Google Scholar 

  47. Korfhage, R.: To see or not to see — is that the query? In: SIGIR (1991)

    Google Scholar 

  48. Lavrenko, V., Manmatha, R., Jeon, J.: A model for learning the semantics of pictures. In: NIPS (2003)

    Google Scholar 

  49. Lelescu, A., Wolfson, O., Xu, B.: Approximate retrieval from multimedia databases using relevance feedback. In: SPIRE/CRIWG (1999)

    Google Scholar 

  50. Meilhac, C., Nastar, C.: Relevance feedback and category search in image databases. In: ICMCS (1999)

    Google Scholar 

  51. Metzler, D., Manmatha, R.: An inference network approach to image retrieval. In: Enser, P.G.B., Kompatsiaris, Y., O’Connor, N.E., Smeaton, A.F., Smeulders, A.W.M. (eds.) CIVR 2004. LNCS, vol. 3115, pp. 42–50. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  52. Mori, Y., Takahashi, H., Oka, R.: Image-to-word transformation based on dividing and vector quantizing images with words. In: Int’l Workshop on Multimedia Intelligent Storage and Retrieval Management (1999)

    Google Scholar 

  53. Müller, W., Henrich, A.: Faster exact histogram intersection on large data collections using inverted VA-files. In: Enser, P.G.B., Kompatsiaris, Y., O’Connor, N.E., Smeaton, A.F., Smeulders, A.W.M. (eds.) CIVR 2004. LNCS, vol. 3115, pp. 455–463. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  54. Nene, S., Nayar, S.: A simple algorithm for nearest neighbor search in high dimensions. IEEE Trans. Pattern Anal. Mach. Intell. 19(9), 989–1003 (1997)

    Article  Google Scholar 

  55. Nowell, L., France, R., Hix, D., Heath, L., Fox, E.: Visualizing search results: Some alternatives to query-document similarity. In: SIGIR (1996)

    Google Scholar 

  56. Pickering, M.: Video Retrieval and Summarisation. PhD thesis, Imperial College London (2004)

    Google Scholar 

  57. Pickering, M., Wong, L., Rüger, S.: ANSES: Summarisation of news video. In: CIKM (2003)

    Google Scholar 

  58. Porkaew, K., Ortega, M., Mehrotra, S.: Query reformulation for content based multimedia retrieval in MARS. In: ICMCS (1999)

    Google Scholar 

  59. Rodden, K., Basalaj, W., Sinclair, D., Wood, K.: Evaluating a visualization of image similarity. In: SIGIR (1999)

    Google Scholar 

  60. Rui, Y., Huang, T., Mehrotra, S.: Relevance feedback techniques in interactive content-based image retrieval. In: SPIE (1998)

    Google Scholar 

  61. Rydberg-Cox, J., Chavez, R., Mahoney, A., Smith, D., Crane, G.: Knowledge management in the perseus digital library, Ariadne (2000)

    Google Scholar 

  62. Rydberg-Cox, J., Vetter, L., Rüger, S., Heesch, D.: Approaching the problem of multi-lingual information retrieval and visualization in greek and latin and old norse texts. In: Heery, R., Lyon, L. (eds.) ECDL 2004. LNCS, vol. 3232, pp. 168–178. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  63. Sammon, J.: A nonlinear mapping for data structure analysis. IEEE Trans. on Computers C-18(5) (1969)

    Google Scholar 

  64. Santini, S., Gupta, A., Jain, R.: Emergent semantics through interaction in image databases. IEEE Trans. on Knowledge and Data Engineering 13(3), 337–351 (2001)

    Article  Google Scholar 

  65. Santini, S., Jain, R.: Integrated browsing and querying for image databases. IEEE Multimedia 7(3), 26–39 (2000)

    Article  Google Scholar 

  66. Shaw, C., Kukla, J., Soboroff, I., Ebert, D., Nicholas, C., Zwa, A., Miller, E., Roberts, D.: Interactive volumetric information visualization for document corpus management. Digital Libraries 2(2/3), 144–156 (1999)

    Article  Google Scholar 

  67. Shaw, J., Fox, E.: Combination of multiple searches. In: TREC 3 (1994)

    Google Scholar 

  68. Shneiderman, B., Feldman, D., Rose, A., Ferre’ Grau, X.: Visualizing digital library search results with categorical and hierarchical axes. In: ACM Digital Libraries (2000)

    Google Scholar 

  69. Smeaton, A., Gurrin, C., Lee, H., Mc Donald, K., Murphy, N., O’Connor, N., O’Sullivan, D., Smyth, B., Wilson, D.: The Físchlár-news-stories system: Personalised access to an archive of TV news. In: RIAO (2004)

    Google Scholar 

  70. Spoerri, A.: InfoCrystal: A visual tool for information retrieval & management. In: CIKM (1993)

    Google Scholar 

  71. Squire, D., Müller, W., Müller, H., Pun, T.: Content-based query of image databases: inspirations from text retrieval. Pattern Recognition Letters 21(13-14), 1193–1198 (2000)

    Article  MATH  Google Scholar 

  72. Torralba, A., Oliva, A.: Statistics of natural image categories. Network: Computation in Neural Systems 14, 391–412 (2003)

    Article  Google Scholar 

  73. Torres, R., Silva, C., Medeiros, C., Rocha, H.: Visual structures for image browsing. In: CIKM (2003)

    Google Scholar 

  74. TRECVID. Trec video retrieval evaluation (2005), http://www-nlpir.nist.gov/projects/trecvid/

  75. van Dongen, S.: A cluster algorithm for graphs. Technical Report INS-R0010, National Research Institute for Mathematics and Computer Science in the Netherlands (2000)

    Google Scholar 

  76. Watts, D., Strogatz, S.: Collective dynamics of ’small-world’ networks. Nature 393, 440–442 (1998)

    Article  Google Scholar 

  77. Weber, R., Stock, H.-J., Blott, S.: A quantitative analysis and performance study for similarity search methods in high-dimensional space. In: VLDB (1998)

    Google Scholar 

  78. Wolf, J.: GeoBrowser: A graphical approach to geo-temporal news browsing. Master’s thesis, Imperial College London (2005)

    Google Scholar 

  79. Wood, M., Campbell, N., Thomas, B.: Iterative refinement by relevance feedback in content-based digital image retrieval. In: ACM Multimedia (1998)

    Google Scholar 

  80. Yavlinsky, A., Pickering, M., Heesch, D., Rüger, S.: A comparative study of evidence combination strategies. In: ICASSP (2004)

    Google Scholar 

  81. Yavlinsky, A., Schofield, E., Rüger, S.: Automated image annotation using global features and robust nonparametric density estimation. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 507–517. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  82. Zhou, M., Feiner, S.: Visual task characterization for automated visual discourse synthesis. In: CHI (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computing, South Kensington Campus, Imperial College London, London, SW7 2AZ, UK

    Stefan Rüger

Authors
  1. Stefan Rüger
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Laboratoire d’Informatique de Paris 6, France

    Marcin Detyniecki

  2. Department of Computer Science, University of Glasgow, 17 Lilybank Gardens, G12 8QQ, Glasgow, UK

    Joemon M. Jose

  3. Fakultät für Informatik, Otto-von-Guericke Universität Madgeburg, Universitätsplatz 2, 39106, Germany

    Andreas Nürnberger

  4. Department of Computing Science, University of Glasgow, G12 8QQ, Glasgow, UK

    C. J. van Rijsbergen

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rüger, S. (2006). Putting the User in the Loop: Visual Resource Discovery. In: Detyniecki, M., Jose, J.M., Nürnberger, A., van Rijsbergen, C.J. (eds) Adaptive Multimedia Retrieval: User, Context, and Feedback. AMR 2005. Lecture Notes in Computer Science, vol 3877. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11670834_1

Download citation

  • DOI: https://doi.org/10.1007/11670834_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-32174-3

  • Online ISBN: 978-3-540-32175-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation