Skip to main content
Springer Nature Link
Log in

DAG-based visual interfaces for navigation in indexed video content

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Indexing and segmenting of video content by motion, color and texture has been intensively explored leading to a commonly used representation in a storyboard. In this paper, a novel method of visualization of video content is proposed. First of all, the content is segmented into shots, and then a spatio-temporal color signature of shots, based on color distribution in the frames, is proposed. This spatio-temporal color signature serves as a basis for graph clustering and graph visualization tools. Those, integrated in a platform for visualization of huge graphs, Tulip, supply an exciting graph-based navigation interface for multimedia content. The results obtained on feature documentaries are promising.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. Download at www.tulip-software.org

References

  1. Adami N, Bugatti A, Leonardi R, Migliorati P, Rossi L (2000, June) Describing multimedia documents in natural and semantic-driven ordered hierarchies. Proc. ICCASP'2000. Istambul, Turkey IV:2023–2026

  2. Auber D (2002, September 25–28) Using Strahler numbers for real time visual exploration of huge graphs. International Conference on Computer Vision and Graphics, Zakopane, Poland:56–69

  3. Auber D Tulip a huge graphs visualization framework, Graph drawing software. In: P. Mutzel M. Jünger (ed) Springer Mathematics and Visualization series:105–126

  4. Auber D, Delest M, Chiricota Y (2004, July 14–16) Strahler based graph clustering using convolution, IV04 (8th International Conference on Information Visualization), London:44–51

  5. Barbieri M, Mekenkamp G, Ceccarelli MP, Nesvadba J (2001, August 22–25) The color browser: a content driven linear video browsing tool. ICME 2001 (Int. Conf. on Multimedia and Expo), Tokyo, Japan:627–630

  6. Benois-Pineau J, Dupuy W, Barba D (2001, September) Re-covering of visual scenarios in movies by motion analysis and grouping spatio-temporal colors signatures of video shots. Eusflat 2001 (Internationnal Conference on Fuzzy Logic and Technology), Leicester:385–389

  7. Coudert F, Benois-Pineau J, Le Lann P-Y, Barba D (1999, June 7–11) ‘Binkey: a system of video content analysis ‘on the fly’ for video indexing’, IEEE ICMCS'99, Florence, Italy:679–684

  8. Delest M, Don A, Benois-Pineau J (2003) Graph-based visual interfaces for navigation in indexed video content. Proc. CBMI'03, Rennes, France:49–55

  9. Ershov AP (1958) On programming of arithmetic operations. Com of the ACM 8:3–6

    Article  MATH  Google Scholar 

  10. Gray RM (1984) Vector quantization. IEEE ASSP Magazine, April:4–28

  11. Guidelines for the TRECVID 2004 Evaluation, Story segmentation, http://www-nlpir.nist.gov/projects/tv2004/.

  12. ISO/IEC JTC 1/SC 29/WG 11/M6156, MPEG-7 Multimedia Description Schemes WD (Version 3.1), Beijing, July 2000

  13. Joly P, Kim H-K (1996) Efficient automatic analysis of camera work and micro-segmentation of video using spatio-temporal images. Signal Processing: Image Communication 8:295–307

    Article  Google Scholar 

  14. Mac Queen J (1965/1966) Some methods for classifications and analysis of multivariate observations. Proc. 5th Berkeley Symp Math Stat Prob:281–297

  15. Manerba F, Benois-Pineau J, Leonardi R (2004, 18–22 January) Extraction of foreground objects from a MPEG2 video stream in rough indexing framework. In Proc. storage and retrieval methods and applications for multimedia 2004, EI'2004 SPIE, San Jose, California 5307:50–60

  16. Meiers T, Sikora T, Keller I (2002) 3D browsing environment for MPEG-7 image databases. Proc SPIE Storage and Retrieval for Media Databases 4676:324–335

    Google Scholar 

  17. Shneiderman B (1996) The eyes have it: a task by data type taxonomy for information visualization. IEEE Conf. on Visual Languages, Boulder:336–343

  18. Strahler AN (1952) Hypsomic analysis of erosional topography. Bull Geol Soc Am 63:1117–1142

    Google Scholar 

  19. Tonomura Y, Akutsu A, Otsui K, Sadakata T (1993) ‘Videomap and videoSpaceIcon: tools for anatomizing video content’. Proc. InterChi'93, ACM:131–136

  20. Yeung M, Yeo B-L (1996, August) Time-constrained clustering for segmentation of video into story units. Proc ICPR'96 3:375–380

    Google Scholar 

Download references

Acknowledgments

This work has been supported by a research grant of Region Aquitaine, France and by national French network in multimedia indexing “Pidot”. We would like to thank Professor Robson (LaBRI) who improved the English style of this paper.

Author information

Authors and Affiliations

  1. LaBRI CNRS UMR 5800/Université Bordeaux 1, Bordeaux, France

    Maylis Delest, Anthony Don & Jenny Benois-Pineau

Authors
  1. Maylis Delest
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Anthony Don
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Jenny Benois-Pineau
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Maylis Delest.

Additional information

This work was supported by the Conseil Régional d'Aquitaine and the STIC Department of the “Centre National de la Recherche Scientifique.”

Rights and permissions

Reprints and permissions

About this article

Cite this article

Delest, M., Don, A. & Benois-Pineau, J. DAG-based visual interfaces for navigation in indexed video content. Multimed Tools Appl 31, 51–72 (2006). https://doi.org/10.1007/s11042-006-0032-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-006-0032-4

Keywords