Skip to main content
SpringerLink
Log in

Creating a clickable TV program by sketching and tracking freeform triggers

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Viewers watching Interactive TV can click on video objects on the screen, connecting them to an advertisement or more detailed content. But this requires an interactive authoring process to attach triggers to clickable objects, which is time-consuming because these objects can appear intermittently, move, and change shape. We facilitate authoring by combining a sketching interface with shot-based object tracking and trigger verification. Experiments involving professional video authors and non-specialist viewers suggest that this approach is an improvement on previous methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Alper Y, Omar J, Mubarak S (2006) Object tracking: a survey. ACM Computing Surveys (CSUR) 38(4): Article no. 13

  2. Bai X, Wang J, Simons D, Sapiro G (2009) Video SnapCut: robust video object cutout using localized classifiers. ACM Transactions on Graphics (TOG) 28(3): Article no. 70

  3. Bradski G (1998) Computer video face tracking for use in a perceptual user interface. Intel Technology Journal Q2 ’98, pp. 1–15

  4. Cattelan RG, Teixeira C, Goularte R, Pimentel MDGC (2008) Watch-and-comment as a paradigm toward ubiquitous interactive video editing. Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) 4(4): Article no. 28

  5. Cesar P, Bulterman DCA, Jansen J, Geerts D, Knoche H, Seager W (2009) Fragment, tag, enrich, and send: enhancing social sharing of video. Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) 5(3): Article no. 19

  6. Dan BG, Chris G, Brian C, David S, Steven MS (2008) Video object annotation, navigation, and composition. In: Proceedings of the 21st annual ACM symposium on User interface software and technology, pp 3–12

  7. David D, Thomas P (1973) Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. The Canadian cartographer 10:112–122

    Google Scholar 

  8. Finke M, Balfanz D (2004) A reference architecture supporting hypervideo content for ITV and the internet domain. Computers and graphics 28:179–191

    Article  Google Scholar 

  9. Frank S, Andreas G, Lynn W (2008) Authoring, viewing, and generating hypervideo: An overview of Hyper-Hitchcock. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) 5(2): Article no. 15

  10. GPAC, http://gpac.sourceforge.net

  11. Huitao L, Alexandros E (2002) An interactive authoring system for video object segmentation and annotation. Signal processing: image communication 17:559–572

    Article  Google Scholar 

  12. IBM MPEG-4 Technologies, IBM MPEG-4 XMT Editor Tool. http://researchweb.watson.ibm.com/mpeg4/Projects/authoring.htm

  13. John H, Jack S (1992) Speeding up the douglas-peucker line-simplification algorithm. In: Proceedings 5th Intl symposium on Spatial Data Handling, pp 134-143

  14. Lombard M, Snyder-Duch J (2001) Interactive advertising and presence: a framework. Journal of Interactive Advertising 1(2), (Online). Available: www.jiad.org/vol1/no2/lombard/index.html

  15. Mcguffin M, Burtnyk N, Kurtenbach G, Street K (2002) FaST Sliders: integrating marking menus and the adjustment of continuous values. Graphics Interface, pp 35–42

  16. Neuschmied H, Trichet R, Merialdo B (2007) Fast annotation of video objects for interactive TV. In: Proceedings of the 15th international conference on Multimedia, pp 158–159

  17. Open Computer Vision Library (OpenCV), http://sourceforge.net/projects/opencvlibrary/

  18. Ramos G, Balakrishnan R (2003) Fluid interaction techniques for the control and annotation of digital video. In: Proceedings of the 16th annual ACM symposium on User interface software and technology, pp 105–114

  19. Shneiderman B, Kang H (2000) Direct Annotation: a drag-and-drop strategy for labeling photos. In: Proceedings of the International Conference on Information Visualisation, pp 88–98

  20. Trichet R, Merialdo B (2006) Fast video object selection for interactive television. In: IEEE International Conference on Multimedia and Expo (ICME), pp 989–992

  21. VideoClix.tv, http://www.videoclix.tv

  22. Yu-jin Z (2006) Advances in image and video segmentation. IRM Press

Download references

Acknowledgments

We acknowledge the contribution of the tvN broadcasting company who allowed us to use their copyright TV program, Shining Girl. We would also like to thank the specialist and other participants who helped us with the evaluation, and the reviewers of this paper for many valuable suggestions.

Author information

Authors and Affiliations

  1. Department of Computer Science, Yonsei University, Seoul, South Korea

    Tae-Jin Park, Jae-Kyung Kim & Yoon-Chul Choy

Authors
  1. Tae-Jin Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jae-Kyung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yoon-Chul Choy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jae-Kyung Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Park, TJ., Kim, JK. & Choy, YC. Creating a clickable TV program by sketching and tracking freeform triggers. Multimed Tools Appl 59, 833–850 (2012). https://doi.org/10.1007/s11042-011-0773-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0773-6

Keywords

Search

Navigation